New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 651516 link

Starred by 1 user

Issue metadata

Status: Archived
Owner: ----
Closed: Jun 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 3
Type: Bug



Sign in to add a comment

cbuildbot: Cleanup doesn't clean SyncChrome checkout, leading to leakage into chromeos-chrome build

Project Member Reported by pprabhu@chromium.org, Sep 29 2016

Issue description

See issue 635702 for an instance of this problem.

SyncChrome pulls chrome (and DEPS) source into /b/cbuild/shared_internal/.cache/distfiles/target/chrome-src-internal/

CleanUp stage skips everything under .cache.

It looks like we directly use sources from the above location in building chromeos-chrome though, and this leads to earlier checkouts breaking later builds even after a 'cbuildbot --clobber' build.
 

Comment 1 by autumn@chromium.org, Oct 12 2016

Cc: nxia@chromium.org dgarr...@chromium.org
Would this be fixed by having --clobber not skip .cache?
Yeah, --clobber should wipe all of .cache. That makes is safer, but also more expensive (slower for the next build).

This should be okay, since we clobber a lot less than we used too.
Owner: chingcodes@chromium.org
Chris, tracking down the --clobber behavior for cbuildbot shouldn't be TOO hard.

Comment 4 by nxia@chromium.org, Oct 12 2016

--clobber doesn't clean /b/git-cache, not sure if it affects the build.
/b/git-cache is different from .cache. Though, we have seen at least one bug caused by bad contents in /b/git-cache. Maybe --clobber should wipe the git cache directory as well.

Chris, not that both such directories can be specified on the command line.
I'd recommend against cleaning /b/git-cache under --clobber, at least until we can prove it's needed. We'll lose a lot of the benefits of that cache, and we don't quite control who can hit the clobber check mark when forcing a build. (I've seen multiple clobber builds in parallel launched by team members outside infra).
Secondly, the bug that I refer to specifically here only needs .cache to be cleaned, because we bindmount source from there into the chroot directly.

/b/git-cache is fetched from GS, not GoB, so re-fetching won't cause quota problems.

Refetching it will slow things some, but won't break anything.

Status: Started (was: Available)
So do we want a 2nd argument for clobbering the git-cache or roll that into the existing clobber?

Same argument is best.
Labels: -current-issue
Labels: Hotlist-Fixit
Owner: ----
Status: Available (was: Started)
In practice, this should be fixed now.

1) cbuildbot_launch clobbers that source tree when a builder changes branches.
2) recent cbuildbot clobbers that directory if gclient sync fails (then tries again).

Are there any known issues currently?

Though, I agree that clobber should wipe the cache directory.
Status: Fixed (was: Available)
According to OP (and my memory), #12 is enough, until proven otherwise.

Comment 14 by dchan@chromium.org, Jan 22 2018

Status: Archived (was: Fixed)

Sign in to add a comment