New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 599255 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Sep 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

chromium.tryserver.win slave state stale

Project Member Reported by thakis@chromium.org, Mar 30 2016

Issue description

https://codereview.chromium.org/1183563003 made it so that slave checkouts ignore master state and use slave state instead.

It looks like this isn't working fully reliably.

https://build.chromium.org/p/tryserver.chromium.win/builders/win_clang?numbuilds=200 has occasional blocks of "Exception steps exception setup_properties" exceptions, an example is here:

https://build.chromium.org/p/tryserver.chromium.win/builders/win_clang/builds/147

@@@STEP_CURSOR setup_properties@@@
@@@STEP_STARTED@@@
@@@STEP_CURSOR setup_properties@@@
@@@STEP_LOG_LINE@exception@Traceback (most recent call last):@@@
@@@STEP_LOG_LINE@exception@  File "../../../scripts/slave/annotated_run.py", line 599, in get_recipe_properties@@@
@@@STEP_LOG_LINE@exception@    workdir, mastername, buildername)@@@
@@@STEP_LOG_LINE@exception@  File "../../../scripts/slave/annotated_run.py", line 681, in get_factory_properties_from_disk@@@
@@@STEP_LOG_LINE@exception@    (buildername, mastername))@@@
@@@STEP_LOG_LINE@exception@LookupError: builder "win_clang" not found on in master "tryserver.chromium.win"@@@
@@@STEP_LOG_END@exception@@@
@@@STEP_EXCEPTION@@@

I think I configured the master correctly and restarted it yesterday night, and based on most builds succeeding, I think that's true.

It looks like these mostly happen on few slaves:
https://build.chromium.org/p/tryserver.chromium.win/buildslaves/vm612-m4
https://build.chromium.org/p/tryserver.chromium.win/buildslaves/vm624-m4

...oh, it looks like update_scripts fails with "fatal: Unable to create 'E:/b/build/.git/refs/remotes/origin/master.lock': File exists."

Maybe the code from https://codereview.chromium.org/1183563003 should print a better error message if the slave checkout is out of date. I'll file a different ticket for getting these two slaves cleaned up, so I suppose this bug isn't super important. Maybe it helps someone googling for this error in the future.
 
Yeah, update_scripts failures are subtle. 

We had a conversation on one of the infra lists about making it a fatal error for the build and I think there was general agreement that we should do that but no one has done it yet. Dunno if there's a bug for it.

Comment 2 by thakis@chromium.org, Mar 30 2016

(filed bug 599257 for the two slaves failing to update.)

Comment 3 by stip@chromium.org, Mar 30 2016

Cc: iannucci@chromium.org
Labels: -Infra Infra-Platform

Comment 4 by aga...@chromium.org, Apr 27 2016

Components: Infra>Platform
Labels: -Infra-Platform
Status: Available (was: Untriaged)
Project Member

Comment 6 by sheriffbot@chromium.org, Sep 4 2017

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available. If you change it back, also remove the "Hotlist-Recharge-Cold" label.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Status: WontFix (was: Untriaged)
I think it's safe to close this.

Sign in to add a comment