New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.
Starred by 6 users

Issue metadata

Status: Verified
Closed: Feb 2018
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug

Sign in to add a comment

Issue 793499: hangs with no output until killed by builder.

Reported by, Dec 8 2017 Project Member

Issue description

It started showing up this afternoon (12/08)
See an example build:

Error message:
14:46:31: INFO: 
14:46:31: ERROR: BaseException in _RunParallelStages <class 'chromite.lib.parallel.ProcessSilentTimeout'>: No output from <_BackgroundTask(_BackgroundTask-7:7:2, started)> for 8640 seconds
Traceback (most recent call last):
  File "/b/c/cbuild/repository/chromite/cbuildbot/builders/", line 120, in _RunParallelStages
  File "/b/c/cbuild/repository/chromite/lib/", line 679, in RunParallelSteps
    return [queue.get_nowait() for queue in queues]
  File "/b/c/cbuild/repository/chromite/lib/", line 676, in RunParallelSteps
  File "/usr/lib/python2.7/", line 24, in __exit__
  File "/b/c/cbuild/repository/chromite/lib/", line 562, in ParallelTasks
    raise BackgroundFailure(exc_infos=errors)
BackgroundFailure: <class 'chromite.lib.parallel.ProcessSilentTimeout'>: No output from <_BackgroundTask(_BackgroundTask-7:7:2, started)> for 8640 seconds


Comment 1 by, Dec 11 2017

Seems the error still shows up on the latest lumpy-chrome-pfq:

Comment 2 by, Dec 11 2017

adding this week's folks. dgarrett: is this an infra issue? I'm not sure how we even know this is a "provision error", the output is pretty opaque to me.

Comment 3 by, Dec 11 2017


Comment 4 by, Dec 11 2017

Summary: hangs with no output until killed by builder. (was: Hwtest provision error on several chrome PFQs and informational PFQs )
Oh... no, that's not a provision error.

There is a long standing problem with incorrectly appearing to hang.

Comment 5 by, Dec 11 2017

I thought xixuan@ had fixed this previously.

Comment 6 by, Dec 12 2017

Is this the same as  issue 772985 , then?

Comment 7 by, Dec 12 2017

Status: Started (was: Untriaged)
Re #6, yes. I will prepare a fix later today.

Comment 8 by, Dec 13 2017

Issue 794125 has been merged into this issue.

Comment 9 by, Dec 14 2017

 Issue 794859  has been merged into this issue.

Comment 10 by, Dec 14 2017

More examples of this. It seems that we are hitting this a LOT now, and it's blocking a variety of things.

Comment 11 by, Dec 15 2017

Project Member
The following revision refers to this bug:

commit cd0856953252117831f4c4441093924d390ae14d
Author: Xixuan Wu <>
Date: Fri Dec 15 02:11:53 2017

cbuildbot: retry swarming commands if it's timed out.

BUG= chromium:793499 
TEST=Run tryjob:

Change-Id: I70861c0b7f22312295ea3a71cd8b55b332168519
Commit-Ready: Xixuan Wu <>
Tested-by: Xixuan Wu <>
Reviewed-by: Don Garrett <>


Comment 12 by, Dec 15 2017

Hopefully, this is now fixed?

Comment 13 by, Dec 15 2017

I hope so... I will wait for some days for more reports if there's any...

Comment 14 by, Feb 10 2018

Status: Verified (was: Started)
Never see this issue reported.

Sign in to add a comment