New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 667458 link

Starred by 1 user

Issue metadata

Status: Duplicate
Owner:
Last visit > 30 days ago
Closed: Nov 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

HWTest Failure for daisy_spring

Project Member Reported by furquan@chromium.org, Nov 21 2016

Issue description

https://uberchromegw.corp.google.com/i/chromeos/builders/daisy_spring-release/builds/1926/steps/HWTest%20%5Bbvt-inline%5D/logs/stdio

@@@STEP_FAILURE@@@
08:48:39: WARNING: No output from <_BackgroundTask(_BackgroundTask-7:7:4, started)> for 8640 seconds
  File "chromite/bin/cbuildbot", line 168, in <module>
    DoMain()
  File "chromite/bin/cbuildbot", line 164, in DoMain
    commandline.ScriptWrapperMain(FindTarget)
  File "/b/cbuild/internal_master/chromite/lib/commandline.py", line 834, in ScriptWrapperMain
    ret = target(argv[1:])
  File "/b/cbuild/internal_master/chromite/scripts/cbuildbot.py", line 1307, in main
    _RunBuildStagesWrapper(options, site_config, build_config)
  File "/b/cbuild/internal_master/chromite/scripts/cbuildbot.py", line 248, in _RunBuildStagesWrapper
    if not builder.Run():
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/generic_builders.py", line 316, in Run
    self.RunStages()
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 474, in RunStages
    super(DistributedBuilder, self).RunStages()
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 334, in RunStages
    self._RunDefaultTypeBuild()
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 321, in _RunDefaultTypeBuild
    self.RunBuildStages()
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 282, in RunBuildStages
    with parallel.BackgroundTaskRunner(task_runner) as queue:
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 745, in BackgroundTaskRunner
    with _BackgroundTask.ParallelTasks(steps, halt_on_error=halt_on_error):
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 532, in ParallelTasks
    task.start()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 388, in start
    return multiprocessing.Process.start(self)
  File "/usr/lib/python2.7/multiprocessing/process.py", line 130, in start
    self._popen = Popen(self)
  File "/usr/lib/python2.7/multiprocessing/forking.py", line 126, in __init__
    code = process_obj._bootstrap()
  File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 399, in run
    errors = self._Run()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 441, in _Run
    self._task(*self._task_args, **self._task_kwargs)
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 602, in TaskRunner
    task(*x, **task_kwargs)
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 128, in _RunBackgroundStagesForBoardAndMarkAsSuccessful
    self._RunBackgroundStagesForBoard(builder_run, board)
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 220, in _RunBackgroundStagesForBoard
    lambda: self._RunHWTests(builder_run, board),
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 674, in RunParallelSteps
    halt_on_error=halt_on_error):
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 532, in ParallelTasks
    task.start()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 388, in start
    return multiprocessing.Process.start(self)
  File "/usr/lib/python2.7/multiprocessing/process.py", line 130, in start
    self._popen = Popen(self)
  File "/usr/lib/python2.7/multiprocessing/forking.py", line 126, in __init__
    code = process_obj._bootstrap()
  File "/usr/lib/python2.7/multiprocessing/process.py", line 258, in _bootstrap
    self.run()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 399, in run
    errors = self._Run()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 441, in _Run
    self._task(*self._task_args, **self._task_kwargs)
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 220, in <lambda>
    lambda: self._RunHWTests(builder_run, board),
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/simple_builders.py", line 112, in _RunHWTests
    self._RunParallelStages(parallel_stages)
  File "/b/cbuild/internal_master/chromite/cbuildbot/builders/generic_builders.py", line 118, in _RunParallelStages
    parallel.RunParallelSteps(steps)
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 675, in RunParallelSteps
    pass
  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
    self.gen.next()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 546, in ParallelTasks
    task_errors = task.Wait()
  File "/b/cbuild/internal_master/chromite/lib/parallel.py", line 363, in Wait
    traceback.print_stack()



Assigning it to pprabhu@ since you looked at a similar bug. Please re-assign if someone else is the right owner.
 
Cc: shuqianz@chromium.org
Owner: furquan@chromium.org
Status: Assigned (was: Untriaged)
+cc: shuqianz, this week's infra deputy.

--> back to furquan. Infra deputy is not the primary contact for generic release builder failures.
Please dig one level deeper. Does this look like an infra issue? Why did that test timeout? (there should be a suite link on the waterfall, which will tell you what happened to the tests)

Comment 2 by groeck@chromium.org, Nov 21 2016

Digging through logs I found the following:

11/21 08:57:07.036 ERROR|                db:0174| 08:57:07 11/21/16: An operational error occured during a database operation: (2006, 'MySQL server has gone away')
11/21 09:04:21.692 ERROR|                db:0174| 09:04:21 11/21/16: An operational error occured during a database operation: (2006, 'MySQL server has gone away')
11/21 09:23:37.600 ERROR|                db:0174| 09:23:37 11/21/16: An operational error occured during a database operation: (2006, 'MySQL server has gone away')

Same as crbug.com/666070 ?

Could be 
Thanks for looking that up groeck@. Yes, it looks similar to 666070. I will update on that bug.
Owner: jrbarnette@chromium.org
jrbarnette@ can you please check if this is a duplicate of 666070?
Mergedinto: 666070
Status: Duplicate (was: Assigned)
jrbarnette@ is out. I am the deputy of this week. I think it is the same cause. I will merge this bug into 666070.

Sign in to add a comment