pineview-release builder was interrupted at Paygen stage, and the buildslave is offline |
|||||||
Issue descriptionThe pineview-release builder failed at the paygen stage. And the build slave is offline. https://uberchromegw.corp.google.com/i/chromeos/builders/pineview-release-group/builds/2184 The builder has been offline since 3/8/16 2pm-3pm. The logs of the failed paygen stage: 14:20:32: INFO: Emitting control files into /tmp/cbuildbot-tmpnNPsd9/tmpL1AEv9/paygen_build-control_files.9i6cet/autotest/au_control_files 14:20:34: INFO: Source full test payload found at gs://chromeos-releases/canary-channel/x86-mario/7978.5.0/payloads/chromeos_7978.5.0_x86-mario_canary-channel_full_test.bin-852bc2e9f79d927aec6ed860f96c82ba 14:20:35: INFO: Control file emitted at /tmp/cbuildbot-tmpnNPsd9/tmpL1AEv9/paygen_build-control_files.9i6cet/autotest/au_control_files/control.paygen_au_canary_full_7978.5.0 14:20:36: INFO: Source full test payload found at gs://chromeos-releases/canary-channel/x86-mario/8036.0.0/payloads/chromeos_8036.0.0_x86-mario_canary-channel_full_test.bin-06c3be91be8766cfcc8ae71253238fe1 14:20:38: INFO: Control file emitted at /tmp/cbuildbot-tmpnNPsd9/tmpL1AEv9/paygen_build-control_files.9i6cet/autotest/au_control_files/control.paygen_au_canary_full_8036.0.0 14:20:38: INFO: Source full test payload found at gs://chromeos-releases/canary-channel/x86-mario/8036.0.0/payloads/chromeos_8036.0.0_x86-mario_canary-channel_full_test.bin-06c3be91be8766cfcc8ae71253238fe1 14:20:39: INFO: Control file emitted at /tmp/cbuildbot-tmpnNPsd9/tmpL1AEv9/paygen_build-control_files.9i6cet/autotest/au_control_files/control.paygen_au_canary_delta_8036.0.0 14:20:39: INFO: Source full test payload found at gs://chromeos-releases/canary-channel/x86-mario/7978.5.0/payloads/chromeos_7978.5.0_x86-mario_canary-channel_full_test.bin-852bc2e9f79d927aec6ed860f96c82ba 14:20:40: INFO: Control file emitted at /tmp/cbuildbot-tmpnNPsd9/tmpL1AEv9/paygen_build-control_files.9i6cet/autotest/au_control_files/control.paygen_au_canary_delta_7978.5.0 14:20:40: INFO: Packing autotest/au_control_files in /tmp/cbuildbot-tmpnNPsd9/tmpL1AEv9/paygen_build-control_files.9i6cet into /tmp/cbuildbot-tmpnNPsd9/tmpL1AEv9/paygen_build-control_files.9i6cet/paygen_au_canary_control.tar.bz2 14:20:40: INFO: Uploading autotest control tarball to gs://chromeos-image-archive/x86-mario-release/R51-8036.0.0/paygen_au_canary_control.tar.bz2 14:20:42: INFO: RunCommand: /b/cbuild/internal_master/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /tmp/cbuildbot-tmpnNPsd9/tmpuEyo61/temp_summary.json --raw-cmd --task-name x86-mario-release/R51-8036.0.0-paygen_au_canary --dimension os Linux --print-status-updates --timeout 9000 --io-timeout 9000 --hard-timeout 9000 --expiration 1200 -- /usr/local/autotest/site_utils/run_suite.py --build x86-mario-release/R51-8036.0.0 --board x86-mario --suite_name paygen_au_canary --pool bvt --file_bugs True --priority Build --timeout_mins 90 --retry True --suite_min_duts 2 -c Autotest instance: cautotest 03-08-2016 [14:20:45] Submitted create_suite_job rpc 03-08-2016 [14:20:45] Created suite job: http://cautotest.corp.google.com/afe/#tab_id=view_job&object_id=56152316 @@@STEP_LINK@Suite created@http://cautotest.corp.google.com/afe/#tab_id=view_job&object_id=56152316@@@ --create_and_return was specified, terminating now. Will return from run_suite with status: OK 14:20:46: INFO: RunCommand: /b/cbuild/internal_master/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /tmp/cbuildbot-tmpnNPsd9/tmpbIGagQ/temp_summary.json --raw-cmd --task-name x86-mario-release/R51-8036.0.0-paygen_au_canary --dimension os Linux --print-status-updates --timeout 9000 --io-timeout 9000 --hard-timeout 9000 --expiration 1200 -- /usr/local/autotest/site_utils/run_suite.py --build x86-mario-release/R51-8036.0.0 --board x86-mario --suite_name paygen_au_canary --pool bvt --file_bugs True --priority Build --timeout_mins 90 --retry True --suite_min_duts 2 -m 56152316 15:04:49: INFO: Refreshing due to a 401 @@@STEP_FAILURE@@@ Unhandled exception occured in tee: Traceback (most recent call last): File "/b/build/slave/pineview-release-group-master/build/chromite/cbuildbot/tee.py", line 144, in run File "/b/build/slave/pineview-release-group-master/build/chromite/cbuildbot/tee.py", line 86, in _tee File "/b/build/slave/pineview-release-group-master/build/chromite/cbuildbot/tee.py", line 58, in _output OSError: [Errno 30] Read-only file system
,
Mar 10 2016
,
Mar 10 2016
,
Mar 10 2016
,
Mar 10 2016
File system on this guy is trashed. Looking.
,
Mar 11 2016
The virtual drive failed on the builder. No failed drives were flagged. Re-created the virtual drive and redeployed. It's back but the first run failed the ManifestVersionedSync step. https://uberchromegw.corp.google.com/i/chromeos/builders/pineview-release-group/builds/2185/steps/ManifestVersionedSync/logs/stdio
,
Mar 11 2016
logs: ERROR:root:This slave's master (id=751915) has been supplanted by a newer master (id=751988). Aborting Do we need to change some kind of bot config file?
,
Mar 11 2016
+dnj@
,
Mar 11 2016
That was probably caused by a rebuild of the previous build. By the time it executed, that build's master ID was obsolete.
,
Mar 11 2016
so we can expect the next build will not fail with the same error?
,
Mar 11 2016
If my theory in #9 is correct, then yes that would be the expectation.
,
Mar 11 2016
That theory sounds right to me.
,
Apr 13 2016
Closing old & fixed bug. |
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by shuqianz@chromium.org
, Mar 10 2016