"Exception waiting for results" (suite.py attempts to retry too many times) |
||||||
Issue descriptionhttps://luci-milo.appspot.com/buildbot/chromeos/nyan_kitty-paladin/849 The test (hardware_RamFio) FAILs, then retries and ABORTs, and then suite.py tries to retry again and gets an exception. Relevant part of the log: 02/26 05:15:43.092 INFO | server_job:0184| START 103561288-chromeos-test/chromeos4-row13-rack8-host10/hardware_RamFio hardware_RamFio timestamp=1488113878 localtime=Feb 26 04:57:58 02/26 05:15:43.092 INFO | server_job:0184| FAIL 103561288-chromeos-test/chromeos4-row13-rack8-host10/hardware_RamFio hardware_RamFio timestamp=1488114783 localtime=Feb 26 05:13:03 Autotest client terminated unexpectedly: DUT rebooted during the test run. 02/26 05:15:43.093 INFO | server_job:0184| END FAIL 103561288-chromeos-test/chromeos4-row13-rack8-host10/hardware_RamFio hardware_RamFio timestamp=1488114783 localtime=Feb 26 05:13:03 02/26 05:15:43.422 INFO | server_job:0184| START 103561288-chromeos-test/chromeos4-row13-rack8-host10/hardware_RamFio hardware_RamFio timestamp=1488113877 localtime=Feb 26 04:57:57 02/26 05:15:43.422 INFO | server_job:0184| ABORT 103561288-chromeos-test/chromeos4-row13-rack8-host10/hardware_RamFio hardware_RamFio timestamp=1488114783 localtime=Feb 26 05:13:03 Job aborted unexpectedly 02/26 05:15:43.423 INFO | server_job:0184| END ABORT 103561288-chromeos-test/chromeos4-row13-rack8-host10/hardware_RamFio hardware_RamFio timestamp=1488114783 localtime=Feb 26 05:13:03 02/26 05:15:43.729 ERROR| suite:1047| Exception waiting for results Traceback (most recent call last): File "/usr/local/autotest/server/cros/dynamic_suite/suite.py", line 1044, in wait bug_template=bug_template) File "/usr/local/autotest/server/cros/dynamic_suite/suite.py", line 1072, in _record_result retry_for=result.id, ignore_errors=True) File "/usr/local/autotest/server/cros/dynamic_suite/suite.py", line 890, in _schedule_test old_job_id=retry_for, new_job_id=job.id) File "/usr/local/autotest/server/cros/dynamic_suite/suite.py", line 153, in add_retry old_job_id) ValueError: We have already retried or attempted to retry job 103561288
,
Feb 27 2017
,
Mar 1 2017
Paul, Aviv - is there a suggested behavior change for retries in this?
,
Mar 7 2017
,
Mar 8 2017
Yes, I'm not sure what the context is here, but the exception message indicates that: - the job was retried twice, - and jobs can only be retried once (why is this?) Apparently there is a bug in autotest where jobs can be retried more than once.
,
Mar 8 2017
(not working on this actively, leaving open for future investigation)
,
Mar 15 2017
,
Mar 30 2018
|
||||||
►
Sign in to add a comment |
||||||
Comment 1 by pho...@chromium.org
, Feb 27 2017Labels: -Pri-3 OS-Chrome Pri-2