New issue
Advanced search Search tips
Note: Color blocks (like █ or █) mean that a user may not be available. Tooltip shows the reason.

Issue 826903 link

Starred by 1 user
Status: Duplicate
Merged: issue 815308
Owner:
akes...@chromium.org
Closed: Apr 2018
Cc:
█ kkan...@chromium.org
█ pmanavalan@chromium.org
rohi...@chromium.org
vsu...@chromium.org
dhadd...@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 1
Type: Bug



Sign in to add a comment

coral nasher robo robo360 build failure

Project Member Reported by dchan@chromium.org, Mar 28 2018 
nasher has been failure in M66 and M67

https://cros-goldeneye.corp.google.com/chromeos/console/listBuild?boards=coral%2Cnasher&milestone=&chromeOsVersion=&chromeVersion=&startTimeFrom=&startTimeTo=#/

The failed tests is cheets_CTS_N.CtsAccountManagerTestCases
log link 
https://ubercautotest.corp.google.com/new_tko/#tab_id=test_detail_view&object_id=700643327

INFO log https://00e9e64bacb9ba8c5d1c446783d3d446201249b77623b3b0c0-apidata.googleusercontent.com/download/storage/v1/b/chromeos-autotest-results/o/187008664-chromeos-test%2Fchromeos2-row4-rack9-host10%2Fcheets_CTS_N.CtsAccountManagerTestCases%2Fdebug%2Fcheets_CTS_N.CtsAccountManagerTestCases.INFO?qk=AD5uMEuDdCJv7abyHKwSrjbTgwckDeuUi9Q8l5pBnZXlnj4MSJnKXVk3gKGvsNVJS01uhqIaYKsD07QUnM2lKuzGEprsiunbZxHuadiIaiZEsiCSh8qT5UAFJrSAX0yhptY-koUqJGQ9psXI6fiqilfOhM4lykypiG4A48ICQ0HZNw2KZt14L6kFg7VC8LW3FUTrC_pj-mWnEztmp0DXYZnUt2erbf1LCzgFmCpf_uWjuYLDzpW7Vc3LncW9iJ3QPO0LBXEILdt-5EPY4MhEUASsJYf05F21CMBz8kJLWUftwfWbPyzaJ7FUh-wPFcMX5a8a16eU6KQmxyAbXm9JfGUBvWiHOL88VpFI7wpm5kJGVxrsPCM8XGzerhOGugJ0GrWg8PDUUA5P1pKZ6L0V0NWXD0Gl43X79hWw-xALoHvEHyiYJdToLGVBB887Tk0bHdmnPC_0ez9035h1Tv_xzUCfOjwXQMQyt6BwkeCLlX__pRr8uodszXserRXs5THr-sukIE5bHBiqCYykyEXmlF8BSMae5GxJxwXS5rveU49SXqpuBNMANNTZ4_H3c_SKDpWgai9Tpeo59Yz6UsKQ0eOiaWyYujoMuu6m6inP-SZEAUuAQZXNQzHZeX03hvDUu3u5mh9PGTKz9efKEBxa-e-xuLPlm2IEI7_jDyyjhkMLkkjIMynueuD7HwbJ5AF8wo4efQFc9vUUd-Dvw8a7JlVKi2LE0i1guxM2DI0LvHYl0qe5oZms8YJtSR9qzZsnBhHDLxauCaPvRB2XU5aN98lDTdFSeozEpuc3DJKpK4Z_TbWghq4JfuP3zWeV9bL4NNH-c-puRKenFd1MWjwMxl74oXkEWZVQnqvsky5Nso3gTfeoOh42DCrHSeIasqhBXjlKEi97ELiQNAIgZ67XrRLOrQAsrH4fTHcmKvE94NrQ8dtjLrLouKI


03/27 22:45:08.164 WARNI|              test:0637| The test failed with the following exception
Traceback (most recent call last):
  File "/usr/local/autotest/client/common_lib/test.py", line 631, in _exec
    _call_test_function(self.execute, *p_args, **p_dargs)
  File "/usr/local/autotest/client/common_lib/test.py", line 831, in _call_test_function
    return func(*args, **dargs)
  File "/usr/local/autotest/client/common_lib/test.py", line 495, in execute
    dargs)
  File "/usr/local/autotest/client/common_lib/test.py", line 362, in _call_run_once_with_retry
    postprocess_profiled_run, args, dargs)
  File "/usr/local/autotest/client/common_lib/test.py", line 400, in _call_run_once
    self.run_once(*args, **dargs)
  File "/usr/local/autotest/server/site_tests/cheets_CTS_N/cheets_CTS_N.py", line 248, in run_once
    precondition_commands)
  File "/usr/local/autotest/server/cros/tradefed_test.py", line 1102, in _run_tradefed_with_retries
    self.summary))
TestWarn: Passed: after 1 retries passing 87 tests, waived=0. run(t=0, p=0, f=0, ne=0, w=0) retry(t=87, p=87, f=0, ne=0, w=0)
03/27 22:45:08.177 INFO |     tradefed_test:0152| Cleaning up /tmp/autotest-tradefed-install_PVlUdm.


Not sure why it failed at the end, here is a sucessful run on astronaut https://00e9e64bacb76dbb1d41f06d006e4b0b2a50df828b226c5910-apidata.googleusercontent.com/download/storage/v1/b/chromeos-autotest-results/o/187008855-chromeos-test%2Fchromeos2-row8-rack5-host5%2Fcheets_CTS_N.CtsAccountManagerTestCases%2Fdebug%2Fcheets_CTS_N.CtsAccountManagerTestCases.INFO?qk=AD5uMEuwbSNexzSmlOz_F2iVdL8w4U-VZWOeocN8ur7kGUlznmmySiLiAZvsYVnw7BQDmnvKyb37lgDEYnkvukEeyifTB-PgBUyVM9c99Fv4Lp2BD1MHhuu-uNJ3TBJZc0YlwbDP7ps9o_eeAdYNu9c0mZme2Ue0rtnfmqlmdzLBigFD9LU3yXHqxGQyDlURuzdhpSjXROoLaeUZ4L13OlJBrjBHeKghnhdvSHpZOf-_odQX75VHJFdHUWynZ6-N5s9M6LDFVa7wVdyfm2JwYBu4J7QLoUQljpemPwvdHNyXWLl4jAL3ATZ6lRLSglcVO2U5VwGLWS_qE1WF7uLf0Zu_HPdoLzSANYD1VVljnFFuN_53KlMjwnv1GaW4SCcR7gQAryzwjcB-AWosxgjJ2bOB0gPeVJ_7B91vOPKXw7DliQBy0p69UmY2YLf8eO8UfGN3juv3r9zNJ5OfP4p9NKi6iKs667WQLR_XOGytBq7j-HOaRoNGmraTecmb2TJyYmEpk7Li-oIdtC8AeLK5KfUEuKmCL3tcFIQcXAWN3-fw1mn9iEdAt1ntCYtrwUbQUndWT58JEk-gJO8L-T-zAbxiQhmRQ01Ww4RVE1wJs1Ox1viIJKkw9w6aCY6XPbv4i93INMiwPDp8FdSwNhJA3a7AdP76Q1ecnoSjmfBUUnb8PC4BGH9XGP8uw5N-J3JtMmd7VwOD7MQxwQ13OWFBAMAsNGdKGctMxu91MmcBt8UyQfFcu8lCyUNBscZwPFdq6sQHOMtAfpHGIyQ5Tzw3AUaXE2STtyl8dQHbI_VM6R9eXRxh0cT8NZjo7BoltkAcl8st-OHcgy4TW-1HtCM7ZFDCcjmEjGnPUUtgvcUVZXF8t7vQPVuZLvkWKRQJrNuS0aDGck9wiEETIiF4VM710gb3JWKuoS_pis9fBfhvLkswf7n1PBCvk9M

Comment 1 by dchan@chromium.org, Mar 28 2018

Cc: vsu...@chromium.org

Comment 2 by rohi...@chromium.org, Mar 28 2018

Cc: dhadd...@chromium.org
Looking at logs:

https://luci-milo.appspot.com/buildbot/chromeos/coral-release/868#

Search for "HWTest [bvt-installer] [nasher] HWTest [bvt-installer] [nasher]"

https://logs.chromium.org/v/?s=chromeos%2Fbb%2Fchromeos%2Fcoral-release%2F868%2F%2B%2Frecipes%2Fsteps%2FHWTest__bvt-installer___nasher_%2F0%2Fstdout

AFAICU, this failure is coming from bvt-installer suite but David can confirm.

Comment 3 by dhadd...@chromium.org, Mar 28 2018 

In general coral is a mess:
https://luci-milo.appspot.com/buildbot/chromeos/coral-release/

The last run failed bvt-installer but it has been failing every suite lately (bvt-arc, inline, etc)

The bvt-installer failure was actually a failure trying to provision the DUT before the test.

Comment 4 by dhadd...@chromium.org, Mar 28 2018 

Looking at some of the other failures most seems like provision failures. I would get infra deputy to take a look here

Comment 5 by dchan@chromium.org, Mar 29 2018

Cc: akes...@chromium.org
Labels: -Pri-3 Pri-1
Owner: shuqianz@chromium.org
assign to current deputy

Comment 6 by dchan@chromium.org, Mar 29 2018

Labels: ReleaseBlock-Stable M-66 M-67

Comment 7 by dchan@chromium.org, Mar 29 2018

Labels: OS-Chrome

Comment 8 by dhadd...@chromium.org, Mar 29 2018

Components: Infra>Client>ChromeOS

Comment 9 by shuqianz@chromium.org, Mar 29 2018 

Here is a brief summary of the recent HWTest failures in coral-release"
https://luci-milo.appspot.com/buildbot/chromeos/coral-release/871: Suite timed out.

https://luci-milo.appspot.com/buildbot/chromeos/coral-release/870: cheets_StartAndroid.stress                FAIL: Autotest client terminated unexpectedly: DUT rebooted during the test run.
Flake DUT

https://luci-milo.appspot.com/buildbot/chromeos/coral-release/869:  provision                                   FAIL: Unhandled DevServerException: CrOS auto-update failed for host chromeos2-row4-rack10-host19: 0) SSHConnectionError: None, 1) SSHConnectionError: ssh: connect to host 100.115.227.82 port 22: Connection timed out

https://luci-milo.appspot.com/buildbot/chromeos/coral-release/868: provision: FAIL: Unhandled DevServerException: CrOS auto-update failed for host chromeos2-row4-rack9-host7: 0) SSHConnectionError: None, 1) SSHConnectionError: ssh: connect to host 100.115.227.48 port 22: Connection timed out

https://luci-milo.appspot.com/buildbot/chromeos/coral-release/867: vision: FAIL: Unhandled DevServerException: CrOS auto-update failed for host chromeos2-row4-rack9-host7: 0) SSHConnectionError: None, 1) SSHConnectionError: ssh: connect to host 100.115.227.48 port 22: Connection timed out

Except for the SSHConnectionError, other failures seem caused by test flake. For the SSHConnectionError seems gone in the most recent runs?

Comment 10 by rohi...@chromium.org, Apr 2 2018

Cc: kkan...@chromium.org pmanavalan@chromium.org
Summary: coral nasher robo robo360 build failure (was: coral nasher build failure)
https://luci-milo.appspot.com/buildbot/chromeos/coral-release/883

Comment 11 by shuqianz@chromium.org, Apr 2 2018

Cc: -akes...@chromium.org
Owner: akes...@chromium.org
Pass to current deputy

Comment 12 by akes...@chromium.org, Apr 2 2018

Mergedinto: 815308
Status: Duplicate (was: Untriaged)
►

Sign in to add a comment