UnitTest, ImageTest stages failing with timeout errors on several canary builders |
||||
Issue descriptionI've noticed a few builds failing in the last few days due to timeout errors in UnitTest and ImageTest stages. Example failures: https://uberchromegw.corp.google.com/i/chromeos/builders/buddy-release/builds/229/steps/UnitTest/logs/stdio https://uberchromegw.corp.google.com/i/chromeos/builders/celes-release/builds/229/steps/UnitTest/logs/stdio Aviv, would infra folks have any insights into these failures? I looked at the logs for a bit but couldn't come up with any good theories to debug this further.
,
Jul 22 2016
Would you or someone else on the infra team have cycles to investigate this further?
,
Jul 22 2016
How about we start with the sheriff? I'd try to look for some new unit test that was added between https://uberchromegw.corp.google.com/i/chromeos/builders/buddy-release/builds/226 (green) and https://uberchromegw.corp.google.com/i/chromeos/builders/buddy-release/builds/227 (unit test timing out)
,
Jul 22 2016
Actually, not so sure the problem started in 8616. It seems to have happened flakily prior to that.
,
Jul 22 2016
,
Jul 25 2016
+Sheriffs. rajatja@, aaboagye@, hidehiko@ can we investigate why the canaries were failing across the board at the unittest and imageTest stages?
,
Jul 25 2016
I've been investigating starting this morning. issue 627881 was where I was placing updates. I haven't figure out why it's taking so long. I was wondering if perhaps the buildslave was too heavily loaded. Additionally, I'm not so sure that the infra/product taskforce needs to be cc'd on this. |
||||
►
Sign in to add a comment |
||||
Comment 1 by akes...@chromium.org
, Jul 22 2016