New issue
Advanced search Search tips

Issue 629727 link

Starred by 4 users

Issue metadata

Status: Fixed
Owner:
Closed: Jul 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: Linux
Pri: 2
Type: ----



Sign in to add a comment

"Linux ChromiumOS Tests (dbg)(1)" in bad state

Project Member Reported by hayato@chromium.org, Jul 20 2016

Issue description

Build is broken:
browser_tests on Ubuntu-12.04

Revision range:
chromium 406043 : 406054

Failing builders:
Linux ChromiumOS Tests (dbg)(1): https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20(dbg)(1)


It looks "Builder: Linux ChromiumOS Tests (dbg)(1)" has been failing (Exception steps exception browser_tests on ubuntu-12.04 failed interactive_ui_tests on ubuntu-12.04 failed unit_tests on ubuntu-12.04 failed failure reason
 ) from https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29/builds/16297
 

Comment 1 by smut@chromium.org, Jul 20 2016

Cc: jam@chromium.org
Labels: OS-Linux
Looks like several shards timed out.

e.g.
https://chromium-swarm.appspot.com/user/task/3020fa8bf42a6e10
https://chromium-swarm.appspot.com/user/task/3020fa91c754e910

+cc jam I guess since he debugged browser_tests in another bug recently. Please cc anyone else who'd know how to investigate the tests.

Comment 2 by aga...@chromium.org, Jul 22 2016

Cc: msramek@chromium.org mpear...@chromium.org mark@chromium.org
 Issue 630612  has been merged into this issue.
FYI, the nearly CCed folks are current sheriffs.  (i.e., we're not the answer to "please cc anyone else who'd know how to investigate the tests.")  I promise to look if I have time, but right now a lot of other things are causing more redness than this bot.

Summary: "Linux ChromiumOS Tests (dbg)(1)" in bad state (was: Build is broken: Builder: Linux ChromiumOS Tests (dbg)(1)")
Fundamentally, this bot is in a bad state.
https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29

We have the series of exceptions on July 20-21 that caused the filing of this bug.  These went away for a while and have now returned.

As sheriff, I'm not quite sure how seriously to take the new failures that appeared at the same time as the exceptions returned.
Labels: -Sheriff-Chromium
This bot seems mostly fine now.  Removing from sheriff-queue but leaving the bug open in case anyone (jam@ agable@) wants to investigate the earlier failures.

Note that this bug had  bug 630612  dupped into it.  That bug covers its insanely long pending build queue, which is still an issue.

Comment 6 by aga...@chromium.org, Jul 25 2016

Issue 630833 has been merged into this issue.

Comment 7 by aga...@chromium.org, Jul 25 2016

Owner: aga...@chromium.org
Status: Started (was: Available)
Basically, this bot got slow. This has caused a big pending queue, and has caused it to be building old revisions which, while correct, is confusing.

I'm going to nuke its checkout, clear its pending queue, and let it start over from scratch.

Comment 8 by aga...@chromium.org, Jul 25 2016

Ok, I've done that, and the bot is up and waiting for its next build request. The most recent green builds were all taking about the same amount of time (40-50m) as the green builds before the swaths of exceptions and failures. So I'm hopeful that it will remain on top of its queue this time.

Comment 9 by aga...@chromium.org, Jul 25 2016

Status: Fixed (was: Started)
It ran and completed in 43 minutes, although it did fail two tests (not surprising given that it basically just ran two or more days worth of changes).

Leaving those failures to the sheriffs.
FYI, I followed up on the failing tests.  (Discovered bad change, reverted it.)

Sign in to add a comment