New issue
Advanced search Search tips

Issue 783933 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Nov 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Fuchsia
Pri: 1
Type: Bug-Regression



Sign in to add a comment

Chromium FYI bot test runs for Fuchsia/ARM64 are taking one hour (each!) to time out

Project Member Reported by w...@chromium.org, Nov 10 2017

Issue description

All the Fuchsia/ARM64 test runs since build 1509 have had every test fixture fail with "not enough capacity".

Build https://build.chromium.org/p/chromium.fyi/builders/Fuchsia%20ARM64/builds/1509 just shows "not enough capacity" for each shared, but the build still took 12hrs(!) end-to-end.

Build https://build.chromium.org/p/chromium.fyi/builders/Fuchsia%20ARM64/builds/1510 shows the same "not enough capacity" error for each shard, but also shows each shard running for ~1hr before expiring.

It looks like:
- Our Fuchsia/ARM64 swarming config is broken.
- The bots don't handle this particular form of brokenness well at all.

Marking this as a P0 since we're currently lacking test coverage for Fuchsia/ARM64 as a result.
 

Comment 1 by w...@chromium.org, Nov 10 2017

Cc: kmarshall@chromium.org
Owner: w...@chromium.org
Status: Started (was: Assigned)
Queued a revert at https://chromium-review.googlesource.com/c/chromium/src/+/764505 and pinged jbudorick@ to see if we can abort the overrunning build job once that has landed.

Comment 2 by w...@chromium.org, Nov 10 2017

Labels: -Pri-0 Pri-1
Project Member

Comment 3 by bugdroid1@chromium.org, Nov 10 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f6ccfd4e25292e96f6fc735b86a00e65bf646bba

commit f6ccfd4e25292e96f6fc735b86a00e65bf646bba
Author: Wez <wez@chromium.org>
Date: Fri Nov 10 21:59:42 2017

Revert "Fuchsia: use ARM-based swarming bots with KVM for Fuchsia FYI job."

This reverts commit 0e648d4b9a3a2316895edd2d31d0299f83c7c1d4.

Reason for revert: This appears to be causing all swarming shards to timeout, but only after hanging for an hour per-fixture.

Original change's description:
> Fuchsia: use ARM-based swarming bots with KVM for Fuchsia FYI job.
>
> Additionally add "net_unittests" test job to the trybot recipe.
>
> Bug: 780652
> Change-Id: I1baaecac057d7784166710baa52608f6272e659f
> Reviewed-on: https://chromium-review.googlesource.com/761763
> Commit-Queue: Kevin Marshall <kmarshall@chromium.org>
> Reviewed-by: Scott Graham <scottmg@chromium.org>
> Reviewed-by: Dirk Pranke <dpranke@chromium.org>
> Cr-Commit-Position: refs/heads/master@{#515394}

TBR=dpranke@chromium.org,kmarshall@chromium.org,scottmg@chromium.org

Change-Id: I37865008768dc84b1a3b501f71d5952b4c2ddbb6
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: 780652,  783933 
Reviewed-on: https://chromium-review.googlesource.com/764505
Commit-Queue: Wez <wez@chromium.org>
Reviewed-by: Kevin Marshall <kmarshall@chromium.org>
Reviewed-by: Wez <wez@chromium.org>
Cr-Commit-Position: refs/heads/master@{#515704}
[modify] https://crrev.com/f6ccfd4e25292e96f6fc735b86a00e65bf646bba/testing/buildbot/chromium.fyi.json

Comment 4 by w...@chromium.org, Nov 10 2017

Status: Fixed (was: Started)

Sign in to add a comment