New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 671640 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner: ----
Closed: Dec 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug-Regression

Blocked on:
issue 664765



Sign in to add a comment

loading.mobile failing on Nexus9 (3) and A1 (3) and N7v2 (3)

Project Member Reported by rnep...@chromium.org, Dec 6 2016

Issue description

Revision range first seen: 435222-435251
Link to failing step log:
https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus9%20Perf%20%283%29?numbuilds=200


If the test is disabled, please downgrade to Pri-2.

 
Cc: charliea@chromium.org
Summary: loading.mobile failing on Nexus9 (3) and A1 (3) (was: loading.mobile failing on Nexus9 (3))
Also failing on https://build.chromium.org/p/chromium.perf/builders/Android%20One%20Perf%20%283%29?numbuilds=200
Summary: loading.mobile failing on Nexus9 (3) and A1 (3) and N7v2 (3) (was: loading.mobile failing on Nexus9 (3) and A1 (3))
Also failing on https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus7v2%20Perf%20(3)
Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus9_perf_bisect/builds/2306
Failure reason: the build has failed due to infrastructure failure.

Looks like the bisect hit the hour timeout running the test. Is this the failure we were trying to catch? If not, should we just re-run?
That is not the expected failure, I will restart.

Comment 10 by dtu@chromium.org, Dec 6 2016

Cc: ksakamoto@chromium.org dtu@chromium.org nednguyen@chromium.org
The test appears to take 3 hours. If the bisect timeout is 1 hour, it won't work :P

First failing build was:
https://build.chromium.org/p/chromium.perf/builders/Android%20Nexus9%20Perf%20%283%29/builds/3691


+ksakamoto, +nednguyen There's a CL related to this benchmark in the build's regression range. I'm going to revert.

But I also suspect it's not actually this CL, but rather maybe enabling traffic shaping increases the runtime so much that it hits some kind of timeout in the Android test runner code? It doesn't always stop at the same page, so I suspect some kind of timeout. The logging output says the failing test is "PrintStep" which is in local_device_perf_test_run.py.


https://codereview.chromium.org/2493063002
Enable traffic shaping in loading.mobile benchmark

After this patch, loading.mobile benchmark will run with two traffic
configurations:

- No traffic shaping (as before)
- "Regular 3G" (Down 750kbps, Up 250kbps, 100ms RTT)

Comment 11 by dtu@chromium.org, Dec 6 2016

Randy pointed me to the place where the timeout is, so instead of a revert, here's a CL to increase the timeout.
https://codereview.chromium.org/2556753003
For this benchmark we should only bisect per story.
Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_perf_bisect/builds/3537
Failure reason: the build has failed due to infrastructure failure.

Project Member

Comment 14 by bugdroid1@chromium.org, Dec 6 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/b08e4a84471a430cf1d76e38cf00685c997334e1

commit b08e4a84471a430cf1d76e38cf00685c997334e1
Author: dtu <dtu@chromium.org>
Date: Tue Dec 06 21:50:30 2016

Increase Android perf test timeout from 3 to 5 hours.

Now that loading.mobile is being run twice, both without and with traffic
shaping, it takes over 3 hours.

BUG= 671640 

Review-Url: https://codereview.chromium.org/2556753003
Cr-Commit-Position: refs/heads/master@{#436750}

[modify] https://crrev.com/b08e4a84471a430cf1d76e38cf00685c997334e1/build/android/pylib/local/device/local_device_perf_test_run.py

Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus9_perf_bisect/builds/2308
Failure reason: the build has failed due to infrastructure failure.

Status: Fixed (was: Untriaged)
Blockedon: 664765
Project Member

Comment 19 by 42576172...@developer.gserviceaccount.com, Apr 11 2017

Bisect failed: None
Failure reason: incorrect bisect configuation.

Sign in to add a comment