New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 713546 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Closed: Sep 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

9.9% regression in speedometer at 465664:465687

Project Member Reported by jarin@google.com, Apr 20 2017

Issue description

See the link to graphs below.
 

Comment 1 by jarin@google.com, Apr 20 2017

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=713546

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwr_DoQkM


Bot(s) for this bug's original alert(s):

android-webview-nexus6

Comment 3 by jarin@chromium.org, Apr 20 2017

Owner: jarin@chromium.org
Project Member

Comment 4 by 42576172...@developer.gserviceaccount.com, Apr 21 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : speedometer
  Metric       : benchmark_duration/benchmark_duration


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981813987254000096

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Apr 23 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : speedometer
  Metric       : benchmark_duration/benchmark_duration


To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981693354923582560

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 8 by 42576172...@developer.gserviceaccount.com, Apr 25 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : speedometer
  Metric       : benchmark_duration/benchmark_duration

Revision             Result                    N
chromium@465663      1.76652 +- 0.0934675      21      good
chromium@465687      1.7622 +- 0.0637897       21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981440767338235936

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Cc: sullivan@chromium.org nedngu...@google.com
Status: Assigned (was: Untriaged)
Seems to be a broken bisect again. The current behavior is strange, the duration doubled and ref stopped completely. What is going on?
For this bug, I would ignore a small regression of 1.85 minutes --> 2.05 minutes (12seconds)
Cc: simonhatch@chromium.org mikec...@chromium.org martiniss@chromium.org
martiniss, mikecase: I think this change may actually be caused by the webview bots being fixed (they had accidentally been running chrome). How could we tell?

simonhatch: can you look into the failed bisect?
#12: We can tell by the bisect data? If bisect says before & after regressions have same results, then it must be due to infra change.
Was failing device_status, latest run appears to be working. Couldn't find a bug associated with fixing the failures though.
re comment 12, 13: Yeah, all the WebView bisect issues were in recipe/infra code. Bisects use the latest version of that code always, so basically, if the issue shows up in bisect its probably a real issue. If it doesnt show up in bisect, this regression was probably caused by infra.

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : speedometer
  Metric       : benchmark_duration/benchmark_duration

Revision             Result                    N
chromium@465663      1.76652 +- 0.0934675      21      good
chromium@465687      1.7622 +- 0.0637897       21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests speedometer

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980663184020685472

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6334716057223168


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 18 by sheriffbot@chromium.org, Jul 19 2017

Labels: Hotlist-Google

Comment 19 by jarin@chromium.org, Jul 29 2017

Status: WontFix (was: Assigned)

Comment 20 by jarin@chromium.org, Jul 29 2017

Status: Assigned (was: WontFix)

Comment 21 by jarin@chromium.org, Sep 18 2017

Status: WontFix (was: Assigned)
Recovered since then.

Sign in to add a comment