New issue
Advanced search Search tips

Issue 786005 link

Starred by 2 users

Issue metadata

Status: WontFix
Owner:
Closed: Nov 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

18.5%-26.3% regression in media.mobile at 516469:516587

Project Member Reported by crouleau@google.com, Nov 16 2017

Issue description

Culprit is probably my change to the metric.
 
Project Member

Comment 1 by 42576172...@developer.gserviceaccount.com, Nov 16 2017

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=786005

(For debugging:) Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?sid=1f7af63bcb04cc9ca1b07e9dbfa8be519c6e8345d63fa4a3cf96663648a81ea3


Bot(s) for this bug's original alert(s):

android-nexus5X
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Nov 16 2017

Cc: crouleau@chromium.org
Owner: crouleau@chromium.org
Status: Assigned (was: Untriaged)

=== Auto-CCing suspected CL author crouleau@chromium.org ===

Hi crouleau@chromium.org, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : Caleb Rouleau
  Commit : 05121b638fb7d738846e17d445d8c7fc7a7d3ce2
  Date   : Wed Nov 15 02:06:57 2017
  Subject: [Telemetry] Repeat MSE test case runs.

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.mobile
  Metric       : story:power_avg/mse.html?media_aac_audio.mp4_h264_video.mp4_waitForPageLoaded_true
  Change       : 27.97% | 2.41475510993 -> 3.09011448671

Revision             Result                    N
chromium@516468      2.41476 +- 0.11651        6      good
chromium@516528      2.41796 +- 0.0876939      6      good
chromium@516543      2.44649 +- 0.0694747      6      good
chromium@516551      2.38158 +- 0.0598995      6      good
chromium@516555      2.38534 +- 0.106718       6      good
chromium@516557      2.42312 +- 0.0333831      6      good
chromium@516558      3.07668 +- 0.0842534      6      bad       <--
chromium@516587      3.09011 +- 0.0796298      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=mse.html.media.aac.audio.mp4.h264.video.mp4.waitForPageLoaded.true media.mobile

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8962749222698931760


For feedback, file a bug with component Speed>Bisection
Status: WontFix (was: Assigned)
This is expected since I changed the test a bit.
Project Member

Comment 5 by 42576172...@developer.gserviceaccount.com, Nov 16 2017

Cc: dalecur...@chromium.org
 Issue 786006  has been merged into this issue.

Sign in to add a comment