New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 693528 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Last visit > 30 days ago
Closed: Feb 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

8.8% regression in system_health.common_desktop at 450685:450851

Project Member Reported by alexclarke@chromium.org, Feb 17 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=693528

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDguJeOqgkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDguPOetAoM


Bot(s) for this bug's original alert(s):

chromium-rel-mac-retina
chromium-rel-mac11
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Feb 17 2017

Cc: rnep...@chromium.org
Owner: rnep...@chromium.org

=== Auto-CCing suspected CL author rnephew@chromium.org ===

Hi rnephew@chromium.org, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : rnephew
  Commit : 2669800fd23e14d62eb724535e49a280e0f19db2
  Date   : Wed Feb 15 19:27:28 2017
  Subject: [Telemetry] Add mac specific youtube recordings for system_health_desktop.

Bisect Details
  Configuration: mac_10_11_perf_bisect
  Benchmark    : system_health.common_desktop
  Metric       : timeToFirstMeaningfulPaint_avg/load_media/load_media_youtube
  Change       : 8.39% | 474.254777778 -> 514.053666666

Revision             Result                  N
chromium@450703      474.255 +- 57.7849      9      good
chromium@450746      475.525 +- 45.0331      6      good
chromium@450767      461.817 +- 13.4889      6      good
chromium@450768      476.972 +- 32.521       6      good
chromium@450769      540.533 +- 71.5144      6      bad       <--
chromium@450770      521.602 +- 46.3837      6      bad
chromium@450772      511.669 +- 15.416       6      bad
chromium@450777      508.182 +- 16.1202      6      bad
chromium@450788      514.054 +- 29.4654      9      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=load.media.youtube system_health.common_desktop

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8987407097267320032

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4518259275071488


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
This is an expected regression. The youtube pages in system health went from not playing videos to playing videos. I do not know enough about this metric to know if that should affect this metric but it seems reasonable to me.
Status: WontFix (was: Untriaged)
I think we can close this then :)

Sign in to add a comment