New issue
Advanced search Search tips

Issue 768390 link

Starred by 0 users

Issue metadata

Status: WontFix
Owner:
Closed: Sep 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

132% regression in media.android.tough_video_cases_tbmv2 at 503733:503822

Project Member Reported by johnchen@chromium.org, Sep 25 2017

Issue description

See the link to graphs below.
 
Project Member

Comment 1 by 42576172...@developer.gserviceaccount.com, Sep 25 2017

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=768390

(For debugging:) Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?sid=de95290ef4ea8c4f50c0d2d61246641fd9d88ca50ef8612583607eee15619bd0


Bot(s) for this bug's original alert(s):

android-nexus5X
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Sep 25 2017

Cc: crouleau@chromium.org
Owner: crouleau@chromium.org
Status: Assigned (was: Untriaged)

=== Auto-CCing suspected CL author crouleau@chromium.org ===

Hi crouleau@chromium.org, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : Caleb Rouleau
  Commit : d00569c2ec14b3a4aa184c27af14c37381b0b08b
  Date   : Fri Sep 22 19:19:49 2017
  Subject: Fix background playback telemetry perf test for Android.

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases_tbmv2
  Metric       : cpu_time_percentage_avg/video.html?src_tulip2.vp9.webm_background
  Change       : 131.97% | 0.338917859668 -> 0.786184213858

Revision             Result                      N
chromium@503732      0.338918 +- 0.00995986      6      good
chromium@503777      0.33739 +- 0.0153304        6      good
chromium@503800      0.341 +- 0.0195056          6      good
chromium@503811      0.338991 +- 0.0175732       6      good
chromium@503817      0.338377 +- 0.00982062      6      good
chromium@503818      0.780311 +- 0.0230885       6      bad       <--
chromium@503819      0.784345 +- 0.0131183       6      bad
chromium@503820      0.7811 +- 0.0092457         6      bad
chromium@503822      0.786184 +- 0.0144013       6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.vp9.webm.background media.android.tough_video_cases_tbmv2

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8967470576733610208


For feedback, file a bug with component Speed>Bisection
Status: WontFix (was: Assigned)
Not a real regression. Change caused by fixing a bug in the benchmark itself.
Cc: mlamouri@chromium.org
Yay! This means the test case is working!

+mlamouri FYI.
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Sep 25 2017

 Issue 768392  has been merged into this issue.

Sign in to add a comment