New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 745924 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 721894
Owner:
Closed: Jul 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

We're still alerting on media.tough_video_cases benchmark summary metrics :(

Project Member Reported by hubbe@google.com, Jul 18 2017

Issue description

See the link to graphs below.
 
Project Member

Comment 1 by 42576172...@developer.gserviceaccount.com, Jul 18 2017

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=745924

(For debugging:) Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?sid=9686f126f87fe418f49ce0dec850d9fefacb24b3320a6a915067835c1805b8b6


Bot(s) for this bug's original alert(s):

chromium-rel-win7-gpu-nvidia
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jul 19 2017

Cc: crouleau@google.com
Owner: crouleau@google.com

=== Auto-CCing suspected CL author crouleau@google.com ===

Hi crouleau@google.com, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : Caleb Rouleau
  Commit : d91823c73e38ab53f22984d88c8f4a30cb52eda9
  Date   : Wed Jul 12 19:07:50 2017
  Subject: Add performance test for background video playback.

Bisect Details
  Configuration: winx64nvidia_perf_bisect
  Benchmark    : media.tough_video_cases_tbmv2
  Metric       : memory:chrome:all_processes:reported_by_chrome:cc:effective_size_avg/memory:chrome:all_processes:reported_by_chrome:cc:effective_size_avg
  Change       : 0.83% | 17647507.1691 -> 17793187.5556

Revision             Result                   N
chromium@485971      17647507 +- 52091.8      9      good
chromium@486021      17661912 +- 111268       9      good
chromium@486034      17608645 +- 165368       6      good
chromium@486040      17652573 +- 221447       9      good
chromium@486043      17617430 +- 136474       6      good
chromium@486044      17618380 +- 207674       9      good
chromium@486045      17825956 +- 196102       6      bad       <--
chromium@486046      17803503 +- 235802       9      bad
chromium@486071      17793188 +- 262371       9      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases_tbmv2

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8973705716368171472


For feedback, file a bug with component Speed>Bisection
Project Member

Comment 4 by sheriffbot@chromium.org, Jul 19 2017

Labels: Hotlist-Google
Summary: We're still alerting on media.tough_video_cases benchmark summary metrics :( (was: 1.5% regression in media.tough_video_cases_tbmv2 at 485972:486071)
I'll fix this.
Cc: simonhatch@chromium.org
Mergedinto: 721894
Status: Duplicate (was: Assigned)
Not sure how to fix this actually. I'm duping this to the original bug where I tried to fix this. For some reason it didn't work.

Sign in to add a comment