New issue
Advanced search Search tips

Issue 738084 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Jun 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1% regression in media.tough_video_cases_tbmv2 at 482452:482541

Project Member Reported by wolenetz@chromium.org, Jun 29 2017

Issue description

These 2 alerts look valid. Bisecting...
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=738084

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgrpeu4wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgnuCn5AsM


Bot(s) for this bug's original alert(s):

chromium-rel-mac12
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jun 29 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : media.tough_video_cases_tbmv2
  Metric       : memory:chrome:gpu_process:reported_by_chrome:malloc:allocated_objects_size_avg/video.html?src_tulip2.wav_type_audio_seek

Revision             Result                  N
chromium@482451      69037487 +- 718840      21      good
chromium@482541      69011056 +- 679636      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.wav.type.audio.seek media.tough_video_cases_tbmv2

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8975432323309833328


For feedback, file a bug with component Speed>Bisection
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Jun 29 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : media.tough_video_cases_tbmv2
  Metric       : memory:chrome:gpu_process:reported_by_chrome:malloc:allocated_objects_size_avg/video.html?src_tulip2.wav_type_audio_seek

Revision             Result                  N
chromium@482451      68990061 +- 720751      21      good
chromium@482541      69005227 +- 644739      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.wav.type.audio.seek media.tough_video_cases_tbmv2

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8975427458477449888


For feedback, file a bug with component Speed>Bisection
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Jun 29 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : media.tough_video_cases_tbmv2
  Metric       : memory:chrome:gpu_process:reported_by_chrome:malloc:allocated_objects_size_avg/video.html?src_tulip2.wav_type_audio_seek

Revision             Result                  N
chromium@482451      69015477 +- 755452      21      good
chromium@482541      69043033 +- 564714      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.wav.type.audio.seek media.tough_video_cases_tbmv2

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8975426251699917168


For feedback, file a bug with component Speed>Bisection
Cc: crouleau@chromium.org
Status: WontFix (was: Untriaged)
+crouleau@ graphs look convincing, but only a 1% regression that the bisects (even with a wider range -- #6) fail to see (lots of noise hides the regression, maybe).

In this case, I'm marking WontFix (just 1% regression). Please reactivate or re-file if you disagree.
Project Member

Comment 10 by 42576172...@developer.gserviceaccount.com, Jun 29 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_10_12_perf_bisect
  Benchmark    : media.tough_video_cases_tbmv2
  Metric       : memory:chrome:gpu_process:reported_by_chrome:malloc:allocated_objects_size_avg/video.html?src_tulip2.wav_type_audio_seek

Revision             Result                  N
chromium@482451      68947854 +- 732719      21      good
chromium@482541      69009185 +- 655534      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.wav.type.audio.seek media.tough_video_cases_tbmv2

More information on addressing performance regressions:
  http://g.co/ChromePerformanceRegressions

Debug information about this bisect:
  https://chromeperf.appspot.com/buildbucket_job_status/8975422479011823264


For feedback, file a bug with component Speed>Bisection

Sign in to add a comment