New issue
Advanced search Search tips

Issue 710128 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner:
Closed: Jun 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocked on:
issue 710239



Sign in to add a comment

20.8% regression in media.tough_video_cases at 459012:459077

Project Member Reported by wolenetz@chromium.org, Apr 10 2017

Issue description

Though ref and test are both noisy, the result appears to have stepped up/this alert seems valid.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=710128

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgrNb6_goM


Bot(s) for this bug's original alert(s):

chromium-rel-mac11-pro
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 10 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_resident_set_size_delta_size/crowd1080.webm_browser


To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982671734782328672

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5875423449186304


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Cc: simonhatch@chromium.org
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Apr 10 2017


=== BISECT JOB RESULTS ===
Bisect failed for unknown reasons

Please contact the team (see below) and report the error.


Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_resident_set_size_delta_size/crowd1080.webm_browser


To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982664744280508800

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5800631962435584


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Blockedon: 710239
Blocking on  crbug.com/710239  for the out of space failure on mac_pro_perf_bisect.
Project Member

Comment 9 by 42576172...@developer.gserviceaccount.com, Apr 12 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: mac_pro_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_resident_set_size_delta_size/crowd1080.webm_browser

Revision             Result                  N
chromium@459011      3461.33 +- 3416.6       21      good
chromium@459077      3447.24 +- 3139.37      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982580399410369808

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5800631962435584


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Status: WontFix (was: Assigned)
Too much noise for successful bisection. Also, the metric returned later to the pre-alert "look" on the graphs.

Sign in to add a comment