New issue
Advanced search Search tips

Issue 679506 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 679324
Owner: ----
Closed: Jan 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocked on:
issue 669608



Sign in to add a comment

26.2%-122% regression in scheduler.tough_scheduling_cases at 441374:441545

Project Member Reported by benhenry@google.com, Jan 9 2017

Issue description

Graphs below.
 
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jan 10 2017


=== BISECT JOB RESULTS ===
Perf regression found but unable to continue

Bisect was stopped because a commit couldn't be classified as either
good or bad.


Bisect Details
  Configuration: win_x64_perf_bisect
  Benchmark    : scheduler.tough_scheduling_cases
  Metric       : mean_input_event_latency/mean_input_event_latency

Revision             Result                  N
chromium@441458      2.85044 +- 36.8896      180      good
chromium@441469      3.14313 +- 52.8348      180      good
chromium@441475      3.13894 +- 52.2054      179      unknown
chromium@441480      7.34712 +- 101.51       180      bad
chromium@441501      7.23471 +- 100.659      180      bad
chromium@441543      7.00494 +- 96.0882      179      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests scheduler.tough_scheduling_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8990906218164247648

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5881320447672320


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Cc: dtu@chromium.org simonhatch@chromium.org
+simonhatch, dtu: seems like for the bisect in #3 the unknown revision should have been classified as good?
Blockedon: 669608
Yeah looks like it should have, it got really close, p 0.0237. We have a bug out to potentially try averaging the values for summary results like this (as the dashboard does), instead of just using the raw data, I'll block on that.

Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Jan 13 2017

Mergedinto: 679324
Status: Duplicate (was: Untriaged)

=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : dtapuska
  Commit : 5494d50ab65532c64a28e91e23b0a722ebbfe8ed
  Date   : Wed Jan 04 22:02:35 2017
  Subject: Remove the requirement to only rAF align non-blocking touch moves.

Bisect Details
  Configuration: win_x64_perf_bisect
  Benchmark    : scheduler.tough_scheduling_cases
  Metric       : mean_input_event_latency/mean_input_event_latency
  Change       : 142.88% | 2.82527854406 -> 6.86191111111

Revision             Result                   N
chromium@441410      2.82528 +- 0.802414      6      good
chromium@441477      2.74863 +- 0.477842      6      good
chromium@441478      7.14943 +- 0.459615      6      bad       <--
chromium@441479      7.17247 +- 0.750156      6      bad
chromium@441480      7.14413 +- 1.22329       6      bad
chromium@441482      7.24278 +- 0.803397      6      bad
chromium@441486      7.31022 +- 1.42881       6      bad
chromium@441494      6.89678 +- 0.724246      6      bad
chromium@441510      7.53469 +- 1.29243       6      bad
chromium@441543      6.86191 +- 0.942304      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests scheduler.tough_scheduling_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8990647830275445488

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5284402268995584


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Sign in to add a comment