New issue
Advanced search Search tips

Issue 731655 link

Starred by 1 user

Issue metadata

Status: Duplicate
Owner: ----
Closed: Jun 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

4.6%-57.7% regression in system_health.common_desktop at 477370:477557

Project Member Reported by primiano@chromium.org, Jun 9 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=731655

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5vvHmggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgltLS4gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglr2wpwsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5uvk-woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5te_qQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglpzEpgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5pv1nAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgluaP4goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5rSK4QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5tv91wsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5qLfuQgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5v27sQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5uvX4QoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgluKAsgsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5r3q_AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5p_8-gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglpTz5wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgloz3_AgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5v2YlwgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5ovYgggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglobi4QkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgloa9hAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5v2C9goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglr2LsQoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglorq5wkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglraGowoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDglvS7kQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5sfCuAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg5seWpQsM


Bot(s) for this bug's original alert(s):

chromium-rel-win10
chromium-rel-win7-dual
chromium-rel-win7-gpu-ati
chromium-rel-win7-gpu-intel
chromium-rel-win7-gpu-nvidia
chromium-rel-win8-dual
win-high-dpi

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: win_perf_bisect
  Benchmark    : system_health.common_desktop
  Metric       : timeToFirstContentfulPaint_avg/browse_media/browse_media_youtube

Revision             Result                  N
chromium@477418      1177.48 +- 2536.02      21      good
chromium@477556      1392.57 +- 3541.38      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.youtube system_health.common_desktop

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977268226117994832

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4954354345312256


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
The actual values on this are pretty crazy noisy, trying to find a cleaner metric to bisect on.

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: win_perf_bisect
  Benchmark    : system_health.common_desktop
  Metric       : timeToFirstContentfulPaint_avg/browse_media/browse_media_youtube

Revision             Result                  N
chromium@477418      1164.9 +- 1703.44       21      good
chromium@477556      1310.31 +- 2027.45      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.youtube system_health.common_desktop

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977253485706107584

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=4954354345312256


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Mergedinto: 730475
Status: Duplicate (was: Untriaged)

=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : mek
  Commit : c8e2b27f71c6792fa1072fa98a22c111ad229090
  Date   : Tue Jun 06 23:18:28 2017
  Subject: Switch to mojo localstorage backend by default.

Bisect Details
  Configuration: win_8_perf_bisect
  Benchmark    : system_health.common_desktop
  Metric       : timeToFirstContentfulPaint_avg/browse_news/browse_news_flipboard
  Change       : 7.09% | 2896.88878571 -> 3102.391

Revision             Result                  N
chromium@477434      2896.89 +- 5047.43      14      good
chromium@477450      2304.39 +- 1065.78      9       good
chromium@477454      2473.43 +- 2340.27      9       good
chromium@477456      2466.52 +- 2076.53      9       good
chromium@477457      2504.88 +- 2727.07      9       good
chromium@477458      2646.43 +- 1242.87      9       bad       <--
chromium@477465      2580.67 +- 2477.25      21      bad
chromium@477496      2648.41 +- 1840.3       21      bad
chromium@477557      3102.39 +- 3775.42      14      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.flipboard system_health.common_desktop

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8977255799529693664

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6390209693876224


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment