Issue metadata
Sign in to add a comment
|
21.8% regression in memory.long_running_idle_gmail_background_tbmv2 at 392622:392676 |
||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
May 12 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@392621 3.89438 0.232877 18 good chromium@392676 3.9772 0.29576 18 bad Bisect job ran on: winx64ati_perf_bisect Bug ID: 611454 Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests memory.long_running_idle_gmail_background_tbmv2 Test Metric: Idle-v8-gc-scavenger_avg/Idle-v8-gc-scavenger_avg Relative Change: 0.02% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64ati_perf_bisect/builds/1352 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9012849849648763344 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6433156610129920 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Jun 1 2016
Moving this nonessential bug to the next milestone. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jun 24 2016
Assigning to the test owner, ulan. This seems super noisy, only happened on one bot, and the bisect failed to reproduce. WontFix?
,
Jun 28 2016
Does ChromiumPerf/chromium-rel-win7-gpu-ati have the same hardware and OS as winx64ati_perf_bisect? I started bisect with larger range. It is strange that the bot cannot reproduce the good result.
,
Jun 28 2016
ulan: yes, they do have the same hardware. Since the test is noisy, it's possible there was a regression but the dashboard pinpointed the wrong range. I re-ran with an expanded range here: https://chromeperf.appspot.com/buildbucket_job_status/9008603380677459904
,
Jul 8 2016
Trying a wider bisect.
,
Jul 10 2016
This issue has been moved once and is lower than Pri-1. Removing the milestone. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
,
Jul 18 2016
My bisect failed with message "Exception steps exception wiggling revision chromium@392629.gsutil ls exception wiggling revision" (https://build.chromium.org/p/tryserver.chromium.perf/builders/winx64ati_perf_bisect/builds/1400) What does it mean?
,
Jul 29 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005788301037741728
,
Jul 29 2016
No idea. Lets try another bisect.
,
Jul 29 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005765730147095456
,
Jul 29 2016
Bisect failed: Unknown Failure reason: the build has failed.
,
Jul 30 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005671800860577376
,
Aug 7 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9005032779373138224
,
Aug 7 2016
Bisect failed: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64ati_perf_bisect/builds/1471 Failure reason: the build has failed.
,
Aug 18 2016
Perf sheriff ping: reminder to follow up on possible performance issues
,
Aug 21 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/9003762723034927456
,
Aug 21 2016
===== BISECT JOB RESULTS ===== Status: completed === Bisection aborted === The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression. Please contact the the team (see below) if you believe this is in error. === Warnings === The following warnings were raised by the bisect job: * Bisect failed to reproduce the regression with enough confidence. ===== TESTED REVISIONS ===== Revision Mean Std Dev N Good? chromium@392621 3.87805 0.354155 18 good chromium@392676 3.8463 0.265371 18 bad Bisect job ran on: winx64ati_perf_bisect Bug ID: 611454 Test Command: src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --also-run-disabled-tests memory.long_running_idle_gmail_background_tbmv2 Test Metric: Idle-v8-gc-scavenger_avg/Idle-v8-gc-scavenger_avg Relative Change: 4.75% Score: 0 Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/winx64ati_perf_bisect/builds/1520 Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005788301037741728 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=5211621375344640 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Aug 25 2016
Bisect bot cannot reproduce the regression. |
|||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||
Comment 1 by pras...@chromium.org
, May 12 2016