Issue metadata
Sign in to add a comment
|
31.1% regression in angle_perftests at 447859:447899 |
||||||||||||||||||||
Issue descriptionSee the link to graphs below.
,
Feb 5 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8988484156696751376
,
Feb 5 2017
=== BISECT JOB RESULTS === NO Perf regression found, tests failed to produce values Bisect Details Configuration: winx64nvidia_perf_bisect Benchmark : angle_perftests Metric : Uniforms_gl_400_vec4/score Revision Result N chromium@447858 7657.29 +- 1249.6 21 good To Run This Test .\src\out\Release_x64\angle_perftests.exe --test-launcher-print-test-stdio=always --test-launcher-jobs=1 Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8988484156696751376 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5829472760102912 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Feb 6 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8988403104169987904
,
Feb 6 2017
Hey Simon/Oysteine, perf bisect seemed to fail with an odd result. Re-running bisect now.
,
Feb 6 2017
re: #c5 Bisect in #c3 failed because the "bad" revision specified didn't produce the metric. I see Uniforms_gl_400_vec4_repeating: score in there, but not Uniforms_gl_400_vec4: score.
,
Feb 6 2017
Hm, I'm not sure. I might have renamed this metric at one point, but would the bisect be tripping up on that? I'm not sure why it would have a 35% regression if the metric changed name entirely.
,
Feb 6 2017
-oysteine@ doesn't work on bisect Good point, if it's appearing on the dashboard then the perf tests are generating the value. Not clear why the bisect wouldn't. Off the top of my head possible differences in testing environment (would hardware make a difference in this test?, although should be same anyway), how it's run, or some sort of difference between the isolated version and the binary the bisect fetches?
,
Feb 6 2017
=== BISECT JOB RESULTS === NO Perf regression found, tests failed to produce values Bisect Details Configuration: winx64nvidia_perf_bisect Benchmark : angle_perftests Metric : Uniforms_gl_400_vec4/score Revision Result N chromium@447858 7693.81 +- 1264.52 21 good To Run This Test .\src\out\Release_x64\angle_perftests.exe --test-launcher-print-test-stdio=always --test-launcher-jobs=1 Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8988403104169987904 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=6471297237778432 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Feb 8 2017
I'm not sure what's going on here, but I think this is noise. Tested locally. |
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by jmad...@chromium.org
, Feb 5 2017