New issue
Advanced search Search tips

Issue 632232 link

Starred by 2 users

Issue metadata

Status: WontFix
Owner:
Closed: Aug 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

3.5% regression in image_decoding.image_decoding_measurement at 407787:407830

Project Member Reported by kouhei@chromium.org, Jul 28 2016

Issue description

See the link to graphs below.
 

Comment 1 by kouhei@chromium.org, Jul 28 2016

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=632232

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg-ofptQoM


Bot(s) for this bug's original alert(s):

android-galaxy-s5
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Jul 28 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N   Good?
chromium@407786  205.733  2.00916  18  good
chromium@407830  206.165  1.67501  18  bad

Bisect job ran on: android_s5_perf_bisect
Bug ID: 632232

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests image_decoding.image_decoding_measurement
Test Metric: ImageDecoding_avg/ImageDecoding_avg
Relative Change: 0.28%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_s5_perf_bisect/builds/842
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9005930881220992832


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5003876332208128

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Status: WontFix (was: Assigned)
Bisect failed to reproduce; some sub-series with ref build also moved at the same time; test appears to not be very stable/consistent; only one platform.
Project Member

Comment 6 by 42576172...@developer.gserviceaccount.com, Aug 17 2016

Cc: zmo@chromium.org
Owner: zmo@chromium.org

=== Auto-CCing suspected CL author zmo@chromium.org ===

Hi zmo@chromium.org, the bisect results pointed to your CL below as possibly
causing a regression. Please have a look at this info and see whether
your CL be related.


===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : Update WebGL2 conformance test expectations for Linux AMD.
Author  : zmo
Commit description:
  
BUG=
TEST=Linux AMD
TBR=qiankun.miao@intel.com
NOTRY=true
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.linux:linux_optional_gpu_tests_rel;master.tryserver.chromium.mac:mac_optional_gpu_tests_rel;master.tryserver.chromium.win:win_optional_gpu_tests_rel

Review-Url: https://codereview.chromium.org/2177173004
Cr-Commit-Position: refs/heads/master@{#407787}
Commit  : 46796b9302c5fc93e385f9b13a16a37d6669b559
Date    : Tue Jul 26 14:26:37 2016


===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N  Good?
chromium@407786  135.904  1.35711  5  good
chromium@407787  130.232  1.44658  5  bad    <--
chromium@407788  130.588  1.06353  5  bad
chromium@407789  126.751  1.29039  5  bad
chromium@407792  128.385  1.63622  5  bad
chromium@407797  127.534  2.33265  5  bad
chromium@407808  126.954  2.13238  5  bad
chromium@407830  130.847  2.18212  8  bad

Bisect job ran on: android_s5_perf_bisect
Bug ID: 632232

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --also-run-disabled-tests image_decoding.image_decoding_measurement
Test Metric: ImageDecoding_avg/image_decoding.html?webp
Relative Change: 3.20%
Score: 99.9

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_s5_perf_bisect/builds/918
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9004062466673757024


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5770407643185152

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Sign in to add a comment