New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 659538 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Feb 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

3.3%-9.2% regression in thread_times.key_silk_cases at 427188:427220

Project Member Reported by alexclarke@chromium.org, Oct 26 2016

Issue description

See the link to graphs below.
 
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Oct 26 2016


===== BISECT JOB RESULTS =====
Status: failed


===== TESTED REVISIONS =====
Revision         Mean     Std Dev    N  Good?
chromium@427187  2.85862  0.0641594  5  good
chromium@427196  2.86836  0.0411533  5  good
chromium@427198  2.82947  0.0283534  5  good
chromium@427200  3.0805   0.0515992  5  bad
chromium@427204  3.1746   0.0466921  5  bad
chromium@427220  3.09013  0.0875039  5  bad

Bisect job ran on: android_nexus9_perf_bisect
Bug ID: 659538

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.key_silk_cases
Test Metric: thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame
Relative Change: 8.10%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus9_perf_bisect/builds/2218
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8997749405178493824


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5315685998133248

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Status: WontFix (was: Untriaged)
Only N9s, WontFix.
Labels: Performance-Responsiveness
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Apr 11 2017


=== BISECT JOB RESULTS ===
Perf regression found but unable to narrow commit range

Build failures prevented the bisect from narrowing the range further.


Bisect Details
  Configuration: android_nexus9_perf_bisect
  Benchmark    : thread_times.key_silk_cases
  Metric       : thread_GPU_cpu_time_per_frame/thread_GPU_cpu_time_per_frame

Suspected Commit Range
  1 commits in range
  https://chromium.googlesource.com/chromium/src/+log/c81a083463ff9422f6b71e6c3a086295f03fde78..26c35c2e81f97a5b291ebd4d639fc3f1a4cc50e8


Revision             Result                    N
chromium@427187      2.85862 +- 0.0641594      5      good
chromium@427196      2.86836 +- 0.0411533      5      good
chromium@427198      2.82947 +- 0.0283534      5      good
chromium@427200      3.0805 +- 0.0515992       5      bad
chromium@427204      3.1746 +- 0.0466921       5      bad
chromium@427220      3.09013 +- 0.0875039      5      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests thread_times.key_silk_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982620176559957920

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5315685998133248


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment