New issue
Advanced search Search tips

Issue 597623 link

Starred by 0 users

Issue metadata

Status: Duplicate
Merged: issue 596882
Owner:
Closed: Mar 2016
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

3.8% regression in webrtc.getusermedia at 382526:382532

Project Member Reported by mustaq@chromium.org, Mar 24 2016

Issue description

See the link to graphs below.
 

Comment 1 by mustaq@chromium.org, Mar 24 2016

All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=597623

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgICg0PvougoM


Bot(s) for this bug's original alert(s):

android-one
Project Member

Comment 2 by 42576172...@developer.gserviceaccount.com, Mar 30 2016


===== BISECT JOB RESULTS =====
Status: completed


=== Bisection aborted ===
The bisect was aborted because The metric values for the initial "good" and "bad" revisions do not represent a clear regression.
Please contact the the team (see below) if you believe this is in error.

=== Warnings ===
The following warnings were raised by the bisect job:

 * Bisect failed to reproduce the regression with enough confidence.

===== TESTED REVISIONS =====
Revision                Mean Value  Std. Dev.   Num Values  Good?
chromium@382525         15075.55555682.443722   18          good
chromium@382532         15065.77777892.027845   18          bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 597623

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --also-run-disabled-tests webrtc.getusermedia
Test Metric: vm_private_dirty_final_browser/vm_private_dirty_final_browser
Relative Change: 0.18%
Score: 0

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1230
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9016732628123238352


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=597623

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Comment 3 by mustaq@chromium.org, Mar 31 2016

Kicked off another bisect with a modified range.
Project Member

Comment 4 by 42576172...@developer.gserviceaccount.com, Mar 31 2016

Mergedinto: 596882
Status: Duplicate (was: Assigned)

===== BISECT JOB RESULTS =====
Status: completed


===== SUSPECTED CL(s) =====
Subject : Roll src/third_party/catapult/ 8d9e4952d..c52974880 (1 commit).
Author  : catapult-deps-roller
Commit description:
  
https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/8d9e4952d037..c52974880be8

$ git log 8d9e4952d..c52974880 --date=short --no-merges --format='%ad %ae %s'

CQ_INCLUDE_TRYBOTS=
TBR=catapult-sheriff@chromium.org

Review URL: https://codereview.chromium.org/1819823003

Cr-Commit-Position: refs/heads/master@{#382518}
Commit  : 0fbcbd2b96fee4d6bd5fc7f4700225bc4af9b442
Date    : Tue Mar 22 06:36:49 2016


===== TESTED REVISIONS =====
Revision                Mean Value  Std. Dev.   Num Values  Good?
chromium@382503         14621.0     188.294602  8           good
chromium@382513         14544.0     22.090722   5           good
chromium@382516         14528.0     31.874755   5           good
chromium@382517         14697.6     183.577776  5           good
chromium@382518         15070.4     61.29274    5           bad         <-
chromium@382523         15012.8     149.837245  5           bad
chromium@382542         15044.0     171.900303  8           bad

Bisect job ran on: android_one_perf_bisect
Bug ID: 597623

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --also-run-disabled-tests webrtc.getusermedia
Test Metric: vm_private_dirty_final_browser/vm_private_dirty_final_browser
Relative Change: 2.93%
Score: 99.9

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_one_perf_bisect/builds/1231
Job details: https://chromeperf.appspot.com/buildbucket_job_status/9016665507580600256


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=597623

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!

Sign in to add a comment