New issue
Advanced search Search tips

Issue 672543 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Feb 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocked on:
issue 672529



Sign in to add a comment

11.7%-38.9% regression in system_health.common_mobile at 436720:436753

Project Member Reported by majidvp@google.com, Dec 8 2016

Issue description

See the link to graphs below.
 

===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Infra Failure: Step('Working on revision chromium@436736,v8@9c9c8d7bb5.install ChromePublic.apk') returned 2
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N  Good?
chromium@436719  365.473  52.7925  8  good
chromium@436736  365.131  22.7047  8  good
chromium@436737  527.176  136.318  5  bad
chromium@436738  474.752  110.098  5  bad
chromium@436739  514.577  97.0423  5  bad
chromium@436741  577.762  81.7158  5  bad
chromium@436745  571.104  79.8453  5  bad
chromium@436753  536.802  70.8678  5  bad

Bisect job ran on: android_nexus9_perf_bisect
Bug ID: 672543

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.facebook.photos system_health.common_mobile
Test Metric: timeToFirstContentfulPaint_avg/browse_media/browse_media_facebook_photos
Relative Change: 46.88%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus9_perf_bisect/builds/2316
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8993821481126433520


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5539782984204288

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
The failed bisect has found one commit which is v8 roll: 
https://chromium.googlesource.com/chromium/src/+/add906ecd953bbcddb9e1da70f1302df87496470

Kicked another bisect to see if it can bisect v8 again.

Note that the graph has started to recover.

===== BISECT JOB RESULTS =====
Status: failed


=== Bisection aborted ===
The bisect was aborted because Infra Failure: Step('Working on revision chromium@436736,v8@9c9c8d7bb5.install ChromePublic.apk') returned 2
Please contact the the team (see below) if you believe this is in error.

===== TESTED REVISIONS =====
Revision         Mean     Std Dev  N  Good?
chromium@436736  700.193  46.6616  8  good
chromium@436737  821.438  210.769  8  bad

Bisect job ran on: android_nexus9_perf_bisect
Bug ID: 672543

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.facebook.photos system_health.common_mobile
Test Metric: timeToFirstMeaningfulPaint_avg/browse_media/browse_media_facebook_photos
Relative Change: 17.32%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus9_perf_bisect/builds/2317
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8993808409476208944


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5806623631605760

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Blockedon: 672529
 crbug.com/672529  for the ChromePublic.apk failure.
 crbug.com/672529  for the ChromePublic.apk failure.
Status: WontFix (was: Untriaged)
Only N9s. WontFix.
Project Member

Comment 12 by 42576172...@developer.gserviceaccount.com, Apr 11 2017


=== BISECT JOB RESULTS ===
Bisect failed unexpectedly

Bisect was aborted with the following:
  Infra Failure: Step('Working on revision chromium@436736,v8@9c9c8d7bb5.install ChromePublic.apk') returned 2


Bisect Details
  Configuration: android_nexus9_perf_bisect
  Benchmark    : system_health.common_mobile
  Metric       : timeToFirstContentfulPaint_avg/browse_media/browse_media_facebook_photos

Revision             Result                  N
chromium@436719      365.473 +- 52.7925      8      good
chromium@436736      365.131 +- 22.7047      8      good
chromium@436737      527.176 +- 136.318      5      bad
chromium@436738      474.752 +- 110.098      5      bad
chromium@436739      514.577 +- 97.0423      5      bad
chromium@436741      577.762 +- 81.7158      5      bad
chromium@436745      571.104 +- 79.8453      5      bad
chromium@436753      536.802 +- 70.8678      5      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.facebook.photos system_health.common_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982612013379782288

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5539782984204288


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 13 by 42576172...@developer.gserviceaccount.com, Apr 11 2017


=== BISECT JOB RESULTS ===
Bisect failed unexpectedly

Bisect was aborted with the following:
  Infra Failure: Step('Working on revision chromium@436736,v8@9c9c8d7bb5.install ChromePublic.apk') returned 2


Bisect Details
  Configuration: android_nexus9_perf_bisect
  Benchmark    : system_health.common_mobile
  Metric       : timeToFirstMeaningfulPaint_avg/browse_media/browse_media_facebook_photos

Revision             Result                  N
chromium@436736      700.193 +- 46.6616      8      good
chromium@436737      821.438 +- 210.769      8      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.facebook.photos system_health.common_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982576295723556816

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5806623631605760


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!

Sign in to add a comment