New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 713078 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Jul 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

25.1%-36.2% regression in smoothness.top_25_smooth at 465266:465372

Project Member Reported by alexclarke@chromium.org, Apr 19 2017

Issue description

See the link to graphs below.
 
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 20 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : smoothness.top_25_smooth
  Metric       : percentage_smooth/http___booking.com

Revision             Result                  N
chromium@465265      69.0096 +- 19.3291      21      good
chromium@465372      69.8124 +- 12.3563      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...booking.com smoothness.top_25_smooth

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981888630972010320

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6433679418589184


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Cc: sullivan@chromium.org
This one is weird, the ref vanishes at the point of the alert.  I'm inclined to suspect the ref should have moved at the same time given the bots can't find a regression.

+sullivan@ what do you make of this?
Cc: mikec...@chromium.org martiniss@chromium.org
+martiniss, mikecase: Wasn't there a config mixup on the webview perfbots lately, where they ran chrome instead of webview? Since we don't have webview ref builds, and ref builds are showing up in the graph, I think this is because we fixed the glitch?
Project Member

Comment 7 by 42576172...@developer.gserviceaccount.com, Apr 22 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : smoothness.top_25_smooth
  Metric       : percentage_smooth/http___booking.com

Revision             Result                  N
chromium@465265      69.0096 +- 19.3291      21      good
chromium@465372      69.8124 +- 12.3563      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=http...booking.com smoothness.top_25_smooth

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981755008510099904

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6433679418589184


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
re #6

Yeah, not super familiar with current situation. But I think all the "webview" perf results from the past few weeks were really testing Chrome. Also, its not 100% fixed yet, as all of the perf devices were also flashed to non-AOSP builds of Android this past month which means, even if you specify --browser=android-webview, it won't actually test the webview being installed.

Hopefully we can get this all cleaned up next week.
Project Member

Comment 10 by 42576172...@developer.gserviceaccount.com, Apr 23 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : smoothness.top_25_smooth
  Metric       : percentage_smooth/https___plus.google.com_110031535020051778989_posts

Revision             Result                  N
chromium@465265      69.0096 +- 19.3291      21      good
chromium@465372      69.8124 +- 12.3563      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=https...plus.google.com.110031535020051778989.posts smoothness.top_25_smooth

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8981562260408108656

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6433679418589184


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Project Member

Comment 12 by 42576172...@developer.gserviceaccount.com, Apr 30 2017


=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_webview_nexus6_aosp_perf_bisect
  Benchmark    : smoothness.top_25_smooth
  Metric       : percentage_smooth/Docs  (1 open document tab)

Revision             Result                  N
chromium@465265      69.0096 +- 19.3291      21      good
chromium@465372      69.8124 +- 12.3563      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-webview --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=Docs...1.open.document.tab. smoothness.top_25_smooth

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8980856021414488464

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6433679418589184


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Status: WontFix (was: Untriaged)
This alert was found before M-60 branched. Closing as WontFix as this is believed to either be invalid or non-reproducible. 

Sign in to add a comment