Project: chromium Issues People Development process History Sign in
New issue
Advanced search Search tips
Starred by 1 user
Status: WontFix
Owner:
Closed: Mar 17
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment
179.6%-14735% regression in system_health.common_mobile at 456988:457036
Project Member Reported by rmcilroy@chromium.org, Mar 16 Back to list
See the link to graphs below.
 
Cc: ksakamoto@chromium.org
Owner: ksakamoto@chromium.org

=== Auto-CCing suspected CL author ksakamoto@chromium.org ===

Hi ksakamoto@chromium.org, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : ksakamoto
  Commit : 4d059dcf25a256d591234eb2a7ffd1673f7c9709
  Date   : Wed Mar 15 06:57:08 2017
  Subject: Loosen FirstMeaningfulPaint UMA network-idle heuristics

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : system_health.common_mobile
  Metric       : timeToFirstMeaningfulPaint_avg/browse_media/browse_media_imgur
  Change       : 13440.98% | 226.491333333 -> 30669.1513333

Revision             Result                  N
chromium@456987      226.491 +- 44.5066      6      good
chromium@457006      231.826 +- 43.3993      6      good
chromium@457015      230.243 +- 43.7344      6      good
chromium@457016      227.117 +- 44.0644      6      good
chromium@457017      30609.1 +- 178.126      6      bad       <--
chromium@457018      30633.3 +- 174.348      6      bad
chromium@457020      30627.1 +- 63.8508      6      bad
chromium@457024      30669.2 +- 83.1258      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.media.imgur system_health.common_mobile

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8984957554923319504

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5296855098851328


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Status: WontFix
I have inspected a few traces from affected tests.

Before my patch, FirstMeaningfulPaint was reported too soon because of bug 659021. My patch changed some heuristics for FirstMeaningfulPaint, and it now reports actual FirstMeaningfulPaint for those pages.

Sign in to add a comment