New issue
Advanced search Search tips

Issue 696851 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: May 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocking:
issue 696881



Sign in to add a comment

20.4%-46.1% regression in media.android.tough_video_cases at 451853:452965 [seek time]

Project Member Reported by tguilbert@chromium.org, Feb 28 2017

Issue description

See the link to graphs below.
 
Summary: 20.4%-46.1% regression in media.android.tough_video_cases at 451853:452965 [seek time] (was: 20.4%-46.1% regression in media.android.tough_video_cases at 451853:452965)
Labels: media_regression_2_27
Blocking: 696881
Started a new bisect, now that bots are up and running again:
https://chromeperf.appspot.com/buildbucket_job_status/8986193247798166912

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: android_nexus5X_perf_bisect
  Benchmark    : media.android.tough_video_cases
  Metric       : seek/smpte_3840x2160_60fps_vp9.webm_seek_warm

Revision             Result                  N
chromium@451852      1632.32 +- 177.646      20      good
chromium@452965      1651.26 +- 255.411      21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8986119669846765856

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5893359450718208


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Status: WontFix (was: Untriaged)
It seems as though the tests are just very flaky. The results vary wildly from day to day.

Sign in to add a comment