New issue
Advanced search Search tips

Issue 687733 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner: ----
Closed: Feb 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression

Blocked on:
issue 683184



Sign in to add a comment

986.9%-1375.3% regression in media.tough_video_cases_extra at 447110:447196

Project Member Reported by crouleau@chromium.org, Feb 1 2017

Issue description

Massive regression in seek time. Check out the graphs.
 

=== BISECT JOB RESULTS ===
NO Perf regression found

Bisect Details
  Configuration: winx64_10_perf_bisect
  Benchmark    : media.tough_video_cases_extra
  Metric       : seek/video.html?src_tulip2.ogg_type_audio

Revision             Result                   N
chromium@447145      0.96881 +- 0.144725      21      good
chromium@447195      3.98238 +- 29.6458       21      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release_x64 --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=video.html.src.tulip2.ogg.type.audio media.tough_video_cases_extra

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8988820507877449456

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=5807187852525568


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Cc: simonhatch@chromium.org
+simonhatch@,

I am considering manually running this bisect because the tool is not working. Is there anything else I can do before I take on that task?
Blockedon: 683184
Cc: dtu@chromium.org
re: #c4

Unfortunately the test we use at the moment isn't great with this kind of data, where most of the values are nearly identical save for a few outliers. We're working on improving this but that won't be ready for a while.

+dtu

Dave can you think of anything that might help here in the short term?
Status: Fixed (was: Untriaged)
It recovered again.

Sign in to add a comment