New issue
Advanced search Search tips

Issue 711502 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Apr 2017
Cc:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 2
Type: Bug-Regression



Sign in to add a comment

1.9%-3.5% regression in media.tough_video_cases at 463662:464039

Project Member Reported by crouleau@chromium.org, Apr 13 2017

Issue description

See the link to graphs below.
 
All graphs for this bug:
  https://chromeperf.appspot.com/group_report?bug_id=711502

Original alerts at time of bug-filing:
  https://chromeperf.appspot.com/group_report?keys=agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggoGq4QsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggquDnAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwqiQuAoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggp3t6goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_M-RsAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggvn9tAsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggp-DpwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggtb-8woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggq-3oQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggv3yugkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_O2e-gkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_L_W4AkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_LnM5AoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggt2e_woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpTRiAgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggr6vgwkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_I_X5woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_O_B9woM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggoqrrQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgwojaogoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpaEoAkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsb1oQsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_K-D4ggM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggsv1_goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggpTG4QgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgguqp4gsM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_O_B9wgM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggorhpQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDgguufrgoM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDggoHFqQkM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_O2e-goM,agxzfmNocm9tZXBlcmZyFAsSB0Fub21hbHkYgIDg_N3k7AgM


Bot(s) for this bug's original alert(s):

chromium-rel-win10
chromium-rel-win7-dual
chromium-rel-win7-gpu-intel
chromium-rel-win8-dual
Project Member

Comment 3 by 42576172...@developer.gserviceaccount.com, Apr 14 2017

Cc: pa...@yandex-team.ru
Owner: pa...@yandex-team.ru

=== Auto-CCing suspected CL author pavor@yandex-team.ru ===

Hi pavor@yandex-team.ru, the bisect results pointed to your CL, please take a look at the
results.


=== BISECT JOB RESULTS ===
Perf regression found with culprit

Suspected Commit
  Author : pavor
  Commit : 56a00719145e7f3f690cbeabb6025e5420932782
  Date   : Wed Apr 12 09:03:32 2017
  Subject: Fix PlatformInfo variation for mime util IsCodecSupportedOnAndroidTest

Bisect Details
  Configuration: win_perf_bisect
  Benchmark    : media.tough_video_cases
  Metric       : vm_working_set_delta_size/garden2_10s.ogv_gpu
  Change       : 0.50% | 7003.33333333 -> 7038.66666667

Revision             Result                  N
chromium@463938      7003.33 +- 32.2077      6      good
chromium@463953      7018.0 +- 50.8331       6      good
chromium@463961      7015.33 +- 46.4471      6      good
chromium@463965      7024.67 +- 36.4051      6      good
chromium@463967      7034.67 +- 72.4431      9      good
chromium@463968      7080.0 +- 40.398        6      bad       <--
chromium@463997      7038.67 +- 33.3067      6      bad

To Run This Test
  src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.tough_video_cases

Debug Info
  https://chromeperf.appspot.com/buildbucket_job_status/8982387018066813472

Is this bisect wrong?
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6172721366433792


| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Speed>Bisection.  Thank you!
Correct me if I am wrong, but as far as I understand media.tough_video_case is a performance test for video playback with urls like file://tough_video_cases/video.html?src=crowd1080.ogv&canvas=true (I looked it up inside tools/perf/page_sets/tough_video_cases.py) and it launches a browser (or some kind of shell browser, IDK, but for sure not media_unittests). My changeset affects only unit tests, it can not affect browser code.
Owner: ----
Status: WontFix (was: Assigned)
Yeah, it looks like bisect found the wrong culprit.

Sign in to add a comment