New issue
Advanced search Search tips

Issue 671628 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 647372
Owner:
Closed: Dec 2016
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug-Regression

Blocked on:
issue 673440



Sign in to add a comment

media.android.tough_video_cases failure on chromium.perf

Project Member Reported by sullivan@chromium.org, Dec 6 2016

Issue description

Assigning to crouleau to re-enable, please reassign if you're not the benchmark owner.

This benchmark was already disabled on L and webview, and it is also failing on K. The revision range is unclear, it seems to pass occasionally but almost always fails. Kicking off bisects from the last passing build.

Link to failing step log:
https://uberchromegw.corp.google.com/i/chromium.perf/builders/Android%20Nexus5%20Perf%20(2)/builds/4512/steps/media.android.tough_video_cases/logs/stdio

[ RUN      ] video.html?src=smpte_3840x2160_60fps_vp9.webm
...
INFO:root:Start: PowerMetric running
INFO:root:*************** BROWSER STANDARD OUTPUT ***************
INFO:root:Cannot get standard output on Android
INFO:root:*********** END OF BROWSER STANDARD OUTPUT ************
INFO:root:********************* BROWSER LOG *********************
INFO:root:No log file
INFO:root:***************** END OF BROWSER LOG ******************
INFO:devil.utils.cmd_helper:[host]> /b/rr/tmpRKeI50/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 0d88d39743e4b8df shell '( /system/bin/screencap -p /data/local/tmp/temp_file-371533bfb276e.png );echo %$?'
INFO:devil.utils.cmd_helper:[host]> /b/rr/tmpRKeI50/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 0d88d39743e4b8df pull /data/local/tmp/temp_file-371533bfb276e.png /tmp/tmpsNFS0W.png
INFO:devil.utils.cmd_helper:[host]> /b/rr/tmpRKeI50/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 0d88d39743e4b8df shell 'rm -f /data/local/tmp/temp_file-371533bfb276e.png'
Traceback (most recent call last):
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 87, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 299, in RunStory
    self._current_page.Run(self)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/page/__init__.py", line 111, in Run
    self.RunPageInteractions(action_runner)
  File "/b/rr/tmpRKeI50/w/src/tools/perf/page_sets/tough_video_cases.py", line 504, in RunPageInteractions
    action_timeout_in_seconds=120)
  File "/b/rr/tmpRKeI50/w/src/tools/perf/page_sets/tough_video_cases.py", line 40, in SeekBeforeAndAfterPlayhead
    label='seek_cold')
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 739, in SeekMedia
    log_time=log_time, label=label))
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 56, in _RunAction
    action.RunAction(self._tab)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/seek.py", line 48, in RunAction
    self._timeout_in_seconds)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
    return func(*args, **kwargs)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/media_action.py", line 35, in WaitForEvent
    timeout=timeout_in_seconds)
  File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_utils/py_utils/__init__.py", line 132, in WaitFor
    (timeout, GetConditionString()))
TimeoutException: Timed out while waiting 120s for lambda: self.HasEventCompletedOrError(tab, selector, event_name),.


If the test is disabled, please downgrade to Pri-2.

 

===== BISECT JOB RESULTS =====
Status: started


===== TESTED REVISIONS =====
Revision         Exit Code  Std Dev  N  Good?
chromium@436365  1          N/A      5  good
chromium@436444  1          N/A      5  bad

Bisect job ran on: android_nexus5_perf_bisect
Bug ID: 671628

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases
Test Metric: board_temperature/board_temperature
Relative Change: 0.00%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4410
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8994011937645400384


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6404604445589504

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Mergedinto: 647372
Status: Duplicate (was: Untriaged)
Project Member

Comment 5 by bugdroid1@chromium.org, Dec 6 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6bf0f09a839c0ad3e065652121361803173adbf4

commit 6bf0f09a839c0ad3e065652121361803173adbf4
Author: sullivan <sullivan@chromium.org>
Date: Tue Dec 06 18:53:48 2016

Disable media.android.tough_video_cases on all android.

It had been running on the perf waterfall on K only, but it is failing
on K as well as WebView and L now.

BUG= 671628 
CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq;master.tryserver.chromium.perf:winx64_10_perf_cq

Review-Url: https://codereview.chromium.org/2549373003
Cr-Commit-Position: refs/heads/master@{#436665}

[modify] https://crrev.com/6bf0f09a839c0ad3e065652121361803173adbf4/tools/perf/benchmarks/media.py


===== BISECT JOB RESULTS =====
Status: started


===== TESTED REVISIONS =====
Revision         Exit Code  Std Dev  N   Good?
chromium@436236  1          N/A      20  good
chromium@436253  1          N/A      20  bad

Bisect job ran on: android_nexus7_perf_bisect
Bug ID: 671628

Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases
Test Metric: board_temperature/board_temperature
Relative Change: 0.00%

Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_perf_bisect/builds/3534
Job details: https://chromeperf.appspot.com/buildbucket_job_status/8994011509120992256


Not what you expected? We'll investigate and get back to you!
  https://chromeperf.appspot.com/bad_bisect?try_job_id=6447106099773440

| O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq
|  X  | for more information addressing perf regression bugs. For feedback,
| / \ | file a bug with component Tests>AutoBisect.  Thank you!
Blockedon: 673440
 crbug.com/673440  for "started" status.

Sign in to add a comment