Issue metadata
Sign in to add a comment
|
media.android.tough_video_cases failure on chromium.perf |
||||||||||||||||||||||
Issue descriptionAssigning to crouleau to re-enable, please reassign if you're not the benchmark owner. This benchmark was already disabled on L and webview, and it is also failing on K. The revision range is unclear, it seems to pass occasionally but almost always fails. Kicking off bisects from the last passing build. Link to failing step log: https://uberchromegw.corp.google.com/i/chromium.perf/builders/Android%20Nexus5%20Perf%20(2)/builds/4512/steps/media.android.tough_video_cases/logs/stdio [ RUN ] video.html?src=smpte_3840x2160_60fps_vp9.webm ... INFO:root:Start: PowerMetric running INFO:root:*************** BROWSER STANDARD OUTPUT *************** INFO:root:Cannot get standard output on Android INFO:root:*********** END OF BROWSER STANDARD OUTPUT ************ INFO:root:********************* BROWSER LOG ********************* INFO:root:No log file INFO:root:***************** END OF BROWSER LOG ****************** INFO:devil.utils.cmd_helper:[host]> /b/rr/tmpRKeI50/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 0d88d39743e4b8df shell '( /system/bin/screencap -p /data/local/tmp/temp_file-371533bfb276e.png );echo %$?' INFO:devil.utils.cmd_helper:[host]> /b/rr/tmpRKeI50/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 0d88d39743e4b8df pull /data/local/tmp/temp_file-371533bfb276e.png /tmp/tmpsNFS0W.png INFO:devil.utils.cmd_helper:[host]> /b/rr/tmpRKeI50/w/src/third_party/catapult/devil/bin/deps/linux2/x86_64/bin/adb -s 0d88d39743e4b8df shell 'rm -f /data/local/tmp/temp_file-371533bfb276e.png' Traceback (most recent call last): File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 87, in _RunStoryAndProcessErrorIfNeeded state.RunStory(results) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function return func(*args, **kwargs) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 299, in RunStory self._current_page.Run(self) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/page/__init__.py", line 111, in Run self.RunPageInteractions(action_runner) File "/b/rr/tmpRKeI50/w/src/tools/perf/page_sets/tough_video_cases.py", line 504, in RunPageInteractions action_timeout_in_seconds=120) File "/b/rr/tmpRKeI50/w/src/tools/perf/page_sets/tough_video_cases.py", line 40, in SeekBeforeAndAfterPlayhead label='seek_cold') File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function return func(*args, **kwargs) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 739, in SeekMedia log_time=log_time, label=label)) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function return func(*args, **kwargs) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/action_runner.py", line 56, in _RunAction action.RunAction(self._tab) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function return func(*args, **kwargs) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/seek.py", line 48, in RunAction self._timeout_in_seconds) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function return func(*args, **kwargs) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/telemetry/telemetry/internal/actions/media_action.py", line 35, in WaitForEvent timeout=timeout_in_seconds) File "/b/rr/tmpRKeI50/w/src/third_party/catapult/common/py_utils/py_utils/__init__.py", line 132, in WaitFor (timeout, GetConditionString())) TimeoutException: Timed out while waiting 120s for lambda: self.HasEventCompletedOrError(tab, selector, event_name),. If the test is disabled, please downgrade to Pri-2.
,
Dec 6 2016
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8994011509120992256
,
Dec 6 2016
===== BISECT JOB RESULTS ===== Status: started ===== TESTED REVISIONS ===== Revision Exit Code Std Dev N Good? chromium@436365 1 N/A 5 good chromium@436444 1 N/A 5 bad Bisect job ran on: android_nexus5_perf_bisect Bug ID: 671628 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases Test Metric: board_temperature/board_temperature Relative Change: 0.00% Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus5_perf_bisect/builds/4410 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8994011937645400384 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6404604445589504 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Dec 6 2016
,
Dec 6 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/6bf0f09a839c0ad3e065652121361803173adbf4 commit 6bf0f09a839c0ad3e065652121361803173adbf4 Author: sullivan <sullivan@chromium.org> Date: Tue Dec 06 18:53:48 2016 Disable media.android.tough_video_cases on all android. It had been running on the perf waterfall on K only, but it is failing on K as well as WebView and L now. BUG= 671628 CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.perf:mac_retina_perf_cq;master.tryserver.chromium.perf:winx64_10_perf_cq Review-Url: https://codereview.chromium.org/2549373003 Cr-Commit-Position: refs/heads/master@{#436665} [modify] https://crrev.com/6bf0f09a839c0ad3e065652121361803173adbf4/tools/perf/benchmarks/media.py
,
Dec 6 2016
===== BISECT JOB RESULTS ===== Status: started ===== TESTED REVISIONS ===== Revision Exit Code Std Dev N Good? chromium@436236 1 N/A 20 good chromium@436253 1 N/A 20 bad Bisect job ran on: android_nexus7_perf_bisect Bug ID: 671628 Test Command: src/tools/perf/run_benchmark -v --browser=android-chromium --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests media.android.tough_video_cases Test Metric: board_temperature/board_temperature Relative Change: 0.00% Buildbot stdio: http://build.chromium.org/p/tryserver.chromium.perf/builders/android_nexus7_perf_bisect/builds/3534 Job details: https://chromeperf.appspot.com/buildbucket_job_status/8994011509120992256 Not what you expected? We'll investigate and get back to you! https://chromeperf.appspot.com/bad_bisect?try_job_id=6447106099773440 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Tests>AutoBisect. Thank you!
,
Dec 12 2016
|
|||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||
Comment 1 by 42576172...@developer.gserviceaccount.com
, Dec 6 2016