Issue metadata
Sign in to add a comment
|
browse:news:cnn failing on mac-retina common |
||||||||||||||||||||
Issue descriptionThis test has been failing pretty often in recent builds (14 out of 20). e.g. recent build: https://luci-milo.appspot.com/buildbot/chromium.perf/Mac%20Retina%20Perf/717 [5496:38207:0531/175635.190589:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"} [5496:38207:0531/175635.190648:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"} [5496:775:0531/175635.199147:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR PIPELINE_ERROR_READ [5496:38207:0531/175635.522692:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"} [5496:38207:0531/175635.522748:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"} [5496:775:0531/175635.563432:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR PIPELINE_ERROR_READ [5496:38207:0531/175638.858350:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"} [5496:38207:0531/175638.858452:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"} [5496:775:0531/175638.859305:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR PIPELINE_ERROR_READ [5496:38207:0531/175638.932027:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"} [5496:38207:0531/175638.932082:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"} [5496:775:0531/175638.932919:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR PIPELINE_ERROR_READ [5496:38207:0531/175639.938943:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"} [5496:775:0531/175639.939088:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR DEMUXER_ERROR_COULD_NOT_OPEN [5496:38207:0531/175640.877164:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"} [5496:38207:0531/175640.877257:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"} [5496:775:0531/175640.880222:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR PIPELINE_ERROR_READ [5496:38207:0531/175640.898909:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: data source error"} [5496:38207:0531/175640.899044:ERROR:render_media_log.cc(30)] MediaEvent: MEDIA_ERROR_LOG_ENTRY {"error":"FFmpegDemuxer: open context failed"} [5496:775:0531/175640.899819:ERROR:render_media_log.cc(30)] MediaEvent: PIPELINE_ERROR PIPELINE_ERROR_READ (INFO) 2017-05-31 17:59:37,582 browser.DumpStateUponFailure:377 *********** END OF BROWSER STANDARD OUTPUT ************ (INFO) 2017-05-31 17:59:37,583 browser.DumpStateUponFailure:379 ********************* BROWSER LOG ********************* (INFO) 2017-05-31 17:59:37,583 browser.DumpStateUponFailure:381 No log file (INFO) 2017-05-31 17:59:37,583 browser.DumpStateUponFailure:384 ***************** END OF BROWSER LOG ****************** Traceback (most recent call last): File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/story_runner.py", line 90, in _RunStoryAndProcessErrorIfNeeded state.RunStory(results) File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function return func(*args, **kwargs) File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/page/shared_page_state.py", line 296, in RunStory self._current_page.Run(self) File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/page/__init__.py", line 112, in Run self.RunPageInteractions(action_runner) File "/b/s/w/ir/tools/perf/page_sets/system_health/system_health_story.py", line 138, in RunPageInteractions self._DidLoadDocument(action_runner) File "/b/s/w/ir/tools/perf/page_sets/system_health/browsing_stories.py", line 83, in _DidLoadDocument self._ReadNextArticle(action_runner) File "/b/s/w/ir/tools/perf/page_sets/system_health/browsing_stories.py", line 92, in _ReadNextArticle action_runner.tab.WaitForDocumentReadyStateToBeComplete() File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function return func(*args, **kwargs) File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 74, in WaitForDocumentReadyStateToBeComplete 'document.readyState == "complete"', timeout=timeout) File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function return func(*args, **kwargs) File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/browser/web_contents.py", line 191, in WaitForJavaScriptCondition return self._inspector_backend.WaitForJavaScriptCondition(*args, **kwargs) File "/b/s/w/ir/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 75, in traced_function return func(*args, **kwargs) File "/b/s/w/ir/third_party/catapult/telemetry/telemetry/internal/backends/chrome_inspector/inspector_backend.py", line 293, in WaitForJavaScriptCondition e.message + '\n' + debug_message) TimeoutException: Timed out while waiting 90s for IsJavaScriptExpressionTrue. https://luci-logdog.appspot.com/v/?s=chrome%2Fbb%2Fchromium.perf%2FMac_Retina_Perf%2F717%2F%2B%2Frecipes%2Fsteps%2Fsystem_health.common_desktop_on_Intel_GPU_on_Mac_on_Mac-10.11%2F0%2Fstdout
,
Jun 1 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977987219470005600
,
Jun 1 2017
=== BISECT JOB RESULTS === Bisect failed for unknown reasons Please contact the team (see below) and report the error. Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8977987219470005600 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5512582351290368 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 1 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977985809017008624
,
Jun 1 2017
,
Jun 1 2017
=== BISECT JOB RESULTS === Bisect failed for unknown reasons Please contact the team (see below) and report the error. Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8977985809017008624 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5512582351290368 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 1 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/6689fa57bf8bf1e7b615adb03505ba1200aa2f3c commit 6689fa57bf8bf1e7b615adb03505ba1200aa2f3c Author: Juan A. Navarro Perez <perezju@chromium.org> Date: Thu Jun 01 14:20:49 2017 [tools/perf] Disable browse:news:cnn on Mac Story is failing consistently on mac retina bot. TBR=nenguyen@google.com Bug: 728576 Change-Id: I6706b20a0465300f969a720c6f23170fab5d8eb5 Reviewed-on: https://chromium-review.googlesource.com/521047 Reviewed-by: Juan Antonio Navarro Pérez <perezju@chromium.org> Commit-Queue: Juan Antonio Navarro Pérez <perezju@chromium.org> Cr-Commit-Position: refs/heads/master@{#476277} [modify] https://crrev.com/6689fa57bf8bf1e7b615adb03505ba1200aa2f3c/tools/perf/page_sets/system_health/browsing_stories.py
,
Jun 2 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977938910723453120
,
Jun 2 2017
Bisects were failing due to crbug.com/728594 , restarting this.
,
Jun 2 2017
Hi Simon, Any idea what happened with this bisect? It says that it's complete, but I can't find a result, and it wasn't posted in this bug.
,
Jun 2 2017
=== BISECT JOB RESULTS === NO Test failure found Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.memory_desktop Metric : memory:chrome:all_processes:reported_by_chrome:allocated_objects_size_avg/memory:chrome:all_processes:reported_by_chrome:allocated_objects_size_avg Revision Exit Code N chromium@475428 1 +- N/A 10 good chromium@475489 1 +- N/A 10 bad Please refer to the following doc on diagnosing memory regressions: https://chromium.googlesource.com/chromium/src/+/master/docs/memory-infra/memory_benchmarks.md To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests system_health.memory_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8977938910723453120 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=4979688243462144 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 6 2017
The NextAction date has arrived: 2017-06-06
,
Jun 7 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977437490534945072
,
Jun 7 2017
Trying again going even farther to the past ...
,
Jun 7 2017
=== BISECT JOB RESULTS === Bisect failed for unknown reasons Please contact the team (see below) and report the error. Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8977437490534945072 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5580049643732992 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 7 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8977427129278266240
,
Jun 7 2017
=== BISECT JOB RESULTS === NO Test failure found Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn Revision Exit Code N chromium@474302 1 +- N/A 10 good chromium@475428 1 +- N/A 10 bad To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8977427129278266240 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5580049643732992 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 21 2017
Let's try one more time, going even further back in time when the story was definitely passing.
,
Jun 21 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8976165194544608576
,
Jun 21 2017
=== BISECT JOB RESULTS === Bisect failed for unknown reasons Please contact the team (see below) and report the error. Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8976165194544608576 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5007648967098368 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 21 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8976155172540194640
,
Jun 21 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8976154996149312640
,
Jun 21 2017
=== BISECT JOB RESULTS === Bisect failed for unknown reasons Please contact the team (see below) and report the error. Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8976155172540194640 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5857880424579072 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 21 2017
=== BISECT JOB RESULTS === NO Test failure found Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn Revision Exit Code N chromium@472741 1 +- N/A 10 good chromium@474302 1 +- N/A 10 bad To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8976154996149312640 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5007648967098368 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 21 2017
Started bisect job https://chromeperf.appspot.com/buildbucket_job_status/8976143672680828224
,
Jun 21 2017
=== BISECT JOB RESULTS === NO Test failure found Bisect Details Configuration: mac_retina_perf_bisect Benchmark : system_health.common_desktop Metric : cpuTimeToFirstMeaningfulPaint_avg/browse_news/browse_news_cnn Revision Exit Code N chromium@472741 1 +- N/A 10 good chromium@474302 1 +- N/A 10 bad To Run This Test src/tools/perf/run_benchmark -v --browser=release --output-format=chartjson --upload-results --pageset-repeat=1 --also-run-disabled-tests --story-filter=browse.news.cnn system_health.common_desktop Debug Info https://chromeperf.appspot.com/buildbucket_job_status/8976143672680828224 Is this bisect wrong? https://chromeperf.appspot.com/bad_bisect?try_job_id=5857880424579072 | O O | Visit http://www.chromium.org/developers/speed-infra/perf-bug-faq | X | for more information addressing perf regression bugs. For feedback, | / \ | file a bug with component Speed>Bisection. Thank you!
,
Jun 22 2017
Failures persist even if we keep going back in the past. And the failure is the same, timing out waiting for a page to load:
File "/b/c/b/mac_retina_perf_bisect/src/tools/perf/page_sets/system_health/browsing_stories.py", line 87, in _ReadNextArticle
action_runner.tab.WaitForDocumentReadyStateToBeComplete()
At this point I'm wondering whether the most reasonable solution would be to re-record the story?
,
Jun 22 2017
Right. Or we can wait for wpr-go to re-record the story. This seems like some sort of error trying to replay video content?
,
Jun 22 2017
This seems to be an important user story. I am not sure how long it will take for wpr-go to be ready on Mac. Please re-record. If it helps, you can take get a NetLog dump (--profiler=netlog). It should tell us what exactly failed to load.
,
Jul 19
The story is passing for me locally. Trying a pinpoint job to see if it passes on mac in the lab.
,
Jul 19
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/15a7a796a40000
,
Jul 19
📍 Pinpoint job started. https://pinpoint-dot-chromeperf.appspot.com/job/157b37f6a40000
,
Jul 19
📍 Job complete. See results below. https://pinpoint-dot-chromeperf.appspot.com/job/15a7a796a40000
,
Jul 19
📍 Job complete. See results below. https://pinpoint-dot-chromeperf.appspot.com/job/157b37f6a40000
,
Jul 19
10/10 runs passed on both Mac hardware configs. Re-enabling.
,
Jul 19
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/1a2fc71a8fb505f32af238ad7d36c671dec6a18d commit 1a2fc71a8fb505f32af238ad7d36c671dec6a18d Author: Annie Sullivan <sullivan@chromium.org> Date: Thu Jul 19 20:05:59 2018 Re-enable browse:news:cnn on Mac in system_health.common_desktop Bug: 728576 Change-Id: I400c9f1a408f9840b00895683cf6a1d0f2b4ae4c TBR: nednguyen@google.com Reviewed-on: https://chromium-review.googlesource.com/1143142 Reviewed-by: Annie Sullivan <sullivan@chromium.org> Commit-Queue: Annie Sullivan <sullivan@chromium.org> Cr-Commit-Position: refs/heads/master@{#576597} [modify] https://crrev.com/1a2fc71a8fb505f32af238ad7d36c671dec6a18d/tools/perf/expectations.config
,
Jul 19
|
|||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||
Comment 1 by perezju@chromium.org
, Jun 1 2017