Flaky WebRtcCaptureFromElementBrowserTest on android |
||||
Issue descriptionhttps://uberchromegw.corp.google.com/i/chromium.android/builders/KitKat%20Tablet%20Tester https://uberchromegw.corp.google.com/i/chromium.android/builders/Lollipop%20Phone%20Tester https://uberchromegw.corp.google.com/i/chromium.android/builders/Lollipop%20Tablet%20Tester etc Disabling VerifyCanvasWebGLCaptureColor on android.
,
Apr 24 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/5983d0ae0dc74c59f63c1851637ae2a8a13421d6 commit 5983d0ae0dc74c59f63c1851637ae2a8a13421d6 Author: mattcary <mattcary@chromium.org> Date: Mon Apr 24 09:24:16 2017 Disabling flaky WebRtcCaptureFromElementBrowserTest.VerifyCanvasWebGLCaptureColor on android emircan and mcasas to TBR as taken from recent changes to the same tests. BUG= 714549 TBR=emircan@chromium.org,mcasas@chromium.org Review-Url: https://codereview.chromium.org/2835973002 Cr-Commit-Position: refs/heads/master@{#466608} [modify] https://crrev.com/5983d0ae0dc74c59f63c1851637ae2a8a13421d6/content/browser/webrtc/webrtc_capture_from_element_browsertest.cc
,
Apr 24 2017
https://build.chromium.org/p/chromium.webrtc.fyi/builders/Android%20Tests%20%28dbg%29%20%28L%20Nexus9%29/builds/21024 https://build.chromium.org/p/chromium.webrtc.fyi/builders/Android%20Tests%20%28dbg%29%20%28L%20Nexus6%29/builds/15288 https://build.chromium.org/p/chromium.webrtc.fyi/builders/Android%20Tests%20%28dbg%29%20%28L%20Nexus5%29/builds/20693 https://build.chromium.org/p/chromium.webrtc.fyi/builders/Android%20Tests%20%28dbg%29%20%28K%20Nexus5%29/builds/15687 Log from one of the bots: I 544.432s run_tests_on_device(03852a60003b9cb8) [ RUN ] WebRtcCaptureFromElementBrowserTest.VerifyCanvasWebGLCaptureColor I 544.433s run_tests_on_device(03852a60003b9cb8) [WARNING:dns_config_service_posix.cc(326)] Failed to read DnsConfig. I 544.433s run_tests_on_device(03852a60003b9cb8) [ERROR:devtools_http_handler.cc(221)] Cannot start http server for devtools. Stop devtools. I 544.433s run_tests_on_device(03852a60003b9cb8) [ERROR:child_process_launcher_helper_posix.cc(115)] Ignoring invalid file assets/snapshot_blob_64.bin I 544.433s run_tests_on_device(03852a60003b9cb8) [WARNING:simple_synchronous_entry.cc(1054)] Could not open platform files for entry. I 544.433s run_tests_on_device(03852a60003b9cb8) [ERROR:shell_android.cc(72)] Not implemented reached in void content::Shell::PlatformSetTitle(const string16&): Media Capture from DOM Elements (canvas) Browser Test I 544.433s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:59709/media/mediarecorder_test_utils.js (22) I 544.433s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(90)] "Expected 255,0,0,255, got 0,0,0,0", source: http://127.0.0.1:59709/media/canvas_capture_color.html (90) I 544.433s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:59709/media/mediarecorder_test_utils.js (22) I 544.433s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:59709/media/mediarecorder_test_utils.js (22) I 544.433s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:59709/media/mediarecorder_test_utils.js (22) I 544.433s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:59709/media/mediarecorder_test_utils.js (22) I 544.433s run_tests_on_device(03852a60003b9cb8) [INFO:browser_test_utils.cc(1477)] DOMMessageQueue::RenderProcessGone 5 I 544.433s run_tests_on_device(03852a60003b9cb8) [ERROR:browser_test_utils.cc(158)] Cannot communicate with DOMMessageQueue. I 544.433s run_tests_on_device(03852a60003b9cb8) ../../content/browser/webrtc/webrtc_content_browsertest_base.cc:67: Failure I 544.433s run_tests_on_device(03852a60003b9cb8) Value of: ExecuteScriptAndExtractString(shell(), javascript, &result) I 544.433s run_tests_on_device(03852a60003b9cb8) Actual: false I 544.433s run_tests_on_device(03852a60003b9cb8) Expected: true I 544.434s run_tests_on_device(03852a60003b9cb8) Failed to execute javascript testCanvasWebGLCaptureColors();. I 544.434s run_tests_on_device(03852a60003b9cb8) From javascript: (nothing) I 544.434s run_tests_on_device(03852a60003b9cb8) When executing 'testCanvasWebGLCaptureColors();' I 544.434s run_tests_on_device(03852a60003b9cb8) ../../content/browser/webrtc/webrtc_content_browsertest_base.cc:91: Failure I 544.434s run_tests_on_device(03852a60003b9cb8) Failed I 544.434s run_tests_on_device(03852a60003b9cb8) [ FAILED ] WebRtcCaptureFromElementBrowserTest.VerifyCanvasWebGLCaptureColor, where TypeParam = and GetParam() = (2011 ms) For completeness, a log where it passes: I 425.526s run_tests_on_device(03852a60003b9cb8) [ RUN ] WebRtcCaptureFromElementBrowserTest.VerifyCanvasWebGLCaptureColor I 425.526s run_tests_on_device(03852a60003b9cb8) [WARNING:dns_config_service_posix.cc(326)] Failed to read DnsConfig. I 425.526s run_tests_on_device(03852a60003b9cb8) [ERROR:devtools_http_handler.cc(221)] Cannot start http server for devtools. Stop devtools. I 425.526s run_tests_on_device(03852a60003b9cb8) [ERROR:child_process_launcher_helper_posix.cc(115)] Ignoring invalid file assets/snapshot_blob_64.bin I 425.526s run_tests_on_device(03852a60003b9cb8) [WARNING:simple_synchronous_entry.cc(1054)] Could not open platform files for entry. I 425.526s run_tests_on_device(03852a60003b9cb8) [ERROR:shell_android.cc(72)] Not implemented reached in void content::Shell::PlatformSetTitle(const string16&): Media Capture from DOM Elements (canvas) Browser Test I 425.526s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:60385/media/mediarecorder_test_utils.js (22) I 425.526s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(90)] "Expected 255,0,0,255, got 0,0,0,0", source: http://127.0.0.1:60385/media/canvas_capture_color.html (90) I 425.526s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:60385/media/mediarecorder_test_utils.js (22) I 425.527s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:60385/media/mediarecorder_test_utils.js (22) I 425.527s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:60385/media/mediarecorder_test_utils.js (22) I 425.527s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:60385/media/mediarecorder_test_utils.js (22) I 425.527s run_tests_on_device(03852a60003b9cb8) [INFO:CONSOLE(22)] "Waiting for", source: http://127.0.0.1:60385/media/mediarecorder_test_utils.js (22) I 425.527s run_tests_on_device(03852a60003b9cb8) [ OK ] WebRtcCaptureFromElementBrowserTest.VerifyCanvasWebGLCaptureColor (1737 ms) Looks almost identical. +CC Junov who owns the similar Issue 706009.
,
Apr 24 2017
braveyao@ can you PTAL?
,
Apr 25 2017
,
Apr 26 2017
I can't reproduce this at my side, w/o hw codec enabled. I tried to run the test case repeatedly (over 100 times) on each N5 K/ N5 L/ N7 M, and all passed. Not sure if this is just a side effect of issue715069 or other failures. I think it's OK to re-enable the case and see what will happen. mcasas@/emircan@, any other thought?
,
Apr 26 2017
I think it is a side affect as you pointed. The test should be fine after the revert.
,
Apr 26 2017
Actually I also tried to run the test with HW H264/VP8 enabled locally on N7, on which my cl caused bots failure. And from bots log, it even happened after my cl was reverted, but with other failed cases around. So it's hard to tell the reason. According to the successful local test result with ToT building, let's try to enable it again then.
,
Apr 26 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/362999207c6a8a108bdbf2d4ea7400e6ad0b2554 commit 362999207c6a8a108bdbf2d4ea7400e6ad0b2554 Author: braveyao <braveyao@chromium.org> Date: Wed Apr 26 23:46:58 2017 Revert of Disabling flaky WebRtcCaptureFromElementBrowserTest.VerifyCanvasWebGLCaptureColor on android (patchset #1 id:1 of https://codereview.chromium.org/2835973002/ ) Reason for revert: Can't reproduce this locally with ToT. Guess it may be affected by issue715069 or other bots failures. Let's reenable it and check. Original issue's description: > Disabling flaky WebRtcCaptureFromElementBrowserTest.VerifyCanvasWebGLCaptureColor on android > > emircan and mcasas to TBR as taken from recent changes to the same tests. > > BUG= 714549 > TBR=emircan@chromium.org,mcasas@chromium.org > > Review-Url: https://codereview.chromium.org/2835973002 > Cr-Commit-Position: refs/heads/master@{#466608} > Committed: https://chromium.googlesource.com/chromium/src/+/5983d0ae0dc74c59f63c1851637ae2a8a13421d6 TBR=emircan@chromium.org,mcasas@chromium.org,mattcary@chromium.org # Not skipping CQ checks because original CL landed more than 1 days ago. BUG= 714549 Review-Url: https://codereview.chromium.org/2839303002 Cr-Commit-Position: refs/heads/master@{#467517} [modify] https://crrev.com/362999207c6a8a108bdbf2d4ea7400e6ad0b2554/content/browser/webrtc/webrtc_capture_from_element_browsertest.cc
,
Apr 26 2017
Let's see if this problem will happen again after the reverting, while the hw codec is not enabled for mediaRecorder, before next step to set this as Fixed or disable the case again for further investigation.
,
Apr 27 2017
he bots are happy again. |
||||
►
Sign in to add a comment |
||||
Comment 1 by mattcary@chromium.org
, Apr 24 2017