The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/18458bb5f1faf72f18813653b5b6c59bed4e5984

commit 18458bb5f1faf72f18813653b5b6c59bed4e5984
Author: sebsg <sebsg@chromium.org>
Date: Tue Sep 12 20:15:26 2017

Disable TabCaptureApiTest.ApiTests flakes on Mac.

Bug: 764464
Tbr: miu@chromium.org
Change-Id: Ibe3cc60266d1c20c79fe6f4b742f882426796ced
Reviewed-on: https://chromium-review.googlesource.com/664065
Reviewed-by: Sebastien Seguin-Gagnon <sebsg@chromium.org>
Commit-Queue: Sebastien Seguin-Gagnon <sebsg@chromium.org>
Cr-Commit-Position: refs/heads/master@{#501377}
[modify] https://crrev.com/18458bb5f1faf72f18813653b5b6c59bed4e5984/chrome/browser/extensions/api/tab_capture/tab_capture_apitest.cc

Perhaps we could have only disabled the test when the --enable-browser-side-navigation flag is present? The normal browser_tests work perfectly. ;-)

Sorry, I didn't take the time to understand the cause. There were lots of different failures and I wanted to fix them fast. Feel free to change change it if you think they are not flaky. Thanks!

It seems this extension API test has exposed an issue when enabling browser side navigation. Not sure if it is specific to just this test or an even bigger problem.

Assigning to jam@ (AFAICT, the browser_side_navigation_browser_tests owner). Please let me know if I can answer any questions about this extension API, the tests, or help with code reviewing fixes. :)

<trying to add to CC owners of chrome.tabCapture API [based on git logs]>

FWIW I am not able to repro at r503452, on Linux with --gtest_repeat=30.  If somebody is able to repro, then maybe we can understand what is going wrong by comparing 1) what happens during a repro against 2) what happens with --disable-browser-side-navigation (assumming this bug is caused by PlzNavigate and doesn't repro with this cmdline flag).

These are the right folks.  We'll try to find someone to take a look.  This looks to be a problem in the extensions API bindings, not sure how navigation changes could be related to that.

lucasza: Please note this issue was only affecting Mac, per subject line. ;-) So, no surprise that you could not repro on Linux.

Admittedly, this is very strange: Is there anything platform-specific about PlzNavigate where it would behave differently on Mac? Nevertheless, the builders don't lie: Test runs on Mac were very flaky, while there were no flakes on the other platforms. Maybe there's a race condition: These tests do open a second tab that is controlled by JavaScript running in the first tab: Maybe navigations in the second tab are not correctly being accounted for by the renderer for the first tab (like a synchronization issue?).

nasko: I originally flagged this as blocking because it may have exposed an issue that affects the wider web: We need to confirm that the flake is, in fact, is all in the test code; and be sure this isn't something that's about to break a number of web sites. Note that this test has been very stable for a long time, and it only turned "flaky" on the PlzNavigate browser tests runs, not the renderer-navigate ones.

If you disgaree, of course, feel free to put the label back again. I'm just seriously concerned that our test has somehow exposed a weird edge case that may break things for other similar "patterns" in-the-wild.

PlzNavigate has been the default on trunk for close to two weeks and is 100% on stable, so FWIW I'm considering it shipped. Since we haven't heard yet reports from users about what this test is trying to cover, I assume it is still a problem, but not one that is blocking shipping PlzNavigate. This is the reason I removed the "Blocking" suffix.

Adding arthursonzogni@ and ahemery@, who might have some cycles to investigate why the failure occurs.

I would have liked to take a look, but I do not have a mac machine to reproduce it. 

I've run locally the test with 100 iterations in Release build and there were no failures. I will attempt another local run and if it still passes, I think it will be good to re-enable the test and see if the bots are still flaky with it. 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/0cece6a45baf482c68e8e54a4522afff5776ed7e

commit 0cece6a45baf482c68e8e54a4522afff5776ed7e
Author: Nasko Oskov <nasko@chromium.org>
Date: Thu Oct 12 21:48:42 2017

Re-enable TabCaptureApiTest.ApiTests on Mac.

I have run the test locally multiple times with iteration count of 100
and 200 without any failures. Re-enabling to see if it will flake on
the bots or whatever the root cause was is possibly fixed.

Bug: 764464
Change-Id: Iedd41ec3b7fa1172766ac32196f3c8dbc2994f9d
Reviewed-on: https://chromium-review.googlesource.com/716797
Reviewed-by: Yuri Wiitala <miu@chromium.org>
Reviewed-by: Alex Moshchuk <alexmos@chromium.org>
Commit-Queue: Nasko Oskov <nasko@chromium.org>
Cr-Commit-Position: refs/heads/master@{#508486}
[modify] https://crrev.com/0cece6a45baf482c68e8e54a4522afff5776ed7e/chrome/browser/extensions/api/tab_capture/tab_capture_apitest.cc

https://uberchromegw.corp.google.com/i/chromium.mac/builders/Mac10.12%20Tests looks clean with no failures in this test. Closing the bug.

 Issue 775822  has been merged into this issue.

Flaking again with the same stderr. This time, 50% of the builds on Mac 10.9 fail.

https://build.chromium.org/p/chromium.mac/builders/Mac10.9%20Tests%20%28dbg%29

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d6eac8c09e0e15b8aca6c054741588f570ecded0

commit d6eac8c09e0e15b8aca6c054741588f570ecded0
Author: Martin Šrámek <msramek@chromium.org>
Date: Wed Oct 18 09:03:02 2017

Revert "Re-enable TabCaptureApiTest.ApiTests on Mac."

This reverts commit 0cece6a45baf482c68e8e54a4522afff5776ed7e.

Reason for revert: The test indeed flakes again.

Original change's description:
> Re-enable TabCaptureApiTest.ApiTests on Mac.
> 
> I have run the test locally multiple times with iteration count of 100
> and 200 without any failures. Re-enabling to see if it will flake on
> the bots or whatever the root cause was is possibly fixed.
> 
> Bug: 764464
> Change-Id: Iedd41ec3b7fa1172766ac32196f3c8dbc2994f9d
> Reviewed-on: https://chromium-review.googlesource.com/716797
> Reviewed-by: Yuri Wiitala <miu@chromium.org>
> Reviewed-by: Alex Moshchuk <alexmos@chromium.org>
> Commit-Queue: Nasko Oskov <nasko@chromium.org>
> Cr-Commit-Position: refs/heads/master@{#508486}

TBR=nasko@chromium.org,miu@chromium.org,alexmos@chromium.org

# Not skipping CQ checks because original CL landed > 1 day ago.

Bug: 764464
Change-Id: I770164ccc298fdb33cf082fc3aa6aef307c10f49
Reviewed-on: https://chromium-review.googlesource.com/725399
Reviewed-by: Martin Šrámek <msramek@chromium.org>
Commit-Queue: Martin Šrámek <msramek@chromium.org>
Cr-Commit-Position: refs/heads/master@{#509720}
[modify] https://crrev.com/d6eac8c09e0e15b8aca6c054741588f570ecded0/chrome/browser/extensions/api/tab_capture/tab_capture_apitest.cc

Disabled. nasko@, can I assign this back to you for investigation?

I've tried to reproduce this locally multiple times and was unable to. Not sure how I can make progress in investigating when the test doesn't fail locally or on the trybots.

Can extra logging be added so that when it flakes next on the waterfall we
have more information?

FWIW, the flaky test is basically just running some JavaScript as an extension, to test the extension API: https://cs.chromium.org/chromium/src/chrome/test/data/extensions/api_test/tab_capture/api_tests.js

Dump of builder logs from the last failed run before the revert (https://build.chromium.org/p/chromium.mac/builders/Mac10.9%20Tests%20%28dbg%29/builds/46249):

[ RUN      ] TabCaptureApiTest.ApiTests
[69155:55555:1018/001353.381276:WARNING:mac_util.mm(226)] Failed to set backup exclusion for file '/private/var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/.org.chromium.Chromium.kxzk9e/d81po9r/Default/History': Error Domain=NSOSStatusErrorDomain Code=-50 "The operation couldn?t be completed. (OSStatus error -50.)" (paramErr: error in user parameter list) (-50)
[69155:5123:1018/001353.399535:WARNING:notification_platform_bridge_mac.mm(519)] AlertNotificationService: XPC connection invalidated.
[69155:55555:1018/001353.573481:WARNING:mac_util.mm(226)] Failed to set backup exclusion for file '/private/var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/.org.chromium.Chromium.kxzk9e/d81po9r/Default/Favicons': Error Domain=NSOSStatusErrorDomain Code=-50 "The operation couldn?t be completed. (OSStatus error -50.)" (paramErr: error in user parameter list) (-50)
[69163:771:1018/001353.596803:WARNING:vt_video_decode_accelerator_mac.cc(178)] Failed to create VTDecompressionSession: Error Domain=NSOSStatusErrorDomain Code=-8973 "The operation couldn?t be completed. (OSStatus error -8973.)" (codecOpenErr) (-8973)
[69163:771:1018/001353.598216:WARNING:vt_video_decode_accelerator_mac.cc(200)] Failed to create hardware VideoToolbox session
[69163:771:1018/001353.681800:ERROR:vt_video_encode_accelerator_mac.cc(495)]  VTCompressionSessionCreate failed: -12908
[69166:771:1018/001355.141357:ERROR:render_process_impl.cc(189)] WebFrame LEAKED 1 TIMES
[69155:771:1018/001355.184667:INFO:CONSOLE(28)] "pending", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[69155:771:1018/001355.187868:INFO:CONSOLE(28)] "active", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[69155:48387:1018/001355.235138:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[69155:771:1018/001355.386666:INFO:CONSOLE(28)] "stopped", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[69155:771:1018/001355.389560:INFO:CONSOLE(0)] "[SUCCESS] captureTabAndVerifyStateTransitions", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69187:771:1018/001359.145407:ERROR:render_process_impl.cc(189)] WebFrame LEAKED 1 TIMES
[69155:771:1018/001359.159639:ERROR:video_capture_device_client.cc(427)] error@ RenewFrameSubscription@../../content/browser/media/capture/web_contents_video_capture_device.cc:651, WebContents and/or main frame are gone., OS message: No such file or directory (2)
[69182:14339:1018/001359.161963:WARNING:audio_input_device.cc(226)] AudioInputDevice::OnStateChanged(ERROR)
[69155:771:1018/001359.177562:INFO:CONSOLE(0)] "[FAIL] getCapturedTabs: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:92:21
    at extensions::tabCapture:59:30", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.179160:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture:
    at Object.callback (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:91:18)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.183770:INFO:CONSOLE(138)] "Uncaught chrome.test.failure", source: extensions::test (138)
[69155:771:1018/001359.228310:INFO:CONSOLE(0)] "[SUCCESS] captureSameTab", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.591213:INFO:CONSOLE(0)] "[FAIL] tabIsUnmutedWhenTabCaptured: uncaught exception: Cannot read property 'muted' of undefined: TypeError: Cannot read property 'muted' of undefined
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:124:35
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at extensions::test:108:22
    at Object.handle (extensions::uncaught_exception_handler:21:3)
    at handleException (extensions::test:32:24)
    at safeFunctionApply (extensions::test:279:7)
    at listener (extensions::test:322:7)
    at EventImpl.dispatchToListener (extensions::event_bindings:403:22)
    at Event.publicClassPrototype.(anonymous function) [as dispatchToListener] (extensions::utils:138:26)
    at EventImpl.dispatch_ (extensions::event_bindings:387:35)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.606778:INFO:CONSOLE(0)] "[FAIL] onlyVideo: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:142:19
    at Object.proxyToGetUserMedia [as customCallback] (extensions::tabCapture:30:7)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.609161:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture: Cannot capture a tab with an active stream.
    at onlyVideo (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:141:16)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.636036:INFO:CONSOLE(0)] "[FAIL] onlyAudio: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:150:19
    at Object.proxyToGetUserMedia [as customCallback] (extensions::tabCapture:30:7)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.637640:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture: Cannot capture a tab with an active stream.
    at onlyAudio (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:149:16)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.653203:INFO:CONSOLE(0)] "[SUCCESS] noAudioOrVideoRequested", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.662598:WARNING:one_google_bar_fetcher_impl.cc(272)] Request failed with error: -11: net::ERR_NOT_IMPLEMENTED
[69155:771:1018/001359.755173:INFO:CONSOLE(0)] "[SUCCESS] offscreenTabsDoNotShowUpAsCapturedTabs", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[69155:771:1018/001359.894662:INFO:CONSOLE(0)] "[SUCCESS] offscreenTabsDoNotShowUpInTabsQuery", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
../../chrome/browser/extensions/api/tab_capture/tab_capture_apitest.cc:151: Failure
Value of: RunExtensionSubtest("tab_capture", "api_tests.html")
  Actual: false
Expected: true
Failed 4 of 9 tests
[69155:48387:1018/001400.032312:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[69155:771:1018/001400.153948:INFO:chrome_cryptauth_service.cc(222)] Profile is not authenticated yet; waiting before starting CryptAuth managers.
[69155:46083:1018/001400.191345:ERROR:gpu_channel_host.cc(301)] OnChannelError
[69155:771:1018/001400.358567:WARNING:url_request_context_getter.cc(43)] URLRequestContextGetter leaking due to no owning thread.
[  FAILED  ] TabCaptureApiTest.ApiTests, where TypeParam =  and GetParam() =  (7232 ms)
[ RUN      ] TabCaptureApiTest.ApiTests
[71972:55323:1018/002023.976484:WARNING:mac_util.mm(226)] Failed to set backup exclusion for file '/private/var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/.org.chromium.Chromium.kxzk9e/dGhgFO1/Default/History': Error Domain=NSOSStatusErrorDomain Code=-50 "The operation couldn?t be completed. (OSStatus error -50.)" (paramErr: error in user parameter list) (-50)
[71972:5123:1018/002023.997389:WARNING:notification_platform_bridge_mac.mm(519)] AlertNotificationService: XPC connection invalidated.
[71972:55323:1018/002024.182722:WARNING:mac_util.mm(226)] Failed to set backup exclusion for file '/private/var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/.org.chromium.Chromium.kxzk9e/dGhgFO1/Default/Favicons': Error Domain=NSOSStatusErrorDomain Code=-50 "The operation couldn?t be completed. (OSStatus error -50.)" (paramErr: error in user parameter list) (-50)
[71977:771:1018/002024.241764:WARNING:vt_video_decode_accelerator_mac.cc(178)] Failed to create VTDecompressionSession: Error Domain=NSOSStatusErrorDomain Code=-8973 "The operation couldn?t be completed. (OSStatus error -8973.)" (codecOpenErr) (-8973)
[71977:771:1018/002024.244081:WARNING:vt_video_decode_accelerator_mac.cc(200)] Failed to create hardware VideoToolbox session
[71977:771:1018/002024.336857:ERROR:vt_video_encode_accelerator_mac.cc(495)]  VTCompressionSessionCreate failed: -12908
[71981:771:1018/002025.817180:ERROR:render_process_impl.cc(189)] WebFrame LEAKED 1 TIMES
[71972:771:1018/002025.864089:INFO:CONSOLE(28)] "pending", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[71972:771:1018/002025.868098:INFO:CONSOLE(28)] "active", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[71972:49411:1018/002025.883455:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[71972:771:1018/002026.101596:INFO:CONSOLE(28)] "stopped", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[71972:771:1018/002026.104395:INFO:CONSOLE(0)] "[SUCCESS] captureTabAndVerifyStateTransitions", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:38659:1018/002026.184639:WARNING:simple_synchronous_entry.cc(1110)] Could not open platform files for entry.
[72008:771:1018/002030.907739:ERROR:render_process_impl.cc(189)] WebFrame LEAKED 1 TIMES
[71972:771:1018/002030.921175:ERROR:video_capture_device_client.cc(427)] error@ RenewFrameSubscription@../../content/browser/media/capture/web_contents_video_capture_device.cc:651, WebContents and/or main frame are gone., OS message: No such file or directory (2)
[71972:771:1018/002030.934360:INFO:CONSOLE(0)] "[FAIL] getCapturedTabs: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:92:21
    at extensions::tabCapture:59:30", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002030.937403:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture:
    at Object.callback (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:91:18)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002030.939132:INFO:CONSOLE(138)] "Uncaught chrome.test.failure", source: extensions::test (138)
[71972:49411:1018/002030.960367:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[71972:771:1018/002030.964077:INFO:CONSOLE(0)] "[SUCCESS] captureSameTab", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.427771:INFO:CONSOLE(0)] "[FAIL] tabIsUnmutedWhenTabCaptured: uncaught exception: Cannot read property 'muted' of undefined: TypeError: Cannot read property 'muted' of undefined
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:124:35
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at extensions::test:108:22
    at Object.handle (extensions::uncaught_exception_handler:21:3)
    at handleException (extensions::test:32:24)
    at safeFunctionApply (extensions::test:279:7)
    at listener (extensions::test:322:7)
    at EventImpl.dispatchToListener (extensions::event_bindings:403:22)
    at Event.publicClassPrototype.(anonymous function) [as dispatchToListener] (extensions::utils:138:26)
    at EventImpl.dispatch_ (extensions::event_bindings:387:35)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.439226:INFO:CONSOLE(0)] "[FAIL] onlyVideo: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:142:19
    at Object.proxyToGetUserMedia [as customCallback] (extensions::tabCapture:30:7)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.440830:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture: Cannot capture a tab with an active stream.
    at onlyVideo (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:141:16)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.469314:INFO:CONSOLE(0)] "[FAIL] onlyAudio: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:150:19
    at Object.proxyToGetUserMedia [as customCallback] (extensions::tabCapture:30:7)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.472745:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture: Cannot capture a tab with an active stream.
    at onlyAudio (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:149:16)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.485402:INFO:CONSOLE(0)] "[SUCCESS] noAudioOrVideoRequested", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.495961:WARNING:one_google_bar_fetcher_impl.cc(272)] Request failed with error: -11: net::ERR_NOT_IMPLEMENTED
[71972:771:1018/002031.628929:INFO:CONSOLE(0)] "[SUCCESS] offscreenTabsDoNotShowUpAsCapturedTabs", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[71972:771:1018/002031.741528:INFO:CONSOLE(0)] "[SUCCESS] offscreenTabsDoNotShowUpInTabsQuery", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
../../chrome/browser/extensions/api/tab_capture/tab_capture_apitest.cc:151: Failure
Value of: RunExtensionSubtest("tab_capture", "api_tests.html")
  Actual: false
Expected: true
Failed 4 of 9 tests
[71972:49411:1018/002031.797529:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[71972:771:1018/002032.013194:INFO:chrome_cryptauth_service.cc(222)] Profile is not authenticated yet; waiting before starting CryptAuth managers.
[71972:45827:1018/002032.040219:ERROR:gpu_channel_host.cc(301)] OnChannelError
[71972:771:1018/002032.074847:WARNING:url_request_context_getter.cc(43)] URLRequestContextGetter leaking due to no owning thread.
[  FAILED  ] TabCaptureApiTest.ApiTests, where TypeParam =  and GetParam() =  (8380 ms)
[ RUN      ] TabCaptureApiTest.ApiTests
[72017:55811:1018/002033.098271:WARNING:mac_util.mm(226)] Failed to set backup exclusion for file '/private/var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/.org.chromium.Chromium.kxzk9e/dWLJWQc/Default/History': Error Domain=NSOSStatusErrorDomain Code=-50 "The operation couldn?t be completed. (OSStatus error -50.)" (paramErr: error in user parameter list) (-50)
[72017:5123:1018/002033.123300:WARNING:notification_platform_bridge_mac.mm(519)] AlertNotificationService: XPC connection invalidated.
[72022:771:1018/002033.303949:WARNING:vt_video_decode_accelerator_mac.cc(178)] Failed to create VTDecompressionSession: Error Domain=NSOSStatusErrorDomain Code=-8973 "The operation couldn?t be completed. (OSStatus error -8973.)" (codecOpenErr) (-8973)
[72022:771:1018/002033.305884:WARNING:vt_video_decode_accelerator_mac.cc(200)] Failed to create hardware VideoToolbox session
[72017:55811:1018/002033.327967:WARNING:mac_util.mm(226)] Failed to set backup exclusion for file '/private/var/folders/9x/6c6sv3cj4j53wzpzthbp4ksm0000gm/T/.org.chromium.Chromium.kxzk9e/dWLJWQc/Default/Favicons': Error Domain=NSOSStatusErrorDomain Code=-50 "The operation couldn?t be completed. (OSStatus error -50.)" (paramErr: error in user parameter list) (-50)
[72022:771:1018/002033.440471:ERROR:vt_video_encode_accelerator_mac.cc(495)]  VTCompressionSessionCreate failed: -12908
[72023:771:1018/002034.807078:ERROR:render_process_impl.cc(189)] WebFrame LEAKED 1 TIMES
[72017:771:1018/002034.851332:INFO:CONSOLE(28)] "pending", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[72017:771:1018/002034.856195:INFO:CONSOLE(28)] "active", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[72017:48643:1018/002034.874458:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[72017:771:1018/002035.046537:INFO:CONSOLE(28)] "stopped", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js (28)
[72017:771:1018/002035.048240:INFO:CONSOLE(0)] "[SUCCESS] captureTabAndVerifyStateTransitions", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:39171:1018/002035.109909:WARNING:simple_synchronous_entry.cc(1110)] Could not open platform files for entry.
[72025:771:1018/002039.336385:ERROR:render_process_impl.cc(189)] WebFrame LEAKED 1 TIMES
[72017:771:1018/002039.349362:ERROR:video_capture_device_client.cc(427)] error@ RenewFrameSubscription@../../content/browser/media/capture/web_contents_video_capture_device.cc:651, WebContents and/or main frame are gone., OS message: No such file or directory (2)
[72017:771:1018/002039.368721:INFO:CONSOLE(0)] "[FAIL] getCapturedTabs: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:92:21
    at extensions::tabCapture:59:30", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.371450:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture:
    at Object.callback (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:91:18)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.374109:INFO:CONSOLE(138)] "Uncaught chrome.test.failure", source: extensions::test (138)
[72017:48643:1018/002039.411851:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[72017:771:1018/002039.416426:INFO:CONSOLE(0)] "[SUCCESS] captureSameTab", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.944191:INFO:CONSOLE(0)] "[FAIL] tabIsUnmutedWhenTabCaptured: uncaught exception: Cannot read property 'muted' of undefined: TypeError: Cannot read property 'muted' of undefined
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:124:35
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at extensions::test:108:22
    at Object.handle (extensions::uncaught_exception_handler:21:3)
    at handleException (extensions::test:32:24)
    at safeFunctionApply (extensions::test:279:7)
    at listener (extensions::test:322:7)
    at EventImpl.dispatchToListener (extensions::event_bindings:403:22)
    at Event.publicClassPrototype.(anonymous function) [as dispatchToListener] (extensions::utils:138:26)
    at EventImpl.dispatch_ (extensions::event_bindings:387:35)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.966006:INFO:CONSOLE(0)] "[FAIL] onlyVideo: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:142:19
    at Object.proxyToGetUserMedia [as customCallback] (extensions::tabCapture:30:7)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.970916:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture: Cannot capture a tab with an active stream.
    at onlyVideo (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:141:16)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.986668:INFO:CONSOLE(0)] "[FAIL] onlyAudio: FAIL (no message)
Error
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:168:18)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at Object.<anonymous> (extensions::test:152:16)
    at Object.handleRequest (extensions::binding:64:27)
    at Object.<anonymous> (extensions::binding:374:32)
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:150:19
    at Object.proxyToGetUserMedia [as customCallback] (extensions::tabCapture:30:7)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.993356:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running tabCapture.capture: Cannot capture a tab with an active stream.
    at onlyAudio (chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:149:16)", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002039.996471:WARNING:one_google_bar_fetcher_impl.cc(272)] Request failed with error: -11: net::ERR_NOT_IMPLEMENTED
[72017:771:1018/002040.003317:INFO:CONSOLE(0)] "[SUCCESS] noAudioOrVideoRequested", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002040.132923:INFO:CONSOLE(0)] "[SUCCESS] offscreenTabsDoNotShowUpAsCapturedTabs", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
[72017:771:1018/002040.247669:INFO:CONSOLE(0)] "[SUCCESS] offscreenTabsDoNotShowUpInTabsQuery", source: chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.html (0)
../../chrome/browser/extensions/api/tab_capture/tab_capture_apitest.cc:151: Failure
Value of: RunExtensionSubtest("tab_capture", "api_tests.html")
  Actual: false
Expected: true
Failed 4 of 9 tests
[72017:48643:1018/002040.305286:WARNING:audio_input_sync_writer.cc(362)] AISW: No room in socket buffer.: Broken pipe (32)
[72017:771:1018/002040.508830:INFO:chrome_cryptauth_service.cc(222)] Profile is not authenticated yet; waiting before starting CryptAuth managers.
[72017:46083:1018/002040.541826:ERROR:gpu_channel_host.cc(301)] OnChannelError
[72017:771:1018/002040.582509:WARNING:url_request_context_getter.cc(43)] URLRequestContextGetter leaking due to no owning thread.
[  FAILED  ] TabCaptureApiTest.ApiTests, where TypeParam =  and GetParam() =  (7757 ms)

Based on the logs, it looks like the same 5 JS tests succeed, and the other 4 fail. Looking at this one is very interesting:

[FAIL] tabIsUnmutedWhenTabCaptured: uncaught exception: Cannot read property 'muted' of undefined: TypeError: Cannot read property 'muted' of undefined
    at chrome-extension://ddchlicdkolnonkihahngkmmmjnjlkkf/api_tests.js:124:35

This actually means it's not a chrome.tabCapture API bug. Instead, it seems that the chrome.tabs.onUpdated event is being fired for something other than what the test expects. See, the test expects changeInfo.mutedInfo to be set, to provide a tab mute status update. However, the exception message indicates that the changeInfo does *not* have this mutedInfo field set. That would mean that an onUpdated event is being dispatched for some other tab event.

Ref: https://developer.chrome.com/extensions/tabs#event-onUpdated

Speculating: Could that "some other tab event" be an URL change event? Or a "loading/complete" status change? This would definitely explain why the test flakes are related to the enabling of PlzNavigate. I'm guessing the timing of browser events has caused a delayed chrome.tabs.onUpdated event to be dispatched for an URL change or a loading/complete status update. If I'm right here, we should be able to fix the test by ignoring the onUpdated events that don't have the changeInfo.mutedInfo filed set.

Thanks for the analysis in comment #25. I'm marking this as available as I won't be able to look into it in the next week or so. If someone wants to take a stab at this in the meantime, feel free to do so.

clamy@, can you or someone in your office take a look at this one, so we ensure there is progress made?

+ahemery, arthursonzogni FYI

I'll try to have a look at it tomorrow (don't have access to a Mac machine today).

It seems like the test is also Flaky on Linux ChromiumOS Msan
https://uberchromegw.corp.google.com/i/chromium.memory/builders/Linux%20ChromiumOS%20MSan%20Tests/builds/4145
https://uberchromegw.corp.google.com/i/chromium.memory/builders/Linux%20ChromiumOS%20MSan%20Tests/builds/4157

I marked it flaky in this CL
https://chromium-review.googlesource.com/c/chromium/src/+/769728

Also flaky in Linux MSan.
https://uberchromegw.corp.google.com/i/chromium.memory/builders/Linux%20MSan%20Tests/builds/5885

Marking it flaky

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/baf02790c7bbce05281e10786d131f357307fcf7

commit baf02790c7bbce05281e10786d131f357307fcf7
Author: Luna Lu <loonybear@chromium.org>
Date: Wed Nov 15 15:34:45 2017

Mark TabCaptureApiTest.ApiTests as flaky on Linux MSan

TBR: clamy,justinlin
Bug: 764464
Change-Id: Id6d81c27a9460541544b084aed2a26d794875f27
Reviewed-on: https://chromium-review.googlesource.com/771536
Reviewed-by: Luna Lu <loonybear@chromium.org>
Commit-Queue: Luna Lu <loonybear@chromium.org>
Cr-Commit-Position: refs/heads/master@{#516703}
[modify] https://crrev.com/baf02790c7bbce05281e10786d131f357307fcf7/chrome/browser/extensions/api/tab_capture/tab_capture_apitest.cc

I can repro the Linux MSan error locally. I'm investigating.

The issue on MSan also repros with PlzNavigate disabled, making this not a PlzNavigate specific issue. I'm going to re-assign to the TabCapture folks. Please send it back if you still see a PlzNavigate specific issue once the Linux Msan one is fixed.