New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 829650 link

Starred by 4 users

Issue metadata

Status: Assigned
Owner:
Last visit > 30 days ago
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows , Fuchsia
Pri: 1
Type: Bug

Blocking:
issue 820950



Sign in to add a comment

NetworkErrorLoggingEndToEndTest flaky on win10_chromium_x64_rel_ng

Project Member Reported by kbr@chromium.org, Apr 6 2018

Issue description

Following on to Issue 820950, multiple tests in NetworkErrorLoggingEndToEndTest (net_unittests) are flaky on the win10_chromium_x64_rel_ng tryserver. This is causing valid CLs to be rejected from the CQ.

Examples:

NetworkErrorLoggingEndToEndTest.ReportNetworkError
https://ci.chromium.org/buildbot/tryserver.chromium.win/win10_chromium_x64_rel_ng/117869
https://chromium-swarm.appspot.com/task?id=3cb0e9f9e9e19c10&refresh=10&show_raw=1

NetworkErrorLoggingEndToEndTest.UploadAtShutdown
https://ci.chromium.org/buildbot/tryserver.chromium.win/win10_chromium_x64_rel_ng/116947
https://chromium-swarm.appspot.com/task?id=3cac215b24ec3810&refresh=10&show_raw=1

Both tests timed out, including during all of the retries.

 
This https://chromium-review.googlesource.com/c/chromium/src/+/996093 may help. If not, we can disable it again.

Comment 2 by gab@chromium.org, Apr 11 2018

I'm still hitting these flaky hangs on CQ this morning (and I can repro easily locally on Windows with out\Release\net_unittests.exe --gtest_repeat=10 --gtest_filter=NetworkErrorLoggingEndToEndTest*)

Comment 3 by gab@chromium.org, Apr 11 2018

FWIW, I added a few base::debug::StackTrace().Print(); in the test to see what happens when the test doesn't hang (hinting at what doesn't happen when it does hang) :

Test passes (no hang) :

[ RUN      ] NetworkErrorLoggingEndToEndTest.ReportNetworkError
        Backtrace (invoking HandleReportRequest()):
                base::debug::StackTrace::StackTrace [0x68810900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x6881001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest::HandleReportRequest [0x01667904+46] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:131)
                base::internal::Invoker<base::internal::BindState<std::unique_ptr<net::test_server::HttpResponse,std::default_delete<net::test_server::HttpResponse> > (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(const net::test_server::HttpRequest &)  [0x01667B7C+20] (D:\src\chrome\src\base\bind_internal.h:589)
                net::test_server::EmbeddedTestServer::HandleRequest [0x0183C715+241] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:214)
                base::internal::FunctorTraits<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscall)),void>::Invoke<ne [0x0183E92F+53] (D:\src\chrome\src\base\bind_internal.h:447)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscal [0x0183E8E7+53] (D:\src\chrome\src\base\bind_internal.h:586)
                net::test_server::HttpConnection::ConsumeData [0x0186F0EA+112] (D:\src\chrome\src\net\test\embedded_test_server\http_connection.cc:46)
                net::test_server::EmbeddedTestServer::HandleReadResult [0x0183D889+155] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:446)
                net::test_server::EmbeddedTestServer::OnReadCompleted [0x0183D7CA+114] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:431)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::test_server::EmbeddedTestServer>,net::test_server::H [0x0183EEC8+18] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x68B2F17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::SSLServerContextImpl::SocketImpl::DoReadCallback [0x68D88EE2+216] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:706)
                net::SSLServerContextImpl::SocketImpl::OnReadReady [0x68D88DAD+51] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:552)
                net::SocketBIOAdapter::OnSocketReadIfReadyComplete [0x68B2B788+174] (D:\src\chrome\src\net\socket\socket_bio_adapter.cc:203)
                base::internal::Invoker<base::internal::BindState<void (net::SocketBIOAdapter::*)(int) __attribute__((thiscall)),base::WeakPtr<net::SocketBIOAdapter> >,void (int)>::Run [0x68B2C182+48] (D:\src\chrome\src\base\bind_internal.h:589)
                net::TCPClientSocket::DidCompleteReadWrite [0x68D8B110+36] (D:\src\chrome\src\net\socket\tcp_client_socket.cc:383)
                base::internal::Invoker<base::internal::BindState<void (net::TCPClientSocket::*)(const base::RepeatingCallback<void (int)> &, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::TCPClientSocket>,base::RepeatingCallback<void (int)> >,void [0x68D8B14F+19] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x68B2F17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::TCPSocketWin::DidSignalRead [0x68D8BDB7+427] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:1003)
                net::TCPSocketWin::Core::ReadDelegate::OnObjectSignaled [0x68D8B9FF+179] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:221)
                base::win::ObjectWatcher::Signal [0x6891ED1E+30] (D:\src\chrome\src\base\win\object_watcher.cc:111)
                base::internal::Invoker<base::internal::BindState<void (base::win::ObjectWatcher::*)(base::win::ObjectWatcher::Delegate *) __attribute__((thiscall)),base::WeakPtr<base::win::ObjectWatcher>,base::win::ObjectWatcher::Delegate *>,void ()>::Run [0x6891EDC5+149] (D:\src\chrome\src\base\bind_internal.h:589)
                base::debug::TaskAnnotator::RunTask [0x68812234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x688485A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x6884C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x6884C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x6884C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x6884FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x6884EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x6884BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68889DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x688CDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x688CE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x688C99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace (posting OnUploadReceived() to |main_task_runner_| from HandleReportRequest():
                base::debug::StackTrace::StackTrace [0x68810900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x6881001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest::HandleReportRequest [0x016679BF+233] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:136)
                base::internal::Invoker<base::internal::BindState<std::unique_ptr<net::test_server::HttpResponse,std::default_delete<net::test_server::HttpResponse> > (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(const net::test_server::HttpRequest &)  [0x01667B7C+20] (D:\src\chrome\src\base\bind_internal.h:589)
                net::test_server::EmbeddedTestServer::HandleRequest [0x0183C715+241] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:214)
                base::internal::FunctorTraits<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscall)),void>::Invoke<ne [0x0183E92F+53] (D:\src\chrome\src\base\bind_internal.h:447)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscal [0x0183E8E7+53] (D:\src\chrome\src\base\bind_internal.h:586)
                net::test_server::HttpConnection::ConsumeData [0x0186F0EA+112] (D:\src\chrome\src\net\test\embedded_test_server\http_connection.cc:46)
                net::test_server::EmbeddedTestServer::HandleReadResult [0x0183D889+155] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:446)
                net::test_server::EmbeddedTestServer::OnReadCompleted [0x0183D7CA+114] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:431)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::test_server::EmbeddedTestServer>,net::test_server::H [0x0183EEC8+18] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x68B2F17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::SSLServerContextImpl::SocketImpl::DoReadCallback [0x68D88EE2+216] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:706)
                net::SSLServerContextImpl::SocketImpl::OnReadReady [0x68D88DAD+51] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:552)
                net::SocketBIOAdapter::OnSocketReadIfReadyComplete [0x68B2B788+174] (D:\src\chrome\src\net\socket\socket_bio_adapter.cc:203)
                base::internal::Invoker<base::internal::BindState<void (net::SocketBIOAdapter::*)(int) __attribute__((thiscall)),base::WeakPtr<net::SocketBIOAdapter> >,void (int)>::Run [0x68B2C182+48] (D:\src\chrome\src\base\bind_internal.h:589)
                net::TCPClientSocket::DidCompleteReadWrite [0x68D8B110+36] (D:\src\chrome\src\net\socket\tcp_client_socket.cc:383)
                base::internal::Invoker<base::internal::BindState<void (net::TCPClientSocket::*)(const base::RepeatingCallback<void (int)> &, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::TCPClientSocket>,base::RepeatingCallback<void (int)> >,void [0x68D8B14F+19] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x68B2F17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::TCPSocketWin::DidSignalRead [0x68D8BDB7+427] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:1003)
                net::TCPSocketWin::Core::ReadDelegate::OnObjectSignaled [0x68D8B9FF+179] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:221)
                base::win::ObjectWatcher::Signal [0x6891ED1E+30] (D:\src\chrome\src\base\win\object_watcher.cc:111)
                base::internal::Invoker<base::internal::BindState<void (base::win::ObjectWatcher::*)(base::win::ObjectWatcher::Delegate *) __attribute__((thiscall)),base::WeakPtr<base::win::ObjectWatcher>,base::win::ObjectWatcher::Delegate *>,void ()>::Run [0x6891EDC5+149] (D:\src\chrome\src\base\bind_internal.h:589)
                base::debug::TaskAnnotator::RunTask [0x68812234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x688485A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x6884C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x6884C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x6884C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x6884FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x6884EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x6884BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68889DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x688CDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x688CE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x688C99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace (invoking OnUploadReceived()):
                base::debug::StackTrace::StackTrace [0x68810900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x6881001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest::OnUploadReceived [0x01667BE8+78] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:154)
                base::internal::FunctorTraits<void (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(std::basic_string<char,std::char_traits<char>,std::allocator<char> >) __attribute__((thiscall)),void>::Invoke<net::(anonymous namespace)::NetworkErrorLoggi [0x01667CA7+73] (D:\src\chrome\src\base\bind_internal.h:447)
                base::internal::Invoker<base::internal::BindState<void (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(std::basic_string<char,std::char_traits<char>,std::allocator<char> >) __attribute__((thiscall)),base::internal::UnretainedWrapper<net:: [0x01667C4B+47] (D:\src\chrome\src\base\bind_internal.h:572)
                base::debug::TaskAnnotator::RunTask [0x68812234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x688485A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x6884C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x6884C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x6884C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x6884FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x6884EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x6884BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68889DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest_ReportNetworkError_Test::TestBody [0x0166708E+326] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:190)
                testing::Test::Run [0x017E5FAE+178] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:2491)
                testing::TestInfo::Run [0x017E679E+204] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:2671)
                testing::TestCase::Run [0x017E6C0A+238] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:2784)
                testing::internal::UnitTestImpl::RunAllTests [0x017ECF4A+632] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:5045)
                testing::UnitTest::Run [0x017ECBD4+156] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:4663)
                base::TestSuite::Run [0x0186658E+102] (D:\src\chrome\src\base\test\test_suite.cc:284)
                base::OnceCallback<int ()>::Run [0x01869B3B+45] (D:\src\chrome\src\base\callback.h:95)
                base::`anonymous namespace'::LaunchUnitTestsInternal [0x01868C1B+274] (D:\src\chrome\src\base\test\launcher\unit_test_launcher.cc:225)
                base::LaunchUnitTests [0x01868AE0+176] (D:\src\chrome\src\base\test\launcher\unit_test_launcher.cc:576)
                main [0x015933ED+189] (D:\src\chrome\src\net\test\run_all_unittests.cc:64)
                __scrt_common_main_seh [0x018DAADA+248] (f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl:283)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        [       OK ] NetworkErrorLoggingEndToEndTest.ReportNetworkError (982 ms)



Test fails (hang):
  (HandleReportRequest() never invoked)
That is *super* helpful, gab -- thanks. Do you know how long the timeout is?

Comment 5 by gab@chromium.org, Apr 11 2018

More stacks (added dumps in TCPSocketWin::Accept and TCPSocketWin::OnObjectSignaled):

Test passes (no hang):

        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::TCPSocketWin::Accept [0x68B1CBF9+41] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:367)
                net::TCPServerSocket::Accept [0x68B1B5E5+325] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:74)
                net::test_server::EmbeddedTestServer::DoAcceptLoop [0x0183C35C+116] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:356)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::TCPSocketWin::Accept [0x68B1CBF9+41] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:367)
                net::TCPServerSocket::Accept [0x68B1B5E5+325] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:74)
                net::test_server::EmbeddedTestServer::DoAcceptLoop [0x0183C35C+116] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:356)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::TCPSocketWin::Accept [0x68B1CBF9+41] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:367)
                net::TCPServerSocket::Accept [0x68B1B5E5+325] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:74)
                net::test_server::EmbeddedTestServer::DoAcceptLoop [0x0183C35C+116] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:356)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::TCPSocketWin::OnObjectSignaled [0x68B1E63F+43] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:771)
                base::win::ObjectWatcher::Signal [0x68F2ED1E+30] (D:\src\chrome\src\base\win\object_watcher.cc:111)
                base::internal::Invoker<base::internal::BindState<void (base::win::ObjectWatcher::*)(base::win::ObjectWatcher::Delegate *) __attribute__((thiscall)),base::WeakPtr<base::win::ObjectWatcher>,base::win::ObjectWatcher::Delegate *>,void ()>::Run [0x68F2EDC5+149] (D:\src\chrome\src\base\bind_internal.h:589)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::TCPSocketWin::Accept [0x68B1CBF9+41] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:367)
                net::TCPServerSocket::Accept [0x68B1B5E5+325] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:74)
                net::test_server::EmbeddedTestServer::DoAcceptLoop [0x0183C35C+116] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:356)
                net::test_server::EmbeddedTestServer::OnAcceptCompleted [0x0183D2BB+133] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:378)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::test_server::EmbeddedTestServer> >,void (int)>::Run [0x0183E807+15] (D:\src\chrome\src\base\bind_internal.h:589)
                net::TCPServerSocket::OnAcceptCompleted [0x68B1B654+44] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:110)
                base::internal::Invoker<base::internal::BindState<void (net::TCPServerSocket::*)(std::unique_ptr<net::StreamSocket,std::default_delete<net::StreamSocket> > *, const base::RepeatingCallback<void (int)> &, int) __attribute__((thiscall)),base::internal::Unre [0x68B1B728+22] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x688BF17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::TCPSocketWin::OnObjectSignaled [0x68B1E73A+294] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:783)
                base::win::ObjectWatcher::Signal [0x68F2ED1E+30] (D:\src\chrome\src\base\win\object_watcher.cc:111)
                base::internal::Invoker<base::internal::BindState<void (base::win::ObjectWatcher::*)(base::win::ObjectWatcher::Delegate *) __attribute__((thiscall)),base::WeakPtr<base::win::ObjectWatcher>,base::win::ObjectWatcher::Delegate *>,void ()>::Run [0x68F2EDC5+149] (D:\src\chrome\src\base\bind_internal.h:589)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest::HandleReportRequest [0x01667904+46] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:131)
                base::internal::Invoker<base::internal::BindState<std::unique_ptr<net::test_server::HttpResponse,std::default_delete<net::test_server::HttpResponse> > (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(const net::test_server::HttpRequest &)  [0x01667B7C+20] (D:\src\chrome\src\base\bind_internal.h:589)
                net::test_server::EmbeddedTestServer::HandleRequest [0x0183C715+241] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:214)
                base::internal::FunctorTraits<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscall)),void>::Invoke<ne [0x0183E92F+53] (D:\src\chrome\src\base\bind_internal.h:447)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscal [0x0183E8E7+53] (D:\src\chrome\src\base\bind_internal.h:586)
                net::test_server::HttpConnection::ConsumeData [0x0186F0EA+112] (D:\src\chrome\src\net\test\embedded_test_server\http_connection.cc:46)
                net::test_server::EmbeddedTestServer::HandleReadResult [0x0183D889+155] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:446)
                net::test_server::EmbeddedTestServer::OnReadCompleted [0x0183D7CA+114] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:431)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::test_server::EmbeddedTestServer>,net::test_server::H [0x0183EEC8+18] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x688BF17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::SSLServerContextImpl::SocketImpl::DoReadCallback [0x68B18EE2+216] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:706)
                net::SSLServerContextImpl::SocketImpl::OnReadReady [0x68B18DAD+51] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:552)
                net::SocketBIOAdapter::OnSocketReadIfReadyComplete [0x688BB788+174] (D:\src\chrome\src\net\socket\socket_bio_adapter.cc:203)
                base::internal::Invoker<base::internal::BindState<void (net::SocketBIOAdapter::*)(int) __attribute__((thiscall)),base::WeakPtr<net::SocketBIOAdapter> >,void (int)>::Run [0x688BC182+48] (D:\src\chrome\src\base\bind_internal.h:589)
                net::TCPClientSocket::DidCompleteReadWrite [0x68B1B110+36] (D:\src\chrome\src\net\socket\tcp_client_socket.cc:383)
                base::internal::Invoker<base::internal::BindState<void (net::TCPClientSocket::*)(const base::RepeatingCallback<void (int)> &, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::TCPClientSocket>,base::RepeatingCallback<void (int)> >,void [0x68B1B14F+19] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x688BF17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::TCPSocketWin::DidSignalRead [0x68B1BDB7+427] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:1006)
                net::TCPSocketWin::Core::ReadDelegate::OnObjectSignaled [0x68B1B9FF+179] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:222)
                base::win::ObjectWatcher::Signal [0x68F2ED1E+30] (D:\src\chrome\src\base\win\object_watcher.cc:111)
                base::internal::Invoker<base::internal::BindState<void (base::win::ObjectWatcher::*)(base::win::ObjectWatcher::Delegate *) __attribute__((thiscall)),base::WeakPtr<base::win::ObjectWatcher>,base::win::ObjectWatcher::Delegate *>,void ()>::Run [0x68F2EDC5+149] (D:\src\chrome\src\base\bind_internal.h:589)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest::HandleReportRequest [0x016679BF+233] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:136)
                base::internal::Invoker<base::internal::BindState<std::unique_ptr<net::test_server::HttpResponse,std::default_delete<net::test_server::HttpResponse> > (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(const net::test_server::HttpRequest &)  [0x01667B7C+20] (D:\src\chrome\src\base\bind_internal.h:589)
                net::test_server::EmbeddedTestServer::HandleRequest [0x0183C715+241] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:214)
                base::internal::FunctorTraits<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscall)),void>::Invoke<ne [0x0183E92F+53] (D:\src\chrome\src\base\bind_internal.h:447)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, std::unique_ptr<net::test_server::HttpRequest,std::default_delete<net::test_server::HttpRequest> >) __attribute__((thiscal [0x0183E8E7+53] (D:\src\chrome\src\base\bind_internal.h:586)
                net::test_server::HttpConnection::ConsumeData [0x0186F0EA+112] (D:\src\chrome\src\net\test\embedded_test_server\http_connection.cc:46)
                net::test_server::EmbeddedTestServer::HandleReadResult [0x0183D889+155] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:446)
                net::test_server::EmbeddedTestServer::OnReadCompleted [0x0183D7CA+114] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:431)
                base::internal::Invoker<base::internal::BindState<void (net::test_server::EmbeddedTestServer::*)(net::test_server::HttpConnection *, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::test_server::EmbeddedTestServer>,net::test_server::H [0x0183EEC8+18] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x688BF17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::SSLServerContextImpl::SocketImpl::DoReadCallback [0x68B18EE2+216] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:706)
                net::SSLServerContextImpl::SocketImpl::OnReadReady [0x68B18DAD+51] (D:\src\chrome\src\net\socket\ssl_server_socket_impl.cc:552)
                net::SocketBIOAdapter::OnSocketReadIfReadyComplete [0x688BB788+174] (D:\src\chrome\src\net\socket\socket_bio_adapter.cc:203)
                base::internal::Invoker<base::internal::BindState<void (net::SocketBIOAdapter::*)(int) __attribute__((thiscall)),base::WeakPtr<net::SocketBIOAdapter> >,void (int)>::Run [0x688BC182+48] (D:\src\chrome\src\base\bind_internal.h:589)
                net::TCPClientSocket::DidCompleteReadWrite [0x68B1B110+36] (D:\src\chrome\src\net\socket\tcp_client_socket.cc:383)
                base::internal::Invoker<base::internal::BindState<void (net::TCPClientSocket::*)(const base::RepeatingCallback<void (int)> &, int) __attribute__((thiscall)),base::internal::UnretainedWrapper<net::TCPClientSocket>,base::RepeatingCallback<void (int)> >,void [0x68B1B14F+19] (D:\src\chrome\src\base\bind_internal.h:589)
                base::RepeatingCallback<void (int)>::Run [0x688BF17D+49] (D:\src\chrome\src\base\callback.h:135)
                net::TCPSocketWin::DidSignalRead [0x68B1BDB7+427] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:1006)
                net::TCPSocketWin::Core::ReadDelegate::OnObjectSignaled [0x68B1B9FF+179] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:222)
                base::win::ObjectWatcher::Signal [0x68F2ED1E+30] (D:\src\chrome\src\base\win\object_watcher.cc:111)
                base::internal::Invoker<base::internal::BindState<void (base::win::ObjectWatcher::*)(base::win::ObjectWatcher::Delegate *) __attribute__((thiscall)),base::WeakPtr<base::win::ObjectWatcher>,base::win::ObjectWatcher::Delegate *>,void ()>::Run [0x68F2EDC5+149] (D:\src\chrome\src\base\bind_internal.h:589)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
                base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
                base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        Backtrace:
                base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
                base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest::OnUploadReceived [0x01667BE8+78] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:154)
                base::internal::FunctorTraits<void (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(std::basic_string<char,std::char_traits<char>,std::allocator<char> >) __attribute__((thiscall)),void>::Invoke<net::(anonymous namespace)::NetworkErrorLoggi [0x01667CA7+73] (D:\src\chrome\src\base\bind_internal.h:447)
                base::internal::Invoker<base::internal::BindState<void (net::(anonymous namespace)::NetworkErrorLoggingEndToEndTest::*)(std::basic_string<char,std::char_traits<char>,std::allocator<char> >) __attribute__((thiscall)),base::internal::UnretainedWrapper<net:: [0x01667C4B+47] (D:\src\chrome\src\base\bind_internal.h:572)
                base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
                base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
                base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
                base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
                base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
                base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
                base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
                base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
                base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
                net::`anonymous namespace'::NetworkErrorLoggingEndToEndTest_ReportNetworkError_Test::TestBody [0x0166708E+326] (D:\src\chrome\src\net\network_error_logging\network_error_logging_end_to_end_test.cc:190)
                testing::Test::Run [0x017E5FAE+178] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:2491)
                testing::TestInfo::Run [0x017E679E+204] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:2671)
                testing::TestCase::Run [0x017E6C0A+238] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:2784)
                testing::internal::UnitTestImpl::RunAllTests [0x017ECF4A+632] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:5045)
                testing::UnitTest::Run [0x017ECBD4+156] (D:\src\chrome\src\third_party\googletest\src\googletest\src\gtest.cc:4663)
                base::TestSuite::Run [0x0186658E+102] (D:\src\chrome\src\base\test\test_suite.cc:284)
                base::OnceCallback<int ()>::Run [0x01869B3B+45] (D:\src\chrome\src\base\callback.h:95)
                base::`anonymous namespace'::LaunchUnitTestsInternal [0x01868C1B+274] (D:\src\chrome\src\base\test\launcher\unit_test_launcher.cc:225)
                base::LaunchUnitTests [0x01868AE0+176] (D:\src\chrome\src\base\test\launcher\unit_test_launcher.cc:576)
                main [0x015933ED+189] (D:\src\chrome\src\net\test\run_all_unittests.cc:64)
                __scrt_common_main_seh [0x018DAADA+248] (f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl:283)
                BaseThreadInitThunk [0x746562C4+36]
                RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
                RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
        [       OK ] NetworkErrorLoggingEndToEndTest.ReportNetworkError (1169 ms)


Test fails (hangs -- never invokes TCPSocketWin::OnObjectSignaled):
Backtrace:
        base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
        base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
        net::TCPSocketWin::Accept [0x68B1CBF9+41] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:367)
        net::TCPServerSocket::Accept [0x68B1B5E5+325] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:74)
        net::test_server::EmbeddedTestServer::DoAcceptLoop [0x0183C35C+116] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:356)
        base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
        base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
        base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
        base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
        base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
        base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
        base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
        base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
        base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
        base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
        base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
        base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
        BaseThreadInitThunk [0x746562C4+36]
        RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
        RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
Backtrace:
        base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
        base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
        net::TCPSocketWin::Accept [0x68B1CBF9+41] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:367)
        net::TCPServerSocket::Accept [0x68B1B5E5+325] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:74)
        net::test_server::EmbeddedTestServer::DoAcceptLoop [0x0183C35C+116] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:356)
        base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
        base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
        base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
        base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
        base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
        base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
        base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
        base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
        base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
        base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
        base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
        base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
        BaseThreadInitThunk [0x746562C4+36]
        RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
        RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
Backtrace:
        base::debug::StackTrace::StackTrace [0x68E20900+32] (D:\src\chrome\src\base\debug\stack_trace_win.cc:286)
        base::debug::StackTrace::StackTrace [0x68E2001D+13] (D:\src\chrome\src\base\debug\stack_trace.cc:199)
        net::TCPSocketWin::Accept [0x68B1CBF9+41] (D:\src\chrome\src\net\socket\tcp_socket_win.cc:367)
        net::TCPServerSocket::Accept [0x68B1B5E5+325] (D:\src\chrome\src\net\socket\tcp_server_socket.cc:74)
        net::test_server::EmbeddedTestServer::DoAcceptLoop [0x0183C35C+116] (D:\src\chrome\src\net\test\embedded_test_server\embedded_test_server.cc:356)
        base::debug::TaskAnnotator::RunTask [0x68E22234+308] (D:\src\chrome\src\base\debug\task_annotator.cc:101)
        base::internal::IncomingTaskQueue::RunTask [0x68E585A9+105] (D:\src\chrome\src\base\message_loop\incoming_task_queue.cc:124)
        base::MessageLoop::RunTask [0x68E5C157+519] (D:\src\chrome\src\base\message_loop\message_loop.cc:327)
        base::MessageLoop::DeferOrRunPendingTask [0x68E5C6AD+157] (D:\src\chrome\src\base\message_loop\message_loop.cc:336)
        base::MessageLoop::DoWork [0x68E5C8DA+506] (D:\src\chrome\src\base\message_loop\message_loop.cc:380)
        base::MessagePumpForIO::DoRunLoop [0x68E5FD75+133] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:482)
        base::MessagePumpWin::Run [0x68E5EE0E+110] (D:\src\chrome\src\base\message_loop\message_pump_win.cc:59)
        base::MessageLoop::Run [0x68E5BC74+116] (D:\src\chrome\src\base\message_loop\message_loop.cc:280)
        base::RunLoop::Run [0x68E99DBC+204] (D:\src\chrome\src\base\run_loop.cc:133)
        base::Thread::Run [0x68EDDEC4+164] (D:\src\chrome\src\base\threading\thread.cc:255)
        base::Thread::ThreadMain [0x68EDE3E7+631] (D:\src\chrome\src\base\threading\thread.cc:340)
        base::`anonymous namespace'::ThreadFunc [0x68ED99E5+165] (D:\src\chrome\src\base\threading\platform_thread_win.cc:94)
        BaseThreadInitThunk [0x746562C4+36]
        RtlSubscribeWnfStateChangeNotification [0x778D0F79+1081]
        RtlSubscribeWnfStateChangeNotification [0x778D0F44+1028]
I'm working on a CL here that I can run past the trybots to debug this, but a couple of LOGs or stack traces in net/reporting/reporting_uploader.cc could help -- I'm not actually sure whether we're ever starting the request we expect.
Project Member

Comment 7 by bugdroid1@chromium.org, Apr 11 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/6ed58b359ac2681d2142dc59bff49af4bbe19695

commit 6ed58b359ac2681d2142dc59bff49af4bbe19695
Author: Gabriel Charette <gab@chromium.org>
Date: Wed Apr 11 18:20:36 2018

Disable NetworkErrorLoggingEndToEndTest on Windows for now to unflake CQ

Flakes reproducible locally via:
net_unittests.exe --gtest_repeat=10 --gtest_filter=NetworkErrorLoggingEndToEndTest*

TBR=juliatuttle@chromium.org

Bug: 829650, 820950
Change-Id: Ie97028bce64a4c8f5d0fc9d164ad0174ae9f95d5
Reviewed-on: https://chromium-review.googlesource.com/1007643
Commit-Queue: Gabriel Charette <gab@chromium.org>
Reviewed-by: Gabriel Charette <gab@chromium.org>
Cr-Commit-Position: refs/heads/master@{#549932}
[modify] https://crrev.com/6ed58b359ac2681d2142dc59bff49af4bbe19695/net/network_error_logging/network_error_logging_end_to_end_test.cc

Cc: juliatut...@chromium.org
 Issue 831736  has been merged into this issue.
Owner: dcreager@chromium.org
Cc: w...@chromium.org
 Issue 913155  has been merged into this issue.
Labels: M-73 OS-Fuchsia
Project Member

Comment 12 by bugdroid1@chromium.org, Dec 11

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a3b8e8bea9846a5c3a2c06d8e8ef4893550a7188

commit a3b8e8bea9846a5c3a2c06d8e8ef4893550a7188
Author: Wez <wez@chromium.org>
Date: Tue Dec 11 20:17:10 2018

Disable flaky NetworkErrorLoggingEndToEndTests under OS_FUCHSIA.

These tests are already disabled under OS_WIN, so just add OS_FUCHSIA to
the preprocessor condition.

Bug: 829650,  913155 
Change-Id: I6b323a1918e655d890715ae331fae4e612d5228c
Reviewed-on: https://chromium-review.googlesource.com/c/1372323
Reviewed-by: Josh Karlin <jkarlin@chromium.org>
Commit-Queue: Wez <wez@chromium.org>
Cr-Commit-Position: refs/heads/master@{#615641}
[modify] https://crrev.com/a3b8e8bea9846a5c3a2c06d8e8ef4893550a7188/net/network_error_logging/network_error_logging_end_to_end_test.cc

Sign in to add a comment