New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 773681 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 2
Type: Bug

Blocking:
issue 700083



Sign in to add a comment

GPU.fyi Win7 x64 Release (NVIDIA) shard failures

Project Member Reported by weiliangc@chromium.org, Oct 11 2017

Issue description

bot: https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20x64%20Release%20%28NVIDIA%29

Example swarm info at: https://chromium-swarm.appspot.com/task?id=392243d6a91b3310&refresh=10&show_raw=1

INFO:root:Starting Chrome ['c:\\b\\swarm_slave\\w\\ir\\out\\Release_x64\\chrome.exe', '--disable-gpu-watchdog', '--disable-domain-blocking-for-3d-apis', '--ignore-autoplay-restrictions', '--disable-gpu-process-crash-limit', '--test-type=gpu', '--enable-experimental-canvas-features', '--js-flags=--expose-gc', '--enable-logging=stderr', '--enable-net-benchmarking', '--metrics-recording-only', '--no-default-browser-check', '--no-first-run', '--enable-gpu-benchmarking', '--disable-background-networking', '--proxy-server=socks://localhost:49249', '--ignore-certificate-errors-spki-list=PhrPvGIaAMmd29hj8BCZOq096yj7uMpRNHpn5PDxI6I=', '--disable-component-extensions-with-background-pages', '--disable-default-apps', '--disable-search-geolocation-disclosure', '--remote-debugging-port=0', '--enable-crash-reporter-for-testing', '--disable-component-update', '--window-size=1280,1024', '--user-data-dir=c:\\b\\swarm_slave\\w\\itsctmr0\\tmpncobhs', 'about:blank']
[1010/202058.449:FATAL:at_exit.cc(58)] Check failed: false. Tried to RegisterCallback without an AtExitManager
Backtrace:
	base::debug::StackTrace::StackTrace [0x000007FEEF138495+69]
	base::debug::StackTrace::StackTrace [0x000007FEEF112EC3+19]
	logging::LogMessage::~LogMessage [0x000007FEEF08BB3D+253]
	base::AtExitManager::RegisterTask [0x000007FEEF0FE469+105]
	base::AtExitManager::RegisterCallback [0x000007FEEF0FE3E2+258]
	base::trace_event::TraceEventETWExport::GetInstance [0x000007FEEF139EA0+112]
	base::trace_event::TraceEventETWExport::IsCategoryGroupEnabled [0x000007FEEF13A31D+125]
	base::trace_event::TraceLog::UpdateCategoryState [0x000007FEEF0A9333+371]
	base::trace_event::CategoryRegistry::GetOrCreateCategoryLocked [0x000007FEEF14105F+655]
	base::trace_event::TraceLog::GetCategoryGroupEnabled [0x000007FEEF0A7092+210]
	base::debug::TaskAnnotator::DidQueueTask [0x000007FEEF167705+53]
	base::internal::IncomingTaskQueue::AddToIncomingQueue [0x000007FEEF150E56+982]
	base::internal::MessageLoopTaskRunner::PostDelayedTask [0x000007FEEF151828+328]
	base::TaskRunner::PostTask [0x000007FEEF0C6043+67]
	base::StackSamplingProfiler::SamplingThread::Add [0x000007FEEF0ADAF2+354]
	base::StackSamplingProfiler::Start [0x000007FEEF0AF986+310]
	MainThreadStackSamplingProfiler::MainThreadStackSamplingProfiler [0x000007FEEE2C3F89+205]
	ChromeMain [0x000007FEEE2BF503+223]
	MainDllLoader::Launch [0x000000013F440C50+784]
	wWinMain [0x000000013F43D824+720]
	__scrt_common_main_seh [0x000000013F83C223+279] (f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl:283)
	BaseThreadInitThunk [0x00000000774B59CD+13]
	RtlUserThreadStart [0x00000000776EB891+33]

 
Cc: kbr@chromium.org
First failing: https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20x64%20Release%20%28NVIDIA%29/builds/12511

Last OK:

https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20x64%20Release%20%28NVIDIA%29/builds/12510

Unsure how to tell if this is an infra-related failure, don't see any hashes that relate to the build repo revision.
Cc: weiliangc@chromium.org asvitk...@chromium.org
Owner: isherman@chromium.org
The stack trace contains reference to sampling profiler.
Thanks Weiliang. Apologies Ilya, I think we'll have to revert your CL temporarily while you investigate, as it's blocking the ANGLE CQ.
Project Member

Comment 6 by bugdroid1@chromium.org, Oct 11 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/aba2fd20b6636eab41e7cb7f879ff511b598b11f

commit aba2fd20b6636eab41e7cb7f879ff511b598b11f
Author: Jamie Madill <jmadill@chromium.org>
Date: Wed Oct 11 14:20:37 2017

Revert "[Sampling Profiler] Start sampling as early during initialization as possible."

This reverts commit 65e27b1b16478877de9c5c31a12569a7f8c88a5b.

Reason for revert:
Causes failures in the GPU FYI x64 bots and ANGLE CQ bots.

See for example 
https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20x64%20Release%20%28NVIDIA%29/builds/12511

[1010/202058.449:FATAL:at_exit.cc(58)] Check failed: false. Tried to RegisterCallback without an AtExitManager
Backtrace:
	base::debug::StackTrace::StackTrace [0x000007FEEF138495+69]
	base::debug::StackTrace::StackTrace [0x000007FEEF112EC3+19]
	logging::LogMessage::~LogMessage [0x000007FEEF08BB3D+253]
	base::AtExitManager::RegisterTask [0x000007FEEF0FE469+105]
	base::AtExitManager::RegisterCallback [0x000007FEEF0FE3E2+258]
	base::trace_event::TraceEventETWExport::GetInstance [0x000007FEEF139EA0+112]
	base::trace_event::TraceEventETWExport::IsCategoryGroupEnabled [0x000007FEEF13A31D+125]
	base::trace_event::TraceLog::UpdateCategoryState [0x000007FEEF0A9333+371]
	base::trace_event::CategoryRegistry::GetOrCreateCategoryLocked [0x000007FEEF14105F+655]
	base::trace_event::TraceLog::GetCategoryGroupEnabled [0x000007FEEF0A7092+210]
	base::debug::TaskAnnotator::DidQueueTask [0x000007FEEF167705+53]
	base::internal::IncomingTaskQueue::AddToIncomingQueue [0x000007FEEF150E56+982]
	base::internal::MessageLoopTaskRunner::PostDelayedTask [0x000007FEEF151828+328]
	base::TaskRunner::PostTask [0x000007FEEF0C6043+67]
	base::StackSamplingProfiler::SamplingThread::Add [0x000007FEEF0ADAF2+354]
	base::StackSamplingProfiler::Start [0x000007FEEF0AF986+310]

BUG=773681

Original change's description:
> [Sampling Profiler] Start sampling as early during initialization as possible.
> 
> This will give us visibility into the performance of the earliest parts of
> startup as well as the later parts, which already have coverage.
> 
> R=​asvitkine@chromium.org
> 
> Bug: 700083
> Change-Id: I2fd2e76c00ca46754a57574dc3713ee641494a66
> Reviewed-on: https://chromium-review.googlesource.com/691239
> Reviewed-by: Scott Violet <sky@chromium.org>
> Reviewed-by: Mike Wittman <wittman@chromium.org>
> Reviewed-by: Alexei Svitkine <asvitkine@chromium.org>
> Commit-Queue: Ilya Sherman <isherman@chromium.org>
> Cr-Commit-Position: refs/heads/master@{#507843}

TBR=sky@chromium.org,wittman@chromium.org,isherman@chromium.org,asvitkine@chromium.org

Change-Id: I28d3080b0fa47b953e9a8707511e8cf9bd05ed2d
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: 700083
Reviewed-on: https://chromium-review.googlesource.com/712854
Reviewed-by: Jamie Madill <jmadill@chromium.org>
Commit-Queue: Jamie Madill <jmadill@chromium.org>
Cr-Commit-Position: refs/heads/master@{#507976}
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/chrome/BUILD.gn
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/chrome/app/chrome_main.cc
[delete] https://crrev.com/249ceffbb5c6909ffdb4e0820d6a2dbb3f08aa6f/chrome/app/profiler/BUILD.gn
[delete] https://crrev.com/249ceffbb5c6909ffdb4e0820d6a2dbb3f08aa6f/chrome/app/profiler/DEPS
[delete] https://crrev.com/249ceffbb5c6909ffdb4e0820d6a2dbb3f08aa6f/chrome/app/profiler/OWNERS
[delete] https://crrev.com/249ceffbb5c6909ffdb4e0820d6a2dbb3f08aa6f/chrome/app/profiler/main_thread_stack_sampling_profiler.cc
[delete] https://crrev.com/249ceffbb5c6909ffdb4e0820d6a2dbb3f08aa6f/chrome/app/profiler/main_thread_stack_sampling_profiler.h
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/chrome/browser/chrome_browser_main.cc
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/chrome/browser/chrome_browser_main.h
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/chrome/gpu/chrome_content_gpu_client.cc
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/chrome/gpu/chrome_content_gpu_client.h
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/components/metrics/child_call_stack_profile_collector.cc
[modify] https://crrev.com/aba2fd20b6636eab41e7cb7f879ff511b598b11f/components/metrics/child_call_stack_profile_collector.h

Blocking: 700083
Labels: -Pri-1 Pri-2
Lowering priority and leaving assigned to Ilya.
Example stack trace from the failures:

[1010/200438.395:FATAL:at_exit.cc(58)] Check failed: false. Tried to RegisterCallback without an AtExitManager
Backtrace:
	base::debug::StackTrace::StackTrace [0x000007FEEF758495+69]
	base::debug::StackTrace::StackTrace [0x000007FEEF732EC3+19]
	logging::LogMessage::~LogMessage [0x000007FEEF6ABB3D+253]
	base::AtExitManager::RegisterTask [0x000007FEEF71E469+105]
	base::AtExitManager::RegisterCallback [0x000007FEEF71E3E2+258]
	base::trace_event::TraceEventETWExport::GetInstance [0x000007FEEF759EA0+112]
	base::trace_event::TraceEventETWExport::IsCategoryGroupEnabled [0x000007FEEF75A31D+125]
	base::trace_event::TraceLog::UpdateCategoryState [0x000007FEEF6C9333+371]
	base::trace_event::CategoryRegistry::GetOrCreateCategoryLocked [0x000007FEEF76105F+655]
	base::trace_event::TraceLog::GetCategoryGroupEnabled [0x000007FEEF6C7092+210]
	base::debug::TaskAnnotator::DidQueueTask [0x000007FEEF787705+53]
	base::internal::IncomingTaskQueue::AddToIncomingQueue [0x000007FEEF770E56+982]
	base::internal::MessageLoopTaskRunner::PostDelayedTask [0x000007FEEF771828+328]
	base::TaskRunner::PostTask [0x000007FEEF6E6043+67]
	base::StackSamplingProfiler::SamplingThread::Add [0x000007FEEF6CDAF2+354]
	base::StackSamplingProfiler::Start [0x000007FEEF6CF986+310]
	MainThreadStackSamplingProfiler::MainThreadStackSamplingProfiler [0x000007FEEE8E3F89+205]
	ChromeMain [0x000007FEEE8DF503+223]
	MainDllLoader::Launch [0x000000013FD50C50+784]
	wWinMain [0x000000013FD4D824+720]
	__scrt_common_main_seh [0x000000014014C223+279] (f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl:283)
	BaseThreadInitThunk [0x0000000077B159CD+13]
	RtlUserThreadStart [0x0000000077C4A561+33]


Sign in to add a comment