New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 621188 link

Starred by 1 user

Issue metadata

Status: Duplicate
Merged: issue 352807
Owner:
OOO until 2019-01-24
Closed: Jun 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 1
Type: Bug



Sign in to add a comment

Windows WebGL 2 video tests started flaking, seen on Win7/NVIDIA/Release

Project Member Reported by jmad...@chromium.org, Jun 17 2016

Issue description

Flaking builds:

https://build.chromium.org/p/chromium.gpu.fyi/builders/Win8%20Release%20%28NVIDIA%29/builds/23015
(WebglConformance.conformance2_textures_video_tex_3d_rgb16f_rgb_half_float)
https://build.chromium.org/p/chromium.gpu.fyi/builders/Win8%20Release%20%28NVIDIA%29/builds/23011
(WebglConformance.conformance2_textures_video_tex_2d_rgba8_rgba_unsigned_byte
WebglConformance.conformance2_textures_video_tex_3d_rgba8ui_rgba_integer_unsigned_byte)
https://build.chromium.org/p/chromium.gpu.fyi/builders/Win8%20Release%20%28NVIDIA%29/builds/23013
(WebglConformance.conformance2_textures_video_tex_2d_rgba16f_rgba_float)
https://build.chromium.org/p/chromium.gpu.fyi/builders/Win8%20Release%20%28NVIDIA%29/builds/23015
(WebglConformance.conformance2_textures_video_tex_3d_rgb16f_rgb_half_float)

Relevant error message:

[2504:196:0617/120304:FATAL:gl_bindings_autogen_gl.cc(12516)] Check failed: false. Trying to call glIsSync() without current GL context
Backtrace:
	base::debug::StackTrace::StackTrace [0x69F52917+23]
	logging::LogMessage::~LogMessage [0x69F1DDD1+49]
	gl::NoContextGLApi::glIsSyncFn [0x6BF38B44+84]
	gl::GLFenceARB::~GLFenceARB [0x6CAB5580+48]
	gl::GLFenceARB::`vector deleting destructor' [0x6CAB55FB+11]
	gpu::gles2::CommandsCompletedQuery::`vector deleting destructor' [0x6CA6BF59+25]
	std::_Hash<std::_Umap_traits<unsigned int,scoped_refptr<gpu::gles2::QueryManager::Query>,std::_Uhash_compare<unsigned int,base_hash::hash<unsigned int>,std::equal_to<unsigned int> >,std::allocator<std::pair<unsigned int const ,scoped_refptr<gpu::gles2::Qu [0x6CA6E618+168]
	gpu::gles2::QueryManager::Destroy [0x6CA6C8EF+143]
	gpu::gles2::GLES2DecoderImpl::Destroy [0x6CA37A7C+1948]
	gpu::GpuCommandBufferStub::Destroy [0x6BF8267D+973]
	gpu::GpuCommandBufferStub::~GpuCommandBufferStub [0x6BF81BA6+22]
	base::ScopedPtrHashMap<int,std::unique_ptr<gpu::GpuChannel,std::default_delete<gpu::GpuChannel> > >::clear [0x6C92B790+32]
	base::ScopedPtrHashMap<int,std::unique_ptr<gpu::GpuChannel,std::default_delete<gpu::GpuChannel> > >::clear [0x6C92B790+32]
	content::GpuChildThread::~GpuChildThread [0x6BCA40DE+366]
	content::ChildProcess::~ChildProcess [0x6B53DC3E+206]
	content::GpuMain [0x6BCA27EE+2606]
	content::RunNamedProcessTypeMain [0x69EFE394+260]
	content::ContentMainRunnerImpl::Run [0x69EFE241+321]

Possibly related to https://codereview.chromium.org/2071953003? This kind of problem is very insidious and hard to track down so we should nail it ASAP.
 
Looks like the bots are actually Win8, so this may be related to https://codereview.chromium.org/2060043002 . I'm already reverting that due to another issue.
Status: Fixed (was: Untriaged)
Owner: jbau...@chromium.org
Status: Assigned (was: Fixed)
Whhops, looks like these weren't fixed, and are timing out, causing whole the whole WebGL 2 step to fail:

https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20Release%20%28NVIDIA%29/builds/25526/steps/webgl2_conformance_tests%20on%20NVIDIA%20GPU%20on%20Windows%20on%20Windows-2008ServerR2-SP1/logs/stdio

https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20Release%20%28ATI%29/builds/21515/steps/webgl2_conformance_tests%20on%20ATI%20GPU%20on%20Windows%20on%20Windows-2008ServerR2-SP1/logs/stdio

[ RUN      ] WebglConformance.conformance2_textures_image_bitmap_from_video_tex_3d_rgba32f_rgba_float
(INFO) 2016-06-15 02:08:01,369 cache_temperature.EnsurePageCacheTemperature:55  PageCacheTemperature: any
[2668:2844:0615/020801:WARNING:webmediaplayer_impl.cc(335)] Using MultibufferDataSource
Traceback (most recent call last):
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\third_party\catapult\telemetry\telemetry\internal\story_runner.py", line 84, in _RunStoryAndProcessErrorIfNeeded
    state.RunStory(results)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\content\test\gpu\gpu_tests\gpu_test_base.py", line 122, in RunStory
    RunStoryWithRetries(DesktopGpuSharedPageState, self, results)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\content\test\gpu\gpu_tests\gpu_test_base.py", line 72, in RunStoryWithRetries
    super(cls, shared_page_state).RunStory(results)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\third_party\catapult\telemetry\telemetry\page\shared_page_state.py", line 306, in RunStory
    self._current_page.Run(self)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\third_party\catapult\telemetry\telemetry\page\__init__.py", line 95, in Run
    shared_state.page_test.RunNavigateSteps(self, current_tab)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\third_party\catapult\telemetry\telemetry\page\legacy_page_test.py", line 191, in RunNavigateSteps
    page.RunNavigateSteps(action_runner)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\content\test\gpu\gpu_tests\webgl_conformance.py", line 192, in RunNavigateSteps
    'webglTestHarness._finished', timeout_in_seconds=300)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\third_party\catapult\telemetry\telemetry\internal\actions\action_runner.py", line 186, in WaitForJavaScriptCondition
    self._tab.WaitForJavaScriptExpression(condition, timeout_in_seconds)
  File "c:\users\chrome~1\appdata\local\temp\isolated_runyhpqnr\third_party\catapult\telemetry\telemetry\internal\browser\web_contents.py", line 136, in WaitForJavaScriptExpression
    e.message + '\n' + debug_message)
TimeoutException: Timed out while waiting 300s for IsJavaScriptExpressionTrue.
Console output:

John can help help here?
Win7 Release NVIDIA hasn't flaked since Jun 15th. I don't know why Win7 Release ATI is still flaking - it seems to have been happening since June 10th.

Comment 5 by kbr@chromium.org, Jun 21 2016

https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20Release%20%28NVIDIA%29/builds/25526 failed because the WebGL 2.0 tests took more than 1 hour to run. Sharding these ( Issue 352807 ) will fix this.

The only recent flake I see in the WebGL 2.0 conformance tests on this bot was WebglConformance.deqp_functional_gles3_shadertexturefunction_textureoffset from https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20Release%20%28NVIDIA%29/builds/25654 . Maybe this has been fixed?

A bunch more of these timeouts today. The log you linked in #c5, it said the video test timed out. Is this expected when the harness itself breaks 1hr? Just wanted to check that there wasn't a regression in speed for these tests that were causing them to take 5min+.

eg recent failure today:
https://build.chromium.org/p/chromium.gpu.fyi/builders/Win7%20Release%20%28NVIDIA%29/builds/25673/steps/webgl2_conformance_tests%20on%20NVIDIA%20GPU%20on%20Windows%20on%20Windows-2008ServerR2-SP1/logs/stdio

Comment 7 by kbr@chromium.org, Jun 22 2016

Yes, the problem's that the overall run is taking 1 hour. It can be seen by going to the bottom of the log and looking for "Duration: 3600.0s". If that duration is hit the step is going to fail.

The sharding is being put in place in https://codereview.chromium.org/2077443002 . Hopefully it will land today.

Owner: kbr@chromium.org
Seems like this is fixed by sharding?

Comment 9 by kbr@chromium.org, Jun 24 2016

Mergedinto: 352807
Status: Duplicate (was: Assigned)
Hopefully. Let's duplicate this into the other bug and reopen if it's seen again.

Sign in to add a comment