New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 793480 link

Starred by 2 users

Issue metadata

Status: Fixed
Owner:
Last visit > 30 days ago
Closed: Dec 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux , Windows
Pri: 1
Type: Bug

Blocked on:
issue 793484

Blocking:
issue 764576
issue 718047
issue 789964



Sign in to add a comment

RunnerTest.Run failure in gin_unittests: Check failed: (isolate->snapshot_blob()) == nullptr.

Project Member Reported by kbr@chromium.org, Dec 8 2017

Issue description

Failure seen here:
https://ci.chromium.org/buildbot/tryserver.chromium.win/win7_chromium_rel_ng/62404

The CL being tried is unrelated.

This test is failing all over this trybot:

https://ci.chromium.org/buildbot/tryserver.chromium.win/win7_chromium_rel_ng/?limit=200

The only CLs that are making it through the CQ are those that retry without patch.

[ RUN      ] RunnerTest.Run

#
# Fatal error in ../../v8/src/api.cc, line 8662
# Check failed: (isolate->snapshot_blob()) == nullptr.
#

Backtrace:
	base::debug::StackTrace::StackTrace [0x009D68E0+32]
	base::debug::StackTrace::StackTrace [0x009F571D+13]
	gin::V8Platform::GetStackTracePrinter [0x009ADD0F+47]
	V8_Fatal [0x00AF034D+109]
	v8::IsolateNewImpl [0x001F3E57+679]
	v8::Isolate::New [0x001F3BA7+39]
	gin::IsolateHolder::IsolateHolder [0x009AD1F3+233]
	gin::IsolateHolder::IsolateHolder [0x009AD0EC+58]
	gin::IsolateHolder::IsolateHolder [0x009AD094+44]
	gin::RunnerTest_Run_Test::TestBody [0x001CC115+117]
	testing::Test::Run [0x0098F624+176]
	testing::TestInfo::Run [0x0098FB0F+201]
	testing::TestCase::Run [0x0098FE9D+235]
	testing::internal::UnitTestImpl::RunAllTests [0x00993A31+625]
	testing::UnitTest::Run [0x009936E9+151]
	base::TestSuite::Run [0x00997BE4+100]
	base::LaunchUnitTests [0x00999083+439]
	base::LaunchUnitTests [0x00998F5A+142]
	main [0x001CC42C+116]
	__scrt_common_main_seh [0x00B31C2A+248] (f:\dd\vctools\crt\vcstartup\src\startup\exe_common.inl:283)
	BaseThreadInitThunk [0x74E0336A+18]
	RtlInitializeExceptionChain [0x770D9902+99]
	RtlInitializeExceptionChain [0x770D98D5+54]

I'm guessing the bug is in the V8 runtime.

Not sure when this started.

 

Comment 1 by kbr@chromium.org, Dec 8 2017

Looking back in the history, the first tryjob that failed this suite was:
https://ci.chromium.org/buildbot/tryserver.chromium.win/win7_chromium_rel_ng/62288

It started failing a couple of hours ago. It seems to only be failing on the trybot.

We should be running the release waterfall bots with dcheck_always_on=true. This is a major difference in behavior between the trybots and waterfall bots.

Comment 2 by kbr@chromium.org, Dec 8 2017

Components: Infra>Client>Chrome

Comment 3 by kbr@chromium.org, Dec 8 2017

Blocking: 793484

Comment 4 by kbr@chromium.org, Dec 8 2017

The reason this wasn't caught on the waterfall is that the Release bots aren't running with dcheck_always_on=true. This is a major gap in behavior and I've filed Issue 793484
about resolving it.

Comment 5 by kbr@chromium.org, Dec 8 2017

Cc: st...@chromium.org

Comment 7 by kbr@chromium.org, Dec 8 2017

Labels: OS-Linux

Comment 8 by kbr@chromium.org, Dec 8 2017

Owner: jkummerow@chromium.org
Status: Assigned (was: Untriaged)
jkummerow@ graciously offered to help do a git bisect of this on his local builds with dcheck_always_on=true because the sheriffs aren't responding. Thanks Jakob.

Comment 9 by kbr@chromium.org, Dec 8 2017

I was wrong; it is happening on the Debug bots. Here's the first failing build on Linux:
https://ci.chromium.org/buildbot/chromium.linux/Linux%20Tests%20%28dbg%29%281%29/68813

Comment 10 by kbr@chromium.org, Dec 8 2017

Blocking: 718047
Cc: yzshen@chromium.org
It's almost surely:

Remove AMD-style module support from gin/.
https://chromium-review.googlesource.com/812172


Owner: yzshen@chromium.org
Sounds likely.
I am reverting that CL now.
Project Member

Comment 12 by bugdroid1@chromium.org, Dec 8 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a8f25f1e37e561d17222773d869ca460e00d8fe1

commit a8f25f1e37e561d17222773d869ca460e00d8fe1
Author: Yuzhu Shen <yzshen@chromium.org>
Date: Fri Dec 08 23:37:45 2017

Revert "Remove AMD-style module support from gin/."

This reverts commit c1ab49a9e23036de2f94da601782da9985a9a481.

Reason for revert: Likely the cause of
RunnerTest.Run failure in gin_unittests: Check failed: (isolate->snapshot_blob()) == nullptr.

Original change's description:
> Remove AMD-style module support from gin/.
> 
> Bug:  718047 
> Change-Id: If480fff65a2e5993ed5143eede8354f890de3a3b
> Reviewed-on: https://chromium-review.googlesource.com/812172
> Commit-Queue: Yuzhu Shen <yzshen@chromium.org>
> Reviewed-by: Jochen Eisinger <jochen@chromium.org>
> Cr-Commit-Position: refs/heads/master@{#522850}

TBR=yzshen@chromium.org,jochen@chromium.org

Change-Id: I4a6efb21dd7972994a06ddab1316fa43e5d3e060
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug:  718047 ,  793480 
Reviewed-on: https://chromium-review.googlesource.com/817373
Reviewed-by: Yuzhu Shen <yzshen@chromium.org>
Commit-Queue: Yuzhu Shen <yzshen@chromium.org>
Cr-Commit-Position: refs/heads/master@{#522921}
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/content/shell/renderer/layout_test/layout_test_content_renderer_client.cc
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/BUILD.gn
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/console.cc
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/console.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/file_module_provider.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/file_module_provider.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/module_registry.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/module_registry.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/module_registry_observer.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/module_registry_unittest.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/module_registry_unittests.js
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/module_runner_delegate.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/module_runner_delegate.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/timer.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/timer.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/modules/timer_unittest.cc
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/runner.h
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/shell/gin_main.cc
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/shell/hello_world.js
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/shell_runner.cc
[modify] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/shell_runner.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/expect.js
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/file.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/file.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/file_runner.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/file_runner.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/file_unittests.js
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/gc.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/gc.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/gtest.cc
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/gtest.h
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/gtest_unittests.js
[add] https://crrev.com/a8f25f1e37e561d17222773d869ca460e00d8fe1/gin/test/run_js_tests.cc

When that CL landed, it failed gin_unittests: 
https://ci.chromium.org/buildbot/tryserver.chromium.linux/linux_chromium_rel_ng/605383
But retrying without patch failed too, so the failure was ignored and the CL landed.

Possibly that means that the test was failing before; or maybe the with-patch run left state around that broke the without-patch run.
Is this test not run in debug on the waterfalls, or is the failure not occurring in a full debug configuration? 

Comment 15 by kbr@chromium.org, Dec 8 2017

See #9. I was wrong; it is failing on the waterfalls on the Debug bots.

#14: See #9. Debug bots on the waterfall are failing (they're just slow). For Release bots, there is the discrepancy between CQ (failing with dcheck_always_on) and waterfall (passing without dchecks). I'm repro'ing locally with full Debug.
Project Member

Comment 17 by bugdroid1@chromium.org, Dec 9 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e1fb0a45400650b7a691cedf2c17108ea33b9a04

commit e1fb0a45400650b7a691cedf2c17108ea33b9a04
Author: Yuzhu Shen <yzshen@chromium.org>
Date: Sat Dec 09 00:39:12 2017

Disable a failing test temporarily during investigation.

BUG= 793480 
TBR=jochen@chromium.org

Change-Id: I2300d376d3c6d0c04e82ec74b3103a12fed04ecf
Reviewed-on: https://chromium-review.googlesource.com/817951
Reviewed-by: Yuzhu Shen <yzshen@chromium.org>
Commit-Queue: Yuzhu Shen <yzshen@chromium.org>
Cr-Commit-Position: refs/heads/master@{#522936}
[modify] https://crrev.com/e1fb0a45400650b7a691cedf2c17108ea33b9a04/gin/shell_runner_unittest.cc

Comment 18 by kbr@chromium.org, Dec 9 2017

Blocking: -793484

Comment 19 by kbr@chromium.org, Dec 9 2017

Blockedon: 793484

Comment 20 by kbr@chromium.org, Dec 9 2017

Blocking: 764576

Comment 21 by kbr@chromium.org, Dec 9 2017

Blocking: 789964

Comment 22 by kbr@chromium.org, Dec 9 2017

Cc: peria@chromium.org
yzshen@ found the commit that caused the underlying problem about 24h ago. Linking to the related bugs.

Yes, my CL can trigger the fail. Please revert it if the issue cannot be fixed easily.
I'm ooo by this Tuesday.
Labels: -Sheriff-Chromium
Project Member

Comment 25 by bugdroid1@chromium.org, Dec 11 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a9b25af57b4dcb66c2642dbe87e6eef54a6fc430

commit a9b25af57b4dcb66c2642dbe87e6eef54a6fc430
Author: Yuzhu Shen <yzshen@chromium.org>
Date: Mon Dec 11 22:30:26 2017

Fix missing config for gin_unittests.

Bug:  793480 
Change-Id: I02c9ae70759be31af025e5787a5683cd76bffc57
Reviewed-on: https://chromium-review.googlesource.com/818452
Reviewed-by: Jakob Kummerow <jkummerow@chromium.org>
Reviewed-by: Jochen Eisinger <jochen@chromium.org>
Commit-Queue: Yuzhu Shen <yzshen@chromium.org>
Cr-Commit-Position: refs/heads/master@{#523235}
[modify] https://crrev.com/a9b25af57b4dcb66c2642dbe87e6eef54a6fc430/gin/BUILD.gn
[modify] https://crrev.com/a9b25af57b4dcb66c2642dbe87e6eef54a6fc430/gin/shell_runner_unittest.cc

Status: Fixed (was: Assigned)

Sign in to add a comment