New issue
Advanced search Search tips

Issue 834652 link

Starred by 1 user
Status: Assigned
Owner:
dschuff@chromium.org
Cc:
smcgruer@chromium.org
mseaborn@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug
Flaky-Test: NaClBrowserTestPnacl.ValidationCacheOfTranslatorNexes



Sign in to add a comment

NaClBrowserTestPnacl.ValidationCacheOfTranslatorNexes is Flaky

Project Member Reported by Findit, Apr 19 2018 
Findit has detected a flake at test NaClBrowserTestPnacl.ValidationCacheOfTranslatorNexes.

Culprit (70.0% confidence): https://chromium-review.googlesource.com/q/I6c49fa6ca36db16ecddfb520e0964bd231565a0b
Regression range: None

Analysis: https://findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVyrwELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCJ5Y2hyb21pdW0ud2luL1dpbjcgKDMyKSBUZXN0cy8zMjQ0Ny9icm93c2VyX3Rlc3RzL1RtRkRiRUp5YjNkelpYSlVaWE4wVUc1aFkyd3VWbUZzYVdSaGRHbHZia05oWTJobFQyWlVjbUZ1YzJ4aGRHOXlUbVY0WlhNPQwLEhNNYXN0ZXJGbGFrZUFuYWx5c2lzGAIM

If this result was incorrect, apply the label Findit-Incorrect-Result, mark the bug as Untriaged and the component Tools>Test>Findit>Flakiness.
Project Member

Comment 1 by Findit, Apr 19 2018 

Findit identified the culprit r550895 with confidence 70.0% in the config "chromium.win / Win7 (32) Tests"
based on the flakiness trend:

https://findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVyrwELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCJ5Y2hyb21pdW0ud2luL1dpbjcgKDMyKSBUZXN0cy8zMjQ0Ny9icm93c2VyX3Rlc3RzL1RtRkRiRUp5YjNkelpYSlVaWE4wVUc1aFkyd3VWbUZzYVdSaGRHbHZia05oWTJobFQyWlVjbUZ1YzJ4aGRHOXlUbVY0WlhNPQwLEhNNYXN0ZXJGbGFrZUFuYWx5c2lzGAIM


Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).
Flake Analyzer is in beta.
Feedback is welcome! Please use component Tools>Test>FindIt>Flakiness

Comment 2 by yoichio@chromium.org, Apr 23 2018

Labels: -Sheriff-Chromium
Owner: smcgruer@chromium.org

Comment 3 by smcgruer@chromium.org, Apr 23 2018

Cc: mseaborn@chromium.org smcgruer@chromium.org
Components: -Tests>Flaky Platform>NaCl
Owner: bradnelson@chromium.org
Status: Assigned (was: Available)
I very much doubt this could be my change; I fixed a few bugs in the Web Animations codebase and made some V8 bindings changes, but that is a world away from NaCL tests as far as I can tell.

Setting component to NaCL and assigning to chrome/test/nacl/OWNERS to see if we can get to the bottom of the flake.



This is an example log from a failed run of the test:

[ RUN      ] NaClBrowserTestPnacl.ValidationCacheOfTranslatorNexes
[5340:7044:0423/024903.686:ERROR:install_util.cc(589)] Unable to create registry key HKLM\SOFTWARE\Policies\Chromium for reading result=2
[5340:2660:0423/024903.747:WARNING:discovery_network_list_win.cc(195)] Failed to open Wlan client handle: 1062
[5340:7044:0423/024903.766:WARNING:chrome_browser_main_win.cc(630)] Command line too long for RegisterApplicationRestart:  --brave-new-test-launcher --cfi-diag=0 --gtest_also_run_disabled_tests --gtest_filter=NaClBrowserTestPnacl.ValidationCacheOfTranslatorNexes --single_process --test-launcher-bot-mode --test-launcher-output="C:\Users\CHROME~2\AppData\Local\Temp\scoped_dir4160_5327\results4160_21945\test_results.xml" --test-launcher-summary-output="e:\b\swarm_slave\w\iodcdxjh\output.json" --user-data-dir="C:\Users\CHROME~2\AppData\Local\Temp\scoped_dir4160_5327\d4160_1661" --disable-offline-auto-reload --enable-nacl --no-first-run --no-default-browser-check --enable-logging=stderr --disable-default-apps --wm-window-animations-disabled --disable-component-update --test-type=browser --force-color-profile=srgb --disable-zero-browsers-open-for-tests --ipc-connection-timeout=30 --allow-file-access-from-files --dom-automation --log-gpu-control-list-decisions --disable-backgrounding-occluded-windows --disable-gl-drawing-for-tests --override-use-software-gl-for-tests --force-color-profile=srgb --disable-compositor-ukm-for-tests --enable-features=TestFeatureForBrowserTest1 --disable-features=NetworkPrediction,TestFeatureForBrowserTest2 --flag-switches-begin --flag-switches-end --restore-last-session about:blank
[5340:4316:0423/024904.160:WARNING:embedded_test_server.cc(228)] Request not handled. Returning 404: /favicon.ico
[5340:7544:0423/024904.232:ERROR:nacl_process_host.cc(263)] NaCl process exited with status -1073741800 (0xc0000018)
[5340:7044:0423/024904.233:INFO:CONSOLE(0)] "NativeClient: PnaclCoordinator: Compiler process could not be created.", source: http://127.0.0.1:63310/pnacl_options.html?use_nmf=o_0&pnacl=1 (0)
[5340:7044:0423/024904.234:INFO:nacl_browsertest_util.cc(76)] LOG Load error: NaCl module load failed: PnaclCoordinator: Compiler process could not be created.
[5340:7044:0423/024904.234:INFO:nacl_browsertest_util.cc(76)] SHUTDOWN 1 test failed.
../../chrome/test/nacl/nacl_browsertest_util.cc(239): error: Value of: handler.test_passed()
  Actual: false
Expected: true
Test failed.
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	NaClBrowserTestBase::RunLoadTest [0x006813C5+489]
	fwprintf [0x006800A5+9598]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

../../base/test/histogram_tester.cc(50): error: Expected: (nullptr) != (histogram), actual: 4-byte object <00-00 00-00> vs NULL
Histogram "NaCl.ValidationCache.Query" does not exist.
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	base::HistogramTester::ExpectBucketCount [0x0216668F+225]
	fwprintf [0x006800E9+9666]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

../../base/test/histogram_tester.cc(50): error: Expected: (nullptr) != (histogram), actual: 4-byte object <00-00 00-00> vs NULL
Histogram "NaCl.ValidationCache.Query" does not exist.
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	base::HistogramTester::ExpectBucketCount [0x0216668F+225]
	fwprintf [0x00680124+9725]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

../../base/test/histogram_tester.cc(35): error: Expected: (nullptr) != (histogram), actual: 4-byte object <00-00 00-00> vs NULL
Histogram "NaCl.ValidationCache.Set" does not exist.
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	base::HistogramTester::ExpectUniqueSample [0x02166285+225]
	fwprintf [0x0068015B+9780]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

[5464,6444:09:49:04.660000] Native Client module will be loaded at base address 0x000000000ef80000
[5464,6444:09:49:04.847000] NaClPageAlloc: VirtualAlloc(*,0x10000) failed
[5464,6444:09:49:04.847000] NaClPageAlloc: VirtualAlloc(*,0x10000) failed
[6664,4436:09:49:05.896000] Native Client module will be loaded at base address 0x000000001e2a0000
[5852,2204:09:49:06.226000] Native Client module will be loaded at base address 0x00000000270d0000
[5852,2204:09:49:06.266000] NaClPageAlloc: VirtualAlloc(*,0x10000) failed
[5852,2204:09:49:06.266000] NaClPageAlloc: VirtualAlloc(*,0x10000) failed
[5340:7044:0423/024906.312:INFO:nacl_browsertest_util.cc(76)] SHUTDOWN 1 test passed.
../../base/test/histogram_tester.cc(186): error: Expected equality of these values:
  expected_count
    Which is: 10
  actual_count
    Which is: 5
Histogram "NaCl.ValidationCache.Query" does not have the right total number of samples (10). It has (5).
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	base::HistogramTester::CheckTotalCount [0x02166580+300]
	base::HistogramTester::ExpectTotalCount [0x02166739+75]
	fwprintf [0x006801C1+9882]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

../../base/test/histogram_tester.cc(171): error: Expected equality of these values:
  expected_count
    Which is: 6
  actual_count
    Which is: 2
Histogram "NaCl.ValidationCache.Query" does not have the right number of samples (6) in the expected bucket (1). It has (2).
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	base::HistogramTester::CheckBucketCount [0x02166426+308]
	base::HistogramTester::ExpectBucketCount [0x021666CD+287]
	fwprintf [0x006801FE+9943]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

../../base/test/histogram_tester.cc(171): error: Expected equality of these values:
  expected_count
    Which is: 4
  actual_count
    Which is: 3
Histogram "NaCl.ValidationCache.Set" does not have the right number of samples (4) in the expected bucket (1). It has (3).
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	base::HistogramTester::CheckBucketCount [0x02166426+308]
	base::HistogramTester::ExpectUniqueSample [0x021662C4+288]
	fwprintf [0x0068023A+10003]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

../../base/test/histogram_tester.cc(186): error: Expected equality of these values:
  expected_count
    Which is: 4
  actual_count
    Which is: 3
Histogram "NaCl.ValidationCache.Set" does not have the right total number of samples (4). It has (3).
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00BB5E38+40]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00BBE853+69]
	testing::internal::AssertHelper::operator= [0x00BBE4B8+48]
	base::HistogramTester::CheckTotalCount [0x02166580+300]
	base::HistogramTester::ExpectUniqueSample [0x021662D0+300]
	fwprintf [0x0068023A+10003]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x021DD365+357]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x02766A9A+3196]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x02765D61+145]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x0133B584+68]
	content::StartupTaskRunner::RunAllTasksNow [0x015B1239+23]
	content::BrowserMainLoop::CreateStartupTasks [0x0133A649+615]
	content::BrowserMainRunnerImpl::Initialize [0x0133D554+100]
	content::BrowserMain [0x01338BBA+138]
	content::RunNamedProcessTypeMain [0x02063663+123]
	content::ContentMainRunnerImpl::Run [0x02063AAE+142]
	service_manager::Main [0x0312F316+622]
	content::ContentMain [0x0206358F+51]
	content::BrowserTestBase::SetUp [0x021DD13A+1498]

[5340:7044:0423/024906.475:WARNING:pref_notifier_impl.cc(23)] Pref observer found at shutdown.
[5340:7044:0423/024906.475:WARNING:pref_notifier_impl.cc(23)] Pref observer found at shutdown.
[  FAILED  ] NaClBrowserTestPnacl.ValidationCacheOfTranslatorNexes, where TypeParam =  and GetParam() =  (2806 ms)
Project Member

Comment 4 by Findit, May 18 2018 

Findit identified the culprit r559362 with confidence 70.0% in the config "chromium.win / Win7 (32) Tests"
based on the flakiness trend:

https://findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVyrwELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCJ5Y2hyb21pdW0ud2luL1dpbjcgKDMyKSBUZXN0cy8zMzUwNy9icm93c2VyX3Rlc3RzL1RtRkRiRUp5YjNkelpYSlVaWE4wVUc1aFkyd3VWbUZzYVdSaGRHbHZia05oWTJobFQyWlVjbUZ1YzJ4aGRHOXlUbVY0WlhNPQwLEhNNYXN0ZXJGbGFrZUFuYWx5c2lzGAEM


Automatically posted by the findit-for-me app (https://goo.gl/Ot9f7N).
Feedback is welcome! Please use component Tools>Test>FindIt>Flakiness

Comment 5 by bradnelson@chromium.org, May 23 2018

Owner: dschuff@chromium.org
►

Sign in to add a comment