PageLoadMetricsBrowserTest.CSSTiming is flaky
Reported by
atuc...@yandex-team.ru,
Mar 2 2017
|
|||
Issue description
Chrome Version : 55.0.2883.95
OS Version: Linux (Ubuntu 16.04 LTS x64)
What steps will reproduce the problem?
1. Compile chromium and browser_tests from sources (release build);
2. Run out/Release.gn/browser_tests --gtest_filter=PageLoadMetricsBrowserTest* --test-launcher-jobs=32 --test-launcher-retry-limit=0 --gtest_repeat=50
>What is the expected result?
All tests passed.
>What happens instead of that?
Some of tests are failed:
3 tests failed:
PageLoadMetricsBrowserTest.CSSTiming (../../chrome/browser/page_load_metrics/page_load_metrics_browsertest.cc:720)
PageLoadMetricsBrowserTest.DocumentWriteReload (../../chrome/browser/page_load_metrics/page_load_metrics_browsertest.cc:394)
PageLoadMetricsBrowserTest.NoAbortMetricsOnClientRedirect (../../chrome/browser/page_load_metrics/page_load_metrics_browsertest.cc:603)
Please provide any additional information below. Attach a screenshot if possible.
I think that some of them can be fixed similar to https://codereview.chromium.org/2698813005/.
Here is a falure log:
[ RUN ] PageLoadMetricsBrowserTest.CSSTiming
[30802:30802:0302/130734.533581:WARNING:password_store_factory.cc(247)] Using basic (unencrypted) store for password storage. See https://chromium.googlesource.com/chromium/src/+/master/docs/linux_password_storage.md for more information about password storage options.
../../base/test/histogram_tester.cc:72: Failure
Value of: 0
Expected: count
Which is: 1
Histogram "PageLoad.PaintTiming.NavigationToFirstContentfulPaint" does not exist.
../../base/test/histogram_tester.cc:72: Failure
Value of: 0
Expected: count
Which is: 1
Histogram "PageLoad.CSSTiming.Parse.BeforeFirstContentfulPaint" does not exist.
../../base/test/histogram_tester.cc:72: Failure
Value of: 0
Expected: count
Which is: 1
Histogram "PageLoad.CSSTiming.Update.BeforeFirstContentfulPaint" does not exist.
../../base/test/histogram_tester.cc:72: Failure
Value of: 0
Expected: count
Which is: 1
Histogram "PageLoad.CSSTiming.ParseAndUpdate.BeforeFirstContentfulPaint" does not exist.
[ FAILED ] PageLoadMetricsBrowserTest.CSSTiming, where TypeParam = and GetParam() = (3956 ms)
[ RUN ] PageLoadMetricsBrowserTest.DocumentWriteReload
.....
.....
../../base/test/histogram_tester.cc:170: Failure
Value of: actual_count
Actual: 1
Expected: expected_count
Which is: 2
Histogram "PageLoad.Clients.DocWrite.Block.ReloadCount" does not have the right total number of samples (2). It has (1).
[ FAILED ] PageLoadMetricsBrowserTest.DocumentWriteReload, where TypeParam = and GetParam() = (3608 ms)
[ RUN ] PageLoadMetricsBrowserTest.NoAbortMetricsOnClientRedirect
[2858:2858:0302/131339.717956:WARNING:password_store_factory.cc(247)] Using basic (unencrypted) store for password storage. See https://chromium.googlesource.com/chromium/src/+/master/docs/linux_password_storage.md for more information about password storage options.
[2858:5596:0302/131341.228540:WARNING:embedded_test_server.cc(219)] Request not handled. Returning 404: /favicon.ico
BrowserTestBase received signal: Segmentation fault. Backtrace:
#0 0x0000027caa37 base::debug::StackTrace::StackTrace()
#1 0x000002d2cf36 content::(anonymous namespace)::DumpStackTraceSignalHandler()
#2 0x7f1b8218d2f0 <unknown>
#3 0x000002d32e11 content::TestNavigationManager::OnWillProcessResponse()
#4 0x00000284ea76 base::debug::TaskAnnotator::RunTask()
#5 0x0000027e21ed base::MessageLoop::RunTask()
#6 0x0000027e2938 base::MessageLoop::DoWork()
#7 0x0000027e3d09 base::MessagePumpGlib::Run()
#8 0x0000027e1f07 base::MessageLoop::RunHandler()
#9 0x0000028015be base::RunLoop::Run()
#10 0x000002d580d1 content::MessageLoopRunner::Run()
#11 0x000002d32b58 content::TestNavigationManager::WaitForDesiredState()
#12 0x000000c922aa PageLoadMetricsBrowserTest_NoAbortMetricsOnClientRedirect_Test::RunTestOnMainThread()
#13 0x00000286fbcf InProcessBrowserTest::RunTestOnMainThreadLoop()
#14 0x000002d2cc98 content::BrowserTestBase::ProxyRunTestOnMainThreadLoop()
#15 0x000002ba699b ChromeBrowserMainParts::PreMainMessageLoopRunImpl()
#16 0x000002ba5ba1 ChromeBrowserMainParts::PreMainMessageLoopRun()
#17 0x0000018d9d25 content::BrowserMainLoop::PreMainMessageLoopRun()
#18 0x000001ba8b16 content::StartupTaskRunner::RunAllTasksNow()
#19 0x0000018d7edb content::BrowserMainLoop::CreateStartupTasks()
#20 0x0000018dd53c content::BrowserMainRunnerImpl::Initialize()
#21 0x0000018d5608 content::BrowserMain()
#22 0x0000027b582c content::ContentMainRunnerImpl::Run()
#23 0x0000027b43d0 content::ContentMain()
#24 0x000002d2c5c9 content::BrowserTestBase::SetUp()
#25 0x00000286e2d0 InProcessBrowserTest::SetUp()
#26 0x00000330745e testing::Test::Run()
#27 0x000003308020 testing::TestInfo::Run()
#28 0x000003308397 testing::TestCase::Run()
#29 0x00000330f5e7 testing::internal::UnitTestImpl::RunAllTests()
#30 0x00000330f267 testing::UnitTest::Run()
#31 0x00000287ed81 base::TestSuite::Run()
#32 0x0000027bf098 ChromeTestSuiteRunner::RunTestSuite()
#33 0x000002d546aa content::LaunchTests()
#34 0x0000027bf017 main
#35 0x7f1b82178a40 __libc_start_main
#36 0x0000005e3611 <unknown>
[28/30] PageLoadMetricsBrowserTest.NoAbortMetricsOnClientRedirect (4195 ms)
,
Mar 2 2017
,
Mar 3 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/dcdc81fcde2b5b40f42023a5bdb46e6c7c6b08ec commit dcdc81fcde2b5b40f42023a5bdb46e6c7c6b08ec Author: mattcary <mattcary@chromium.org> Date: Fri Mar 03 09:52:55 2017 Page load metrics: improve flaky CSSTiming Make CSSTiming less flaky by waiting for the style updated event. BUG= 697761 Review-Url: https://codereview.chromium.org/2729893002 Cr-Commit-Position: refs/heads/master@{#454553} [modify] https://crrev.com/dcdc81fcde2b5b40f42023a5bdb46e6c7c6b08ec/chrome/browser/page_load_metrics/page_load_metrics_browsertest.cc
,
Mar 3 2017
This should improve matters. There is still occasional flakes, but this is as much time as I have to put into it. |
|||
►
Sign in to add a comment |
|||
Comment 1 by mattcary@chromium.org
, Mar 2 2017