sync_integration_tests failing on chromium.win/Win10 Tests x64 (dbg) |
|||||||||
Issue descriptionFiled by sheriff-o-matic@appspot.gserviceaccount.com on behalf of shimazu@chromium.org sync_integration_tests failing on chromium.win/Win10 Tests x64 (dbg) Builders failed on: - Win10 Tests x64 (dbg): https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Win10%20Tests%20x64%20%28dbg%29 == description == Bunch of tests in sync_integration_tests frequently fail. In the bad builds, stdout contains some message about Sync HTTP server as follows. You can see the full stdout from here: https://logs.chromium.org/logs/chromium/buildbucket/cr-buildbucket.appspot.com/8938403586906328208/+/steps/sync_integration_tests_on_Windows-10-15063/0/stdout -- part of stdout -- Sync HTTP server started at 127.0.0.1:58836/chromiumsync... Fake OAuth2 Token server started at 127.0.0.1:58836/o/oauth2/token... Sync XMPP server started at 127.0.0.1:58838... sending server_data: {"xmpp_port": 58838, "host": "127.0.0.1", "port": 58836} (56 bytes) [6032:6836:0812/035931.286:WARNING:discovery_network_list_win.cc(195)] Failed to open Wlan client handle: 1062 [6032:6812:0812/035931.398:WARNING:chrome_browser_main_win.cc(641)] Command line too long for RegisterApplicationRestart: --brave-new-test-launcher --cfi-diag=0 --disable-gpu-process-for-dx12-vulkan-info-collection --gtest_also_run_disabled_tests --gtest_filter=MigrationSingleClientTest.PrefsOnlyModifyPref --single_process --test-launcher-bot-mode --test-launcher-output="C:\b\s\w\it2u2ref\scoped_dir7120_2035\results7120_4689\test_results.xml" --test-launcher-summary-output="C:\b\s\w\io5limwz\output.json" --user-data-dir="C:\b\s\w\it2u2ref\scoped_dir7120_2035\d7120_30513" --sync-url=http://127.0.0.1:58836/chromiumsync --sync-notification-host-port=127.0.0.1:58838 --sync-allow-insecure-xmpp-connection --disable-offline-auto-reload --disable-background-networking --sync-short-initial-retry-override --sync-short-nudge-delay-for-test --no-first-run --no-default-browser-check --enable-logging=stderr --disable-default-apps --wm-window-animations-disabled --disable-component-update --test-type=browser --force-color-profile=srgb --disable-zero-browsers-open-for-tests --ipc-connection-timeout=45 --allow-file-access-from-files --dom-automation --log-gpu-control-list-decisions --disable-backgrounding-occluded-windows --disable-gl-drawing-for-tests --override-use-software-gl-for-tests --force-color-profile=srgb --disable-compositor-ukm-for-tests --enable-features=TestFeatureForBrowserTest1 --disable-features=NetworkPrediction,SpeculativePreconnect,TestFeatureForBrowserTest2 --disable-gpu-process-for-dx12-vulkan-info-collection --flag-switches-begin --flag-switches-end --restore-last-session about:blank [6032:1956:0812/035931.958:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe [6032:1956:0812/035931.973:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe [6032:6812:0812/035932.067:WARNING:gaia_auth_fetcher.cc(926)] Could not reach Google Accounts servers: errno -11 Starting connection to 127.0.0.1:58845 Handshake done for user@gmail.com/127.0.0.1:58845.chrome-sync [6740:3116:0812/035932.973:ERROR:webthread_impl_for_utility_thread.cc(19)] NOT IMPLEMENTED [6032:1956:0812/035933.161:WARNING:http_cache_transaction.cc(1273)] Unable to create cache entry [Client A -> chromiumsync.py] GetUpdates NEW_CLIENT <experiments+nigori>@0 Creating permanent item: Experiments Creating permanent item: Nigori Returning encryption keys: ['8NVR47B1KOYJ3ZDN'] [Client A <- chromiumsync.py] 2 update(s) [6032:5752:0812/035933.208:WARNING:sync_encryption_handler_impl.cc(970)] Nigori had empty encryption keybag. [6032:5752:0812/035933.234:WARNING:sync_encryption_handler_impl.cc(970)] Nigori had empty encryption keybag. [6032:6812:0812/035933.236:ERROR:account_tracker.cc(265)] OnOAuthError [6032:6812:0812/035933.237:WARNING:account_tracker.cc(192)] Failed to get UserInfo for gaia_id_for_user@gmail.com [6032:6812:0812/035933.239:ERROR:account_info_fetcher.cc(74)] OnOAuthError [6032:6812:0812/035933.239:WARNING:account_fetcher_service.cc(322)] Failed to get UserInfo for gaia_id_for_user@gmail.com [6032:6812:0812/035933.255:INFO:profile_sync_service.cc(2070)] ConfigureDataTypeManager not invoked because datatypes cannot be configured now [6032:6812:0812/035933.256:INFO:profile_sync_service.cc(2070)] ConfigureDataTypeManager not invoked because datatypes cannot be configured now [6032:5752:0812/035933.287:WARNING:sync_encryption_handler_impl.cc(346)] Ignoring new implicit passphrase. Keystore migration already performed. [Client A -> chromiumsync.py] GetUpdates NEW_CLIENT <device_info+priority_preference>@0, <nigori>@2 Creating permanent item: Device Info Creating permanent item: Priority Preferences [Client A <- chromiumsync.py] 2 update(s) Sending notification to user@gmail.com/127.0.0.1:58845.chrome-sync [Client A -> chromiumsync.py] GetUpdates NEW_CLIENT <app+app_setting+autofill+autofill_profile+autofill_wallet+bookmark+dictionary+extension+extension_setting+favicon_image+favicon_tracking+history_delete_directive+password+preference+search_engine+session+theme+typed_url+wallet_metadata>@0, <nigori>@4 Creating permanent item: Apps Creating permanent item: App Settings Creating permanent item: Bookmarks Creating permanent item: Bookmark Bar Creating permanent item: Other Bookmarks Creating permanent item: Autofill Creating permanent item: Autofill Profiles Creating permanent item: Autofill Wallet Items Creating permanent item: Autofill Wallet Metadata Creating permanent item: Extension Settings Creating permanent item: Extensions Creating permanent item: History Delete Directives Creating permanent item: Favicon Images Creating permanent item: Favicon Tracking Creating permanent item: Passwords Creating permanent item: Preferences Creating permanent item: Search Engines Creating permanent item: Sessions Creating permanent item: Themes Creating permanent item: Typed URLs Creating permanent item: Dictionary [Client A <- chromiumsync.py] 21 update(s) Sending notification to user@gmail.com/127.0.0.1:58845.chrome-sync [Client A -> chromiumsync.py] GetUpdates GU_TRIGGER <experiments>@2, <device_info+priority_preference>@4, <app+app_setting+autofill+autofill_profile+autofill_wallet+bookmark+dictionary+extension+extension_setting+favicon_image+favicon_tracking+history_delete_directive+nigori+password+preference+search_engine+session+theme+typed_url+wallet_metadata>@25 [Client A <- chromiumsync.py] 0 update(s) [Client A -> chromiumsync.py] Commit 22 item(s) Sending notification to user@gmail.com/127.0.0.1:58845.chrome-sync [Client A -> chromiumsync.py] GetUpdates GU_TRIGGER <all except app_list+app_notification+arc_package+article+managed_user+managed_user_setting+managed_user_shared_setting+managed_user_whitelist+printer+reading_list+synced_notification+synced_notification_app_info+wifi_credential>@25 Returning encryption keys: ['8NVR47B1KOYJ3ZDN'] [Client A <- chromiumsync.py] 22 update(s) [6032:1956:0812/035933.723:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe [6032:1956:0812/035933.755:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe [6032:1956:0812/035933.755:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe [Client A -> chromiumsync.py] GetUpdates GU_TRIGGER <all except app_list+app_notification+arc_package+article+managed_user+managed_user_setting+managed_user_shared_setting+managed_user_whitelist+printer+reading_list+synced_notification+synced_notification_app_info+wifi_credential>@47 [Client A <- chromiumsync.py] 0 update(s) [6032:1956:0812/035933.942:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe ../../chrome/browser/sync/test/integration/sync_test.cc(1110): error: Expected equality of these values: "Notifications disabled" base::UTF16ToASCII( browser()->tab_strip_model()->GetActiveWebContents()-> GetTitle()) Which is: "" Stack trace: Backtrace: StackTraceGetter::CurrentStackTrace [0x00007FF794A2BBB0+80] testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00007FF794A4698A+90] testing::internal::AssertHelper::operator= [0x00007FF794A4648A+90] SyncTest::DisableNotificationsImpl [0x00007FF7975C561D+781] SyncTest::DisableNotifications [0x00007FF7975C56E3+19] base::circular_deque<syncer::EnumSet<enum syncer::ModelType,2,41> >::~circular_deque<syncer::EnumSet<enum syncer::ModelType,2,41> > [0x00007FF79485FDAE+206] std::_Vector_alloc<std::_Vec_base_types<std::unique_ptr<MigrationWatcher,std::default_delete<MigrationWatcher> >,std::allocator<std::unique_ptr<MigrationWatcher,std::default_delete<MigrationWatcher> > > > >::_Free_proxy [0x00007FF79485FC58+552] wmemcpy [0x00007FF79485F023+6947] content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x00007FF79824A2AB+811] ??$Invoke@P8BrowserTestBase@content@@EAAXXZPEAV12@$$V@?$FunctorTraits@P8BrowserTestBase@content@@EAAXXZX@internal@base@@SAXP8BrowserTestBase@content@@EAAXXZ$$QEAPEAV34@@Z [0x00007FF79824C8AA+26] base::internal::InvokeHelper<0,void>::MakeItSo<void (__cdecl content::BrowserTestBase::*const & __ptr64)(void) __ptr64,content::BrowserTestBase * __ptr64> [0x00007FF79824C824+52] base::internal::Invoker<base::internal::BindState<void (__cdecl content::BrowserTestBase::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserTestBase> >,void __cdecl(void)>::RunImpl<void (__cdecl content::BrowserTestBase::*const & __ptr64) [0x00007FF79824C7D8+88] base::internal::Invoker<base::internal::BindState<void (__cdecl content::BrowserTestBase::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserTestBase> >,void __cdecl(void)>::Run [0x00007FF79824C6EC+60] base::RepeatingCallback<void __cdecl(void)>::Run [0x00007FF794B96562+66] ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x00007FF798545CE4+6820] ChromeBrowserMainParts::PreMainMessageLoopRun [0x00007FF7985441A1+465] content::BrowserMainLoop::PreMainMessageLoopRun [0x00007FFE902D4423+355] ??$Invoke@P8BrowserMainLoop@content@@EAAHXZPEAV12@$$V@?$FunctorTraits@P8BrowserMainLoop@content@@EAAHXZX@internal@base@@SAHP8BrowserMainLoop@content@@EAAHXZ$$QEAPEAV34@@Z [0x00007FFE902DE3CA+26] base::internal::InvokeHelper<0,int>::MakeItSo<int (__cdecl content::BrowserMainLoop::*const & __ptr64)(void) __ptr64,content::BrowserMainLoop * __ptr64> [0x00007FFE902DE344+52] base::internal::Invoker<base::internal::BindState<int (__cdecl content::BrowserMainLoop::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserMainLoop> >,int __cdecl(void)>::RunImpl<int (__cdecl content::BrowserMainLoop::*const & __ptr64)(vo [0x00007FFE902DE2E8+88] base::internal::Invoker<base::internal::BindState<int (__cdecl content::BrowserMainLoop::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserMainLoop> >,int __cdecl(void)>::Run [0x00007FFE902DE1BC+60] base::RepeatingCallback<int __cdecl(void)>::Run [0x00007FFE90D30142+66] content::StartupTaskRunner::RunAllTasksNow [0x00007FFE9170CBB1+161] content::BrowserMainLoop::CreateStartupTasks [0x00007FFE902D2351+1441] content::BrowserMainRunnerImpl::Initialize [0x00007FFE902E4558+1864] content::BrowserMain [0x00007FFE902CB9F2+194] content::RunBrowserProcessMain [0x00007FFE92FCDE08+168] content::ContentMainRunnerImpl::Run [0x00007FFE92FCF127+935] content::ContentServiceManagerMainDelegate::RunEmbedderProcess [0x00007FFE92FCB4C7+55] service_manager::Main [0x00007FFE9BEF5102+1762] content::ContentMain [0x00007FFE92FCDCCF+95] content::BrowserTestBase::SetUp [0x00007FF798249C3B+2875] InProcessBrowserTest::SetUp [0x00007FF7975E0F8E+1998] SyncTest::SetUp [0x00007FF7975BC336+710]
,
Aug 13
Let me bump this up to P1 since it's making the bot red occasionally.
,
Aug 15
,
Aug 16
melandory@, could you triage please?
,
Aug 17
Friendly ping -- these tests are still failing.
,
Aug 21
,
Sep 9
The failing reason is being investigated in bug mentioned in previous comment
,
Sep 17
triage ping: melandory@, any updates?
,
Sep 26
triage ping: melandory@, any updates?
,
Oct 15
,
Oct 24
FYI: Note the blocking bug 876224 - tl;dr *lots* of tests are flaky/broken on this particular bot, so it's most likely not anything specific to the sync tests. IIUC, this bot was spun up somewhat recently, and those test suites simply never worked there.
,
Nov 12
Triage ping for melandory@, thanks!
,
Nov 19
Triage ping for melandory@, thanks! I am puzzled, is this blocking or blocked on bug 876224?
,
Dec 10
,
Dec 10
Tanja, are you still working on this or do you want to drop this bug (incl. FixitSync label)?
,
Dec 30
[6032:1956:0812/035933.942:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
,
Dec 30
,
Yesterday
(45 hours ago)
|
|||||||||
►
Sign in to add a comment |
|||||||||
Comment 1 by shimazu@chromium.org
, Aug 13Components: Tests>Flaky
Owner: vitaliii@chromium.org
Status: Assigned (was: Available)