New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 873573 link

Starred by 2 users

Issue metadata

Status: Available
Owner: ----
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows
Pri: 2
Type: ----

Blocking:
issue 876224



Sign in to add a comment

sync_integration_tests failing on chromium.win/Win10 Tests x64 (dbg)

Project Member Reported by sheriff-...@appspot.gserviceaccount.com, Aug 13

Issue description

Filed by sheriff-o-matic@appspot.gserviceaccount.com on behalf of shimazu@chromium.org

sync_integration_tests failing on chromium.win/Win10 Tests x64 (dbg)

Builders failed on: 
- Win10 Tests x64 (dbg): 
  https://ci.chromium.org/p/chromium/builders/luci.chromium.ci/Win10%20Tests%20x64%20%28dbg%29

== description ==
Bunch of tests in sync_integration_tests frequently fail. In the bad builds, stdout contains some message about Sync HTTP server as follows.
You can see the full stdout from here:
https://logs.chromium.org/logs/chromium/buildbucket/cr-buildbucket.appspot.com/8938403586906328208/+/steps/sync_integration_tests_on_Windows-10-15063/0/stdout

-- part of stdout --
Sync HTTP server started at 127.0.0.1:58836/chromiumsync...
Fake OAuth2 Token server started at 127.0.0.1:58836/o/oauth2/token...
Sync XMPP server started at 127.0.0.1:58838...
sending server_data: {"xmpp_port": 58838, "host": "127.0.0.1", "port": 58836} (56 bytes)
[6032:6836:0812/035931.286:WARNING:discovery_network_list_win.cc(195)] Failed to open Wlan client handle: 1062
[6032:6812:0812/035931.398:WARNING:chrome_browser_main_win.cc(641)] Command line too long for RegisterApplicationRestart:  --brave-new-test-launcher --cfi-diag=0 --disable-gpu-process-for-dx12-vulkan-info-collection --gtest_also_run_disabled_tests --gtest_filter=MigrationSingleClientTest.PrefsOnlyModifyPref --single_process --test-launcher-bot-mode --test-launcher-output="C:\b\s\w\it2u2ref\scoped_dir7120_2035\results7120_4689\test_results.xml" --test-launcher-summary-output="C:\b\s\w\io5limwz\output.json" --user-data-dir="C:\b\s\w\it2u2ref\scoped_dir7120_2035\d7120_30513" --sync-url=http://127.0.0.1:58836/chromiumsync --sync-notification-host-port=127.0.0.1:58838 --sync-allow-insecure-xmpp-connection --disable-offline-auto-reload --disable-background-networking --sync-short-initial-retry-override --sync-short-nudge-delay-for-test --no-first-run --no-default-browser-check --enable-logging=stderr --disable-default-apps --wm-window-animations-disabled --disable-component-update --test-type=browser --force-color-profile=srgb --disable-zero-browsers-open-for-tests --ipc-connection-timeout=45 --allow-file-access-from-files --dom-automation --log-gpu-control-list-decisions --disable-backgrounding-occluded-windows --disable-gl-drawing-for-tests --override-use-software-gl-for-tests --force-color-profile=srgb --disable-compositor-ukm-for-tests --enable-features=TestFeatureForBrowserTest1 --disable-features=NetworkPrediction,SpeculativePreconnect,TestFeatureForBrowserTest2 --disable-gpu-process-for-dx12-vulkan-info-collection --flag-switches-begin --flag-switches-end --restore-last-session about:blank
[6032:1956:0812/035931.958:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
[6032:1956:0812/035931.973:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
[6032:6812:0812/035932.067:WARNING:gaia_auth_fetcher.cc(926)] Could not reach Google Accounts servers: errno -11
Starting connection to 127.0.0.1:58845
Handshake done for user@gmail.com/127.0.0.1:58845.chrome-sync
[6740:3116:0812/035932.973:ERROR:webthread_impl_for_utility_thread.cc(19)] NOT IMPLEMENTED
[6032:1956:0812/035933.161:WARNING:http_cache_transaction.cc(1273)] Unable to create cache entry
[Client A -> chromiumsync.py] GetUpdates NEW_CLIENT <experiments+nigori>@0
Creating permanent item: Experiments
Creating permanent item: Nigori
Returning encryption keys: ['8NVR47B1KOYJ3ZDN']
[Client A <- chromiumsync.py] 2 update(s)
[6032:5752:0812/035933.208:WARNING:sync_encryption_handler_impl.cc(970)] Nigori had empty encryption keybag.
[6032:5752:0812/035933.234:WARNING:sync_encryption_handler_impl.cc(970)] Nigori had empty encryption keybag.
[6032:6812:0812/035933.236:ERROR:account_tracker.cc(265)] OnOAuthError
[6032:6812:0812/035933.237:WARNING:account_tracker.cc(192)] Failed to get UserInfo for gaia_id_for_user@gmail.com
[6032:6812:0812/035933.239:ERROR:account_info_fetcher.cc(74)] OnOAuthError
[6032:6812:0812/035933.239:WARNING:account_fetcher_service.cc(322)] Failed to get UserInfo for gaia_id_for_user@gmail.com
[6032:6812:0812/035933.255:INFO:profile_sync_service.cc(2070)] ConfigureDataTypeManager not invoked because datatypes cannot be configured now
[6032:6812:0812/035933.256:INFO:profile_sync_service.cc(2070)] ConfigureDataTypeManager not invoked because datatypes cannot be configured now
[6032:5752:0812/035933.287:WARNING:sync_encryption_handler_impl.cc(346)] Ignoring new implicit passphrase. Keystore migration already performed.
[Client A -> chromiumsync.py] GetUpdates NEW_CLIENT <device_info+priority_preference>@0, <nigori>@2
Creating permanent item: Device Info
Creating permanent item: Priority Preferences
[Client A <- chromiumsync.py] 2 update(s)
Sending notification to user@gmail.com/127.0.0.1:58845.chrome-sync
[Client A -> chromiumsync.py] GetUpdates NEW_CLIENT <app+app_setting+autofill+autofill_profile+autofill_wallet+bookmark+dictionary+extension+extension_setting+favicon_image+favicon_tracking+history_delete_directive+password+preference+search_engine+session+theme+typed_url+wallet_metadata>@0, <nigori>@4
Creating permanent item: Apps
Creating permanent item: App Settings
Creating permanent item: Bookmarks
Creating permanent item: Bookmark Bar
Creating permanent item: Other Bookmarks
Creating permanent item: Autofill
Creating permanent item: Autofill Profiles
Creating permanent item: Autofill Wallet Items
Creating permanent item: Autofill Wallet Metadata
Creating permanent item: Extension Settings
Creating permanent item: Extensions
Creating permanent item: History Delete Directives
Creating permanent item: Favicon Images
Creating permanent item: Favicon Tracking
Creating permanent item: Passwords
Creating permanent item: Preferences
Creating permanent item: Search Engines
Creating permanent item: Sessions
Creating permanent item: Themes
Creating permanent item: Typed URLs
Creating permanent item: Dictionary
[Client A <- chromiumsync.py] 21 update(s)
Sending notification to user@gmail.com/127.0.0.1:58845.chrome-sync
[Client A -> chromiumsync.py] GetUpdates GU_TRIGGER <experiments>@2, <device_info+priority_preference>@4, <app+app_setting+autofill+autofill_profile+autofill_wallet+bookmark+dictionary+extension+extension_setting+favicon_image+favicon_tracking+history_delete_directive+nigori+password+preference+search_engine+session+theme+typed_url+wallet_metadata>@25
[Client A <- chromiumsync.py] 0 update(s)
[Client A -> chromiumsync.py] Commit 22 item(s)
Sending notification to user@gmail.com/127.0.0.1:58845.chrome-sync
[Client A -> chromiumsync.py] GetUpdates GU_TRIGGER <all except app_list+app_notification+arc_package+article+managed_user+managed_user_setting+managed_user_shared_setting+managed_user_whitelist+printer+reading_list+synced_notification+synced_notification_app_info+wifi_credential>@25
Returning encryption keys: ['8NVR47B1KOYJ3ZDN']
[Client A <- chromiumsync.py] 22 update(s)
[6032:1956:0812/035933.723:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
[6032:1956:0812/035933.755:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
[6032:1956:0812/035933.755:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
[Client A -> chromiumsync.py] GetUpdates GU_TRIGGER <all except app_list+app_notification+arc_package+article+managed_user+managed_user_setting+managed_user_shared_setting+managed_user_whitelist+printer+reading_list+synced_notification+synced_notification_app_info+wifi_credential>@47
[Client A <- chromiumsync.py] 0 update(s)
[6032:1956:0812/035933.942:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
../../chrome/browser/sync/test/integration/sync_test.cc(1110): error: Expected equality of these values:
  "Notifications disabled"
  base::UTF16ToASCII( browser()->tab_strip_model()->GetActiveWebContents()-> GetTitle())
    Which is: ""
Stack trace:
Backtrace:
	StackTraceGetter::CurrentStackTrace [0x00007FF794A2BBB0+80]
	testing::internal::UnitTestImpl::CurrentOsStackTraceExceptTop [0x00007FF794A4698A+90]
	testing::internal::AssertHelper::operator= [0x00007FF794A4648A+90]
	SyncTest::DisableNotificationsImpl [0x00007FF7975C561D+781]
	SyncTest::DisableNotifications [0x00007FF7975C56E3+19]
	base::circular_deque<syncer::EnumSet<enum syncer::ModelType,2,41> >::~circular_deque<syncer::EnumSet<enum syncer::ModelType,2,41> > [0x00007FF79485FDAE+206]
	std::_Vector_alloc<std::_Vec_base_types<std::unique_ptr<MigrationWatcher,std::default_delete<MigrationWatcher> >,std::allocator<std::unique_ptr<MigrationWatcher,std::default_delete<MigrationWatcher> > > > >::_Free_proxy [0x00007FF79485FC58+552]
	wmemcpy [0x00007FF79485F023+6947]
	content::BrowserTestBase::ProxyRunTestOnMainThreadLoop [0x00007FF79824A2AB+811]
	??$Invoke@P8BrowserTestBase@content@@EAAXXZPEAV12@$$V@?$FunctorTraits@P8BrowserTestBase@content@@EAAXXZX@internal@base@@SAXP8BrowserTestBase@content@@EAAXXZ$$QEAPEAV34@@Z [0x00007FF79824C8AA+26]
	base::internal::InvokeHelper<0,void>::MakeItSo<void (__cdecl content::BrowserTestBase::*const & __ptr64)(void) __ptr64,content::BrowserTestBase * __ptr64> [0x00007FF79824C824+52]
	base::internal::Invoker<base::internal::BindState<void (__cdecl content::BrowserTestBase::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserTestBase> >,void __cdecl(void)>::RunImpl<void (__cdecl content::BrowserTestBase::*const & __ptr64) [0x00007FF79824C7D8+88]
	base::internal::Invoker<base::internal::BindState<void (__cdecl content::BrowserTestBase::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserTestBase> >,void __cdecl(void)>::Run [0x00007FF79824C6EC+60]
	base::RepeatingCallback<void __cdecl(void)>::Run [0x00007FF794B96562+66]
	ChromeBrowserMainParts::PreMainMessageLoopRunImpl [0x00007FF798545CE4+6820]
	ChromeBrowserMainParts::PreMainMessageLoopRun [0x00007FF7985441A1+465]
	content::BrowserMainLoop::PreMainMessageLoopRun [0x00007FFE902D4423+355]
	??$Invoke@P8BrowserMainLoop@content@@EAAHXZPEAV12@$$V@?$FunctorTraits@P8BrowserMainLoop@content@@EAAHXZX@internal@base@@SAHP8BrowserMainLoop@content@@EAAHXZ$$QEAPEAV34@@Z [0x00007FFE902DE3CA+26]
	base::internal::InvokeHelper<0,int>::MakeItSo<int (__cdecl content::BrowserMainLoop::*const & __ptr64)(void) __ptr64,content::BrowserMainLoop * __ptr64> [0x00007FFE902DE344+52]
	base::internal::Invoker<base::internal::BindState<int (__cdecl content::BrowserMainLoop::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserMainLoop> >,int __cdecl(void)>::RunImpl<int (__cdecl content::BrowserMainLoop::*const & __ptr64)(vo [0x00007FFE902DE2E8+88]
	base::internal::Invoker<base::internal::BindState<int (__cdecl content::BrowserMainLoop::*)(void) __ptr64,base::internal::UnretainedWrapper<content::BrowserMainLoop> >,int __cdecl(void)>::Run [0x00007FFE902DE1BC+60]
	base::RepeatingCallback<int __cdecl(void)>::Run [0x00007FFE90D30142+66]
	content::StartupTaskRunner::RunAllTasksNow [0x00007FFE9170CBB1+161]
	content::BrowserMainLoop::CreateStartupTasks [0x00007FFE902D2351+1441]
	content::BrowserMainRunnerImpl::Initialize [0x00007FFE902E4558+1864]
	content::BrowserMain [0x00007FFE902CB9F2+194]
	content::RunBrowserProcessMain [0x00007FFE92FCDE08+168]
	content::ContentMainRunnerImpl::Run [0x00007FFE92FCF127+935]
	content::ContentServiceManagerMainDelegate::RunEmbedderProcess [0x00007FFE92FCB4C7+55]
	service_manager::Main [0x00007FFE9BEF5102+1762]
	content::ContentMain [0x00007FFE92FCDCCF+95]
	content::BrowserTestBase::SetUp [0x00007FF798249C3B+2875]
	InProcessBrowserTest::SetUp [0x00007FF7975E0F8E+1998]
	SyncTest::SetUp [0x00007FF7975BC336+710]
 
Cc: -shimazu@chromium.org
Components: Tests>Flaky
Owner: vitaliii@chromium.org
Status: Assigned (was: Available)
Looking at the flakiness dashboard, MigrationSingleClientTest.AllTypesWithNigoriAtOnce sometimes fails only on Win10 dbg. Some of other tests in MigrationSingleClientTest looks the same. 
https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=sync_integration_tests&tests=MigrationSingleClientTest.AllTypesWithNigoriAtOnce

vitaliii: added you to the owner since you are in the OWNERS of components/sync. Could you triage this?
Labels: -Pri-2 Pri-1
Let me bump this up to P1 since it's making the bot red occasionally.
Labels: -Sheriff-Chromium
Components: Services>Sync
Owner: melandory@chromium.org
melandory@, could you triage please?
Friendly ping -- these tests are still failing.
Blockedon: 876224
The failing reason is being investigated in bug mentioned in previous comment
triage ping: melandory@, any updates?
triage ping: melandory@, any updates?
Blockedon: -876224
Blocking: 876224
Labels: FixitSync
Labels: OS-Windows
FYI: Note the blocking bug 876224 - tl;dr *lots* of tests are flaky/broken on this particular bot, so it's most likely not anything specific to the sync tests. IIUC, this bot was spun up somewhat recently, and those test suites simply never worked there.
Triage ping for melandory@, thanks!
Triage ping for melandory@, thanks!
I am puzzled, is this blocking or blocked on bug 876224?

Labels: -Pri-1 Pri-2
Tanja, are you still working on this or do you want to drop this bug (incl. FixitSync label)?
[6032:1956:0812/035933.942:ERROR:service_manager_context.cc(270)] Attempting to run unsupported native service: C:\b\s\w\ir\out\Debug_x64\chrome_renderer.service.exe
Cc: tschumann@chromium.org
 Issue 910600  has been merged into this issue.

Comment 19 by jkrcal@chromium.org, Yesterday (45 hours ago)

Owner: ----
Status: Available (was: Assigned)

Sign in to add a comment