New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 683216 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Feb 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

"SyncErrorTest.ClientDataObsoleteTest" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Jan 20 2017

Issue description

"SyncErrorTest.ClientDataObsoleteTest" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRTeW5jRXJyb3JUZXN0LkNsaWVudERhdGFPYnNvbGV0ZVRlc3QM.

Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
 
Cc: maxbogue@chromium.org zea@chromium.org s...@chromium.org pav...@chromium.org stanisc@chromium.org
Labels: -Sheriff-Chromium
Owner: maxbogue@chromium.org
Status: Assigned (was: Untriaged)
Looks like flaky auth errors? This flaked three times on the 20th and I don't see any history of flakes in the past couple months.

DCHECK failure is here; I am wondering if this has uncovered a sync bug. https://cs.chromium.org/chromium/src/components/sync/engine_impl/get_updates_processor.cc?dr=C&q=get_updates_processor.cc&sq=package:chromium&l=190

Because of the potential for a real bug and no ongoing flakiness I am assigning to Sync owners to either disable the test, close, or assess the risk of a real bug.

SyncErrorTest.ClientDataObsoleteTest (run #3):
[ RUN      ] SyncErrorTest.ClientDataObsoleteTest
Xlib:  extension "RANDR" missing on display ":99".
Xlib:  extension "RANDR" missing on display ":99".
[32744:32744:0120/001420.991403:WARNING:audio_manager.cc(321)] Multiple instances of AudioManager detected
[32744:32744:0120/001420.991438:WARNING:audio_manager.cc(278)] Multiple instances of AudioManager detected
[32744:32744:0120/001421.028534:WARNING:password_store_factory.cc(247)] Using basic (unencrypted) store for password storage. See https://chromium.googlesource.com/chromium/src/+/master/docs/linux_password_storage.md for more information about password storage options.
[32744:32744:0120/001421.234090:WARNING:password_store_factory.cc(247)] Using basic (unencrypted) store for password storage. See https://chromium.googlesource.com/chromium/src/+/master/docs/linux_password_storage.md for more information about password storage options.
[32744:32744:0120/001421.342230:WARNING:password_store_factory.cc(247)] Using basic (unencrypted) store for password storage. See https://chromium.googlesource.com/chromium/src/+/master/docs/linux_password_storage.md for more information about password storage options.
[32744:32744:0120/001421.389445:ERROR:child_account_info_fetcher_impl.cc(144)] ChildAccountInfoFetcherImpl::OnGetUserInfoSuccess: GetUserInfo response didn't include allServices field.
[32744:346:0120/001421.419577:WARNING:server_connection_manager.cc(269)] ServerConnectionManager forcing SYNC_AUTH_ERROR
[32744:346:0120/001421.419656:WARNING:syncer_proto_util.cc(338)] Error posting from syncer: Response Code (bogus on error): -1 Content-Length (bogus on error): -1 Server Status: SYNC_AUTH_ERROR
[32744:346:0120/001421.420547:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Bookmarks
[32744:346:0120/001421.420865:WARNING:sync_encryption_handler_impl.cc(971)] Nigori had empty encryption keybag.
[32744:346:0120/001421.422391:WARNING:sync_encryption_handler_impl.cc(971)] Nigori had empty encryption keybag.
[32744:346:0120/001421.432704:WARNING:sync_encryption_handler_impl.cc(347)] Ignoring new implicit passphrase. Keystore migration already performed.
[32744:346:0120/001421.433162:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Bookmarks
[32744:311:0120/001421.441108:WARNING:simple_synchronous_entry.cc(1054)] Could not open platform files for entry.
[32744:306:0120/001421.441146:WARNING:simple_synchronous_entry.cc(1054)] Could not open platform files for entry.
[32744:346:0120/001421.992039:ERROR:get_updates_processor.cc(244)] PostClientToServerMessage() failed during GetUpdates
[32744:346:0120/001432.021848:WARNING:server_connection_manager.cc(269)] ServerConnectionManager forcing SYNC_AUTH_ERROR
[32744:346:0120/001432.021951:WARNING:syncer_proto_util.cc(338)] Error posting from syncer: Response Code (bogus on error): -1 Content-Length (bogus on error): -1 Server Status: SYNC_AUTH_ERROR
[32744:346:0120/001432.023165:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Bookmarks
[32744:346:0120/001432.023183:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Preferences
[32744:346:0120/001432.023195:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Themes
[32744:346:0120/001432.023204:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Search Engines
[32744:346:0120/001432.023214:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Sessions
[32744:346:0120/001432.023223:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Apps
[32744:346:0120/001432.023233:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Device Info
[32744:346:0120/001432.023264:WARNING:get_updates_processor.cc(103)] Skipping unexpected progress marker for non-enabled type Priority Preferences
[32744:32744:0120/001432.037134:INFO:profile_sync_service.cc(1386)] ProfileSyncService::Observe Sync Configure aborted
[32744:346:0120/001432.037302:FATAL:get_updates_processor.cc(190)] Check failed: handler_it != update_handler_map_->end(). Failed to look up handler for Priority Preferences
#0 0x000001e327ae base::debug::StackTrace::StackTrace()
#1 0x000001e4aa4b logging::LogMessage::~LogMessage()
#2 0x000005d69d70 syncer::GetUpdatesProcessor::PrepareGetUpdates()
#3 0x000005d69a4b syncer::GetUpdatesProcessor::DownloadUpdates()
#4 0x000005d326c0 syncer::Syncer::DownloadAndApplyUpdates()
#5 0x000005d32ada syncer::Syncer::ConfigureSyncShare()
#6 0x000005d2f2fa syncer::SyncSchedulerImpl::DoConfigurationSyncCycleJob()
#7 0x000005d3078f syncer::SyncSchedulerImpl::TrySyncCycleJobImpl()
#8 0x00000062894a _ZN4base8internal13FunctorTraitsIMN7content21EmbeddedServiceRunnerEFvvEvE6InvokeIRKNS_7WeakPtrIS3_EEJEEEvS5_OT_DpOT0_
#9 0x000001ee02ee base::debug::TaskAnnotator::RunTask()
#10 0x000001e51d3d base::MessageLoop::RunTask()
#11 0x000001e523f6 base::MessageLoop::DoWork()
#12 0x000001e53e09 base::MessagePumpDefault::Run()
#13 0x000001e51a95 base::MessageLoop::RunHandler()
#14 0x000001e7931c base::RunLoop::Run()
#15 0x000001ea311c base::Thread::Run()
#16 0x000001ea3618 base::Thread::ThreadMain()
#17 0x000001e9c4ac base::(anonymous namespace)::ThreadFunc()
#18 0x7f58205fce9a start_thread
#19 0x7f581a25e36d clone
Cc: -stanisc@chromium.org -pav...@chromium.org
Owner: pav...@chromium.org
Pavel, could this have also been caused by http://crrev.com/2641523004? Looks like no flakes have occurred since the 20th when it was reverted.
Project Member

Comment 3 by chromium...@appspot.gserviceaccount.com, Jan 27 2017

Labels: Sheriff-Chromium
Detected 7 new flakes for test/step "SyncErrorTest.ClientDataObsoleteTest". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRTeW5jRXJyb3JUZXN0LkNsaWVudERhdGFPYnNvbGV0ZVRlc3QM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Project Member

Comment 4 by chromium...@appspot.gserviceaccount.com, Jan 30 2017

Detected 3 new flakes for test/step "SyncErrorTest.ClientDataObsoleteTest". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRTeW5jRXJyb3JUZXN0LkNsaWVudERhdGFPYnNvbGV0ZVRlc3QM. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 5 by chromium...@appspot.gserviceaccount.com, Jan 31 2017

Detected 3 new flakes for test/step "SyncErrorTest.ClientDataObsoleteTest". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRTeW5jRXJyb3JUZXN0LkNsaWVudERhdGFPYnNvbGV0ZVRlc3QM. This message was posted automatically by the chromium-try-flakes app.
Labels: -Sheriff-Chromium
Disabling this test on Linux and Windows builders.
Project Member

Comment 7 by bugdroid1@chromium.org, Feb 1 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/5cc54f5575d095142cbc1755653265565a2f462c

commit 5cc54f5575d095142cbc1755653265565a2f462c
Author: iclelland <iclelland@chromium.org>
Date: Wed Feb 01 16:17:14 2017

Disable flaky test SyncErrorTest.ClientDataObsoleteTest.

The test has been flaky recently on Linux and Windows builders.
Disabling until the root cause is fixed.

BUG= 683216 
TBR=pavely@chromium.org

Review-Url: https://codereview.chromium.org/2668583007
Cr-Commit-Position: refs/heads/master@{#447527}

[modify] https://crrev.com/5cc54f5575d095142cbc1755653265565a2f462c/chrome/browser/sync/test/integration/sync_errors_test.cc

Project Member

Comment 8 by chromium...@appspot.gserviceaccount.com, Feb 1 2017

Labels: Sheriff-Chromium
Detected 5 new flakes for test/step "SyncErrorTest.ClientDataObsoleteTest". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyLwsSBUZsYWtlIiRTeW5jRXJyb3JUZXN0LkNsaWVudERhdGFPYnNvbGV0ZVRlc3QM. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Labels: -Sheriff-Chromium
Status: Started (was: Assigned)
There is a race condition that happens when DataTypeManagerImpl is stopped during configuration. In this case Configuration sync cycle can be called with model types that were just unregistered from ModelTypeRegistry.

Here is the sequence:
[UI thread] - DTMI::Configure posts ModelTypeRegistry::RegisterDirectoryType to sync thread
[UI thread] - DTMI::Configure posts SyncBackendHostCore::DoConfigureSyncer to sync thread
[UI thread] - DTMI::Stop posts ModelTypeRegistry::UnregisterDirectoryType to sync thread
[Sync thread] - ModelTypeRegistry::RegisterDirectoryType creates update handler for type
[Sync thread] - SyncBackendHostCore::DoConfigureSyncer posts SyncSchedulerImpl::TrySyncCycleJobImpl on sync thread passing set of types to configure
[Sync thread] - ModelTypeRegistry::UnregisterDirectoryType removes update handler
[Sync thread] - SyncSchedulerImpl::TrySyncCycleJobImpl runs configuration for the type for which update handler was just unregistered
Project Member

Comment 11 by bugdroid1@chromium.org, Feb 24 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/2010aad1ee6e6b1edfff8e726dbfbea20c2a6ce4

commit 2010aad1ee6e6b1edfff8e726dbfbea20c2a6ce4
Author: pavely <pavely@chromium.org>
Date: Fri Feb 24 21:35:55 2017

[Sync] Adjust types to configure during shutdown

When preparing request to server we need to make sure there are update handlers
registered for all types to download. It is possible that configuration cycle
is scheduled with set of types that are later unregistered from
ModelTypeRegistry as part of shutdown. When configuration cycle gets to run
it DCHECKs on types that were requested but later unregistered.

The solution is to detect shutdown condition and adjust types to download.

BUG= 683216 
R=skym@chromium.org

Review-Url: https://codereview.chromium.org/2718533003
Cr-Commit-Position: refs/heads/master@{#452932}

[modify] https://crrev.com/2010aad1ee6e6b1edfff8e726dbfbea20c2a6ce4/chrome/browser/sync/test/integration/sync_errors_test.cc
[modify] https://crrev.com/2010aad1ee6e6b1edfff8e726dbfbea20c2a6ce4/components/sync/engine_impl/syncer.cc
[modify] https://crrev.com/2010aad1ee6e6b1edfff8e726dbfbea20c2a6ce4/components/sync/engine_impl/syncer_unittest.cc

Status: Fixed (was: Started)

Sign in to add a comment