New issue
Advanced search Search tips

Issue 856726 link

Starred by 1 user

Issue metadata

Status: Verified
Owner:
Closed: Jun 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux , Android , Windows , iOS , Chrome , Mac
Pri: 3
Type: Bug



Sign in to add a comment

[autofill] Flaky test in PersonalDataManagerTest

Project Member Reported by rogerm@chromium.org, Jun 26 2018

Issue description

The following test is flaky:

  PersonalDataManagerTest
     .GetProfileSuggestions_NoSubsetsCheckingIfTooManyProfiles

The test case ends with an expectation that probably doesn't need to be there.

The test validates that when there are more then 15 suggestions, autofill skips the expensive "dedupe" operation to merge suggestions. The last expectation validates that the first suggestion has a particular value, but the ordering of the suggestion isn't actually set/controlled by the test.

Out of the 16 suggestions, fifteen have the expected value but one has a different value, so this test can be expected to fail roughly once every 16 executions.

Looking at the flakiness dashboard bears this out.

See: https://goto.google.com/crbug-856726


 

Comment 1 by rogerm@chromium.org, Jun 26 2018

Description: Show this description
Project Member

Comment 2 by bugdroid1@chromium.org, Jun 26 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/963967d34b6a2e211320187cf0cced92fc8dc18e

commit 963967d34b6a2e211320187cf0cced92fc8dc18e
Author: Roger McFarlane <rogerm@chromium.org>
Date: Tue Jun 26 19:18:30 2018

[autofill] Fix a flaky test

Flaky test:

  PersonalDataManagerTest
     .GetProfileSuggestions_NoSubsetsCheckingIfTooManyProfiles

This CL removes an errant expectation.

The test validates that when there are more then 15 suggestions,
autofill skips the expensive "dedupe" operation to merge
suggestions. There was an extra expectation that the first
suggestion has a particular value, but the ordering of the
suggestion isn't actually set/controlled by the test.

Out of the 16 suggestions, fifteen have the same value but one
has a different value, so this test was failing roughly once
every 16 runs.

Bug:  856726 
Change-Id: Ib17bd91d232598886e1050622b3ca8c10e856f35
Reviewed-on: https://chromium-review.googlesource.com/1115462
Commit-Queue: Roger McFarlane <rogerm@chromium.org>
Reviewed-by: Sebastien Seguin-Gagnon <sebsg@chromium.org>
Cr-Commit-Position: refs/heads/master@{#570485}
[modify] https://crrev.com/963967d34b6a2e211320187cf0cced92fc8dc18e/components/autofill/core/browser/personal_data_manager_unittest.cc

Comment 3 by rogerm@chromium.org, Jun 29 2018

Status: Fixed (was: Untriaged)

Comment 4 by rogerm@chromium.org, Jun 29 2018

Status: Verified (was: Fixed)

Sign in to add a comment