New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 852888 link

Starred by 1 user

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

"benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile/background:news:nytimes" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Jun 14 2018

Issue description

"benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile/background:news:nytimes" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 25 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNygQELEgVGbGFrZSJ2YmVuY2htYXJrcy5zeXN0ZW1faGVhbHRoX3Ntb2tlX3Rlc3QuU3lzdGVtSGVhbHRoQmVuY2htYXJrU21va2VUZXN0LnN5c3RlbV9oZWFsdGgubWVtb3J5X21vYmlsZS9iYWNrZ3JvdW5kOm5ld3M6bnl0aW1lcww.

Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs

This flaky test/step was previously tracked in  issue 851263 .
 
Labels: Pri-2
Project Member

Comment 2 by chromium...@appspot.gserviceaccount.com, Jun 15 2018

Detected 23 new flakes for test/step "benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile/background:news:nytimes". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNygQELEgVGbGFrZSJ2YmVuY2htYXJrcy5zeXN0ZW1faGVhbHRoX3Ntb2tlX3Rlc3QuU3lzdGVtSGVhbHRoQmVuY2htYXJrU21va2VUZXN0LnN5c3RlbV9oZWFsdGgubWVtb3J5X21vYmlsZS9iYWNrZ3JvdW5kOm5ld3M6bnl0aW1lcww. This message was posted automatically by the chromium-try-flakes app.

Comment 3 by holte@chromium.org, Jun 18 2018

Found some related bugs:

Previous flaky bug: https://bugs.chromium.org/p/chromium/issues/detail?id=851263
Bug for this on desktop: https://bugs.chromium.org/p/chromium/issues/detail?id=816482

Will disable this test.
Project Member

Comment 4 by chromium...@appspot.gserviceaccount.com, Jun 18 2018

Detected 3 new flakes for test/step "benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile/background:news:nytimes". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNygQELEgVGbGFrZSJ2YmVuY2htYXJrcy5zeXN0ZW1faGVhbHRoX3Ntb2tlX3Rlc3QuU3lzdGVtSGVhbHRoQmVuY2htYXJrU21va2VUZXN0LnN5c3RlbV9oZWFsdGgubWVtb3J5X21vYmlsZS9iYWNrZ3JvdW5kOm5ld3M6bnl0aW1lcww. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 5 by bugdroid1@chromium.org, Jun 18 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/c6c7cdfc39d1ddd28bc462739de4fb6723964448

commit c6c7cdfc39d1ddd28bc462739de4fb6723964448
Author: Steven Holte <holte@google.com>
Date: Mon Jun 18 20:34:10 2018

Disable Flaky SystemHealthBenchmarkSmokeTest.

BUG=852888

TBR=perezju@chromium.org

Change-Id: I773594071fb0e9357af63d3024dd71125cad9723
Reviewed-on: https://chromium-review.googlesource.com/1104880
Reviewed-by: Steven Holte <holte@chromium.org>
Commit-Queue: Steven Holte <holte@chromium.org>
Cr-Commit-Position: refs/heads/master@{#568140}
[modify] https://crrev.com/c6c7cdfc39d1ddd28bc462739de4fb6723964448/tools/perf/benchmarks/system_health_smoke_test.py

Comment 6 by holte@chromium.org, Jun 18 2018

Labels: -Sheriff-Chromium Test-Disabled
Owner: perezju@chromium.org
Status: Assigned (was: Untriaged)
Project Member

Comment 7 by chromium...@appspot.gserviceaccount.com, Jun 20 2018

Labels: Sheriff-Chromium
Detected 4 new flakes for test/step "benchmarks.system_health_smoke_test.SystemHealthBenchmarkSmokeTest.system_health.memory_mobile/background:news:nytimes". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNygQELEgVGbGFrZSJ2YmVuY2htYXJrcy5zeXN0ZW1faGVhbHRoX3Ntb2tlX3Rlc3QuU3lzdGVtSGVhbHRoQmVuY2htYXJrU21va2VUZXN0LnN5c3RlbV9oZWFsdGgubWVtb3J5X21vYmlsZS9iYWNrZ3JvdW5kOm5ld3M6bnl0aW1lcww. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Cc: nednguyen@chromium.org
It looks like #5 disabled the wrong story (load:news:nytimes vs background:news:nytimes), also using the old disable method. Will revert that and disable the correct story in expectations.config.
Project Member

Comment 9 by bugdroid1@chromium.org, Jun 21 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/a8e152d441576f279d581fac3579f7981c9a8137

commit a8e152d441576f279d581fac3579f7981c9a8137
Author: Juan Antonio Navarro Perez <perezju@chromium.org>
Date: Thu Jun 21 08:38:05 2018

[tools/perf] Disable flaky background:news:nytimes

Story has been flaky in system_health.memory_mobile when running as
smoke test on N5X.

NOTRY=true
TBR=nednguyen@google.com

Bug: 852888
Change-Id: I8f82f42d50c6bf5f34bfda1cc42d147444921c05
Reviewed-on: https://chromium-review.googlesource.com/1109512
Reviewed-by: Juan Antonio Navarro Pérez <perezju@chromium.org>
Commit-Queue: Juan Antonio Navarro Pérez <perezju@chromium.org>
Cr-Commit-Position: refs/heads/master@{#569191}
[modify] https://crrev.com/a8e152d441576f279d581fac3579f7981c9a8137/tools/perf/expectations.config

Project Member

Comment 10 by bugdroid1@chromium.org, Jun 21 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/9d41737c01308fa62814ff698ab6f3ff584dc798

commit 9d41737c01308fa62814ff698ab6f3ff584dc798
Author: Juan Antonio Navarro Pérez <perezju@chromium.org>
Date: Thu Jun 21 11:06:59 2018

Revert "Disable Flaky SystemHealthBenchmarkSmokeTest."

This reverts commit c6c7cdfc39d1ddd28bc462739de4fb6723964448.

Reason for revert: Wrong story was disabled.

Original change's description:
> Disable Flaky SystemHealthBenchmarkSmokeTest.
>
> BUG=852888
>
> TBR=perezju@chromium.org
>
> Change-Id: I773594071fb0e9357af63d3024dd71125cad9723
> Reviewed-on: https://chromium-review.googlesource.com/1104880
> Reviewed-by: Steven Holte <holte@chromium.org>
> Commit-Queue: Steven Holte <holte@chromium.org>
> Cr-Commit-Position: refs/heads/master@{#568140}

TBR=holte@chromium.org

# Not skipping CQ checks because original CL landed > 1 day ago.

NOTRY=True

Bug: 852888
Change-Id: Ibded1b8ca4185a53323dcd26e76501b25dfd6a54
Reviewed-on: https://chromium-review.googlesource.com/1109039
Commit-Queue: Juan Antonio Navarro Pérez <perezju@chromium.org>
Reviewed-by: Juan Antonio Navarro Pérez <perezju@chromium.org>
Cr-Commit-Position: refs/heads/master@{#569215}
[modify] https://crrev.com/9d41737c01308fa62814ff698ab6f3ff584dc798/tools/perf/benchmarks/system_health_smoke_test.py

Labels: -Sheriff-Chromium
Assigned -> removing from sheriffs' queue.
Labels: Pri-3

Sign in to add a comment