New issue
Advanced search Search tips

Issue 661434 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Mar 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Windows , Mac
Pri: 1
Type: Bug-Regression

Blocked on:
issue 674788



Sign in to add a comment

"telemetry_unittests (with patch)" is flaky

Project Member Reported by kbr@chromium.org, Nov 2 2016

Issue description

Flaky on macOS:
telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testWebviewInExtension

Flaky on Windows:
telemetry.internal.backends.chrome_inspector.tracing_backend_unittest.TracingBackendTest.testDumpMemorySuccess
telemetry.page.page_run_end_to_end_unittest.ActualPageRunEndToEndTests.testNeedsBrowserRestartAfterEachPage

All flake occurrences on chromium-try-flakes:
http://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw

For some reason, chromium-try-flakes wasn't reporting these, even though it had an issue ID of 0. Going to try associating this bug with it.

Happened to notice this because my CL was hit by this:
https://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_rel_ng/builds/323419
https://codereview.chromium.org/2457363002

It's clear this is occasionally slowing down try jobs a lot. Please investigate and consider disabling these tests on the affected platforms, or adding retries.
 

Comment 1 by kbr@chromium.org, Nov 2 2016

It looks like chromium-try-flakes has now associated this bug with those failures, though why it wasn't reporting them previously should be investigated by the Infra team.

Components: -Infra>Flakiness
We've seen chromium-try-flakes miss flakes before. Unfortunately I don't have the bandwidth at the moment to investigate why. See  issue 645827  for more details.
Project Member

Comment 3 by chromium...@appspot.gserviceaccount.com, Nov 9 2016

Detected 39 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 4 by chromium...@appspot.gserviceaccount.com, Nov 12 2016

Detected 17 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 5 by chromium...@appspot.gserviceaccount.com, Nov 14 2016

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.

Comment 6 by kbr@chromium.org, Nov 16 2016

Chromium-try-flakes isn't reporting all of the flakes of this test, though it seems to be recording them here:
https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw

On macOS, telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testWebviewInExtension is very flaky. It failed 15 times in the past 24 hours, and just affected another of my CLs, holding it up for an hour:

https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335726
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335721
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335623
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335505
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335444
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335336
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335323
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335286
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335224
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335218
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335204
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/335005

The failure mode is:

  Traceback (most recent call last):
    File "/b/swarm_slave/w/iregBC16/third_party/catapult/telemetry/telemetry/internal/browser/extension_unittest.py", line 216, in testWebviewInExtension
      self.assertEquals(1, len(webview_contexts))
  AssertionError: 1 != 0

Full stdout from one of the runs is attached.

I'm going to submit a CL to Telemetry disabling this test on macOS, since it doesn't look like the test harness has a retry mechanism for flaky tests. Looking at src/third_party/catapult/telemetry/telemetry/internal/browser/extension_unittest.py , it's already disabled on Windows and Linux because of flakiness.

stdout.txt
1.6 MB View Download
Project Member

Comment 7 by bugdroid1@chromium.org, Nov 16 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/b823ed52c962da5def94d544045513faa6c3c9ba

commit b823ed52c962da5def94d544045513faa6c3c9ba
Author: catapult-deps-roller <catapult-deps-roller@chromium.org>
Date: Wed Nov 16 08:05:55 2016

Roll src/third_party/catapult/ e30d2e8f4..5c3c95eda (1 commit).

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/e30d2e8f4cbd..5c3c95edaa02

$ git log e30d2e8f4..5c3c95eda --date=short --no-merges --format='%ad %ae %s'
2016-11-15 kbr Disable WebviewInExtensionTest.testWebviewInExtension on macOS.

BUG= 661434 

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls

CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=catapult-sheriff@chromium.org

Review-Url: https://codereview.chromium.org/2508783002
Cr-Commit-Position: refs/heads/master@{#432419}

[modify] https://crrev.com/b823ed52c962da5def94d544045513faa6c3c9ba/DEPS

Project Member

Comment 8 by chromium...@appspot.gserviceaccount.com, Nov 19 2016

Detected 8 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 9 by chromium...@appspot.gserviceaccount.com, Nov 20 2016

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 10 by chromium...@appspot.gserviceaccount.com, Nov 24 2016

Detected 5 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 11 by chromium...@appspot.gserviceaccount.com, Nov 26 2016

Detected 7 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 12 by chromium...@appspot.gserviceaccount.com, Nov 28 2016

Detected 4 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 13 by chromium...@appspot.gserviceaccount.com, Nov 29 2016

Detected 29 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 14 by chromium...@appspot.gserviceaccount.com, Nov 30 2016

Detected 12 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 15 by chromium...@appspot.gserviceaccount.com, Dec 1 2016

Detected 19 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 16 by chromium...@appspot.gserviceaccount.com, Dec 2 2016

Detected 24 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 17 by chromium...@appspot.gserviceaccount.com, Dec 3 2016

Detected 5 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 18 by chromium...@appspot.gserviceaccount.com, Dec 4 2016

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 19 by chromium...@appspot.gserviceaccount.com, Dec 5 2016

Detected 8 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Cc: -andyb...@chromium.org
Project Member

Comment 21 by chromium...@appspot.gserviceaccount.com, Dec 6 2016

Detected 16 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 22 by chromium...@appspot.gserviceaccount.com, Dec 10 2016

Detected 4 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 23 by chromium...@appspot.gserviceaccount.com, Dec 12 2016

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Cc: charliea@chromium.org
Almost all the failure are due to test Timed-out. I suspect this is due to the deadlock bug of cloud storage implementation (issue 643320).

I will disable running telemetry_unittests in parallel. This can be reenabled once Emily finishes her idempotency work which enable fetching the binary files before test runtime.
Any idea what could be deadlocking now that we have a timeout on acquiring the lock?
#25: not sure. I will just run the test serially to see whether it's still hang.
Project Member

Comment 27 by bugdroid1@chromium.org, Dec 13 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e882052d97ffbcfddca3a5af0dc6d0f709d95e02

commit e882052d97ffbcfddca3a5af0dc6d0f709d95e02
Author: nednguyen <nednguyen@google.com>
Date: Tue Dec 13 12:36:41 2016

Run telemetry_unitests in serial

This is suspected to cause flaky failure of telemetry_unitests

BUG= 661434 

Review-Url: https://codereview.chromium.org/2564413002
Cr-Commit-Position: refs/heads/master@{#438143}

[modify] https://crrev.com/e882052d97ffbcfddca3a5af0dc6d0f709d95e02/testing/buildbot/gn_isolate_map.pyl

Project Member

Comment 28 by chromium...@appspot.gserviceaccount.com, Dec 14 2016

Detected 9 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 29 by chromium...@appspot.gserviceaccount.com, Dec 15 2016

Detected 8 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
The telemetry_unittests keep timing out because of the timeout limit is too short. I will add 3 shards for it as the next step.
Project Member

Comment 31 by bugdroid1@chromium.org, Dec 15 2016

Blockedon: 674788
Project Member

Comment 33 by bugdroid1@chromium.org, Dec 16 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/cde936a4f8050aa7678afe36aae7c23f78473cc7

commit cde936a4f8050aa7678afe36aae7c23f78473cc7
Author: ksakamoto <ksakamoto@chromium.org>
Date: Fri Dec 16 07:27:22 2016

Revert of Set number of shards for telemetry_unittests to be 2 (patchset #1 id:1 of https://codereview.chromium.org/2579793002/ )

Reason for revert:
telemetry_unittests failing on chromium.linux/Linux Tests (dbg)(1) and linux_chromium_rel_ng.
 https://crbug.com/674788 

Original issue's description:
> Set number of shards for telemetry_unittests to be 2
>
> This suite currently occasionally is timed out (its usual runtime is 20 minutes total), causing flaky failure
>
> BUG= 661434 
>
> Committed: https://crrev.com/45cada6244d0cc9c8798e6531d2c1ea0b90a5668
> Cr-Commit-Position: refs/heads/master@{#438859}

TBR=dpranke@chromium.org,maruel@chromium.org,nednguyen@google.com
# Skipping CQ checks because original CL landed less than 1 days ago.
NOPRESUBMIT=true
NOTREECHECKS=true
NOTRY=true
BUG= 661434 

Review-Url: https://codereview.chromium.org/2583703003
Cr-Commit-Position: refs/heads/master@{#439060}

[modify] https://crrev.com/cde936a4f8050aa7678afe36aae7c23f78473cc7/testing/buildbot/chromium.fyi.json
[modify] https://crrev.com/cde936a4f8050aa7678afe36aae7c23f78473cc7/testing/buildbot/chromium.linux.json
[modify] https://crrev.com/cde936a4f8050aa7678afe36aae7c23f78473cc7/testing/buildbot/chromium.mac.json
[modify] https://crrev.com/cde936a4f8050aa7678afe36aae7c23f78473cc7/testing/buildbot/chromium.win.json

Project Member

Comment 34 by chromium...@appspot.gserviceaccount.com, Dec 16 2016

Detected 73 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Really really strange, the patch that add more shards make telemetry_unittests timed out a lot for more often ( issue 674788 )
Project Member

Comment 36 by chromium...@appspot.gserviceaccount.com, Dec 17 2016

Detected 15 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 37 by chromium...@appspot.gserviceaccount.com, Dec 19 2016

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 38 by chromium...@appspot.gserviceaccount.com, Dec 21 2016

Detected 8 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 39 by chromium...@appspot.gserviceaccount.com, Dec 22 2016

Detected 9 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 40 by chromium...@appspot.gserviceaccount.com, Dec 28 2016

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 41 by chromium...@appspot.gserviceaccount.com, Dec 29 2016

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 42 by chromium...@appspot.gserviceaccount.com, Jan 2 2017

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 43 by chromium...@appspot.gserviceaccount.com, Jan 3 2017

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 44 by chromium...@appspot.gserviceaccount.com, Jan 4 2017

Detected 5 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 45 by chromium...@appspot.gserviceaccount.com, Jan 6 2017

Detected 9 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 46 by chromium...@appspot.gserviceaccount.com, Jan 7 2017

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Split this into three bugs:

https://github.com/catapult-project/catapult/issues/3130 (browser_unittest.py:testIsTracingRunning)

https://github.com/catapult-project/catapult/issues/3131 (tracing_backend_unittest.py:testDumpMemorySuccess)

https://bugs.chromium.org/p/chromium/issues/detail?id=679429 (telemetry_unittests timing out on Linux CQ)
Project Member

Comment 48 by bugdroid1@chromium.org, Jan 9 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/147c319b045d16301dbc6fb82c164fadfd75154b

commit 147c319b045d16301dbc6fb82c164fadfd75154b
Author: catapult-deps-roller <catapult-deps-roller@chromium.org>
Date: Mon Jan 09 22:41:04 2017

Roll src/third_party/catapult/ 01464d2b3..d7650682c (2 commits).

https://chromium.googlesource.com/external/github.com/catapult-project/catapult.git/+log/01464d2b3b93..d7650682cad0

$ git log 01464d2b3..d7650682c --date=short --no-merges --format='%ad %ae %s'
2017-01-09 charliea Disable tests causing flakiness for telemetry_unittests on the Win CQ
2017-01-09 nednguyen [Telemetry] Simplify trace_data.TraceData by removing support for constructing it from raw data

BUG= 661434 

Documentation for the AutoRoller is here:
https://skia.googlesource.com/buildbot/+/master/autoroll/README.md

If the roll is causing failures, see:
http://www.chromium.org/developers/tree-sheriffs/sheriff-details-chromium#TOC-Failures-due-to-DEPS-rolls

CQ_INCLUDE_TRYBOTS=master.tryserver.chromium.android:android_optional_gpu_tests_rel
TBR=catapult-sheriff@chromium.org

Review-Url: https://codereview.chromium.org/2628443002
Cr-Commit-Position: refs/heads/master@{#442380}

[modify] https://crrev.com/147c319b045d16301dbc6fb82c164fadfd75154b/DEPS

Project Member

Comment 49 by chromium...@appspot.gserviceaccount.com, Feb 16 2017

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 50 by chromium...@appspot.gserviceaccount.com, Feb 16 2017

Detected 3 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 51 by chromium...@appspot.gserviceaccount.com, Feb 24 2017

Detected 10 new flakes for test/step "telemetry_unittests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyKwsSBUZsYWtlIiB0ZWxlbWV0cnlfdW5pdHRlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Status: Fixed (was: Assigned)
This seems fixed. Now let rely on flakiness server to report individual flaky tests.

Sign in to add a comment