New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 602652 link

Starred by 1 user

Issue metadata

Status: Duplicate
Owner: ----
Closed: Aug 2016
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

"browser_tests (with patch)" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Apr 12 2016

Issue description

"browser_tests (with patch)" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw.

Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
 
Cc: chrome-network-stack@google.com
Components: -Tests>Flaky Internals>Network>Proxy
Labels: -Sheriff-Chromium
Owner: agl@chromium.org
Status: Unconfirmed (was: Untriaged)
The following tests failed three times in a row:

OutOfProcessProxyResolverBrowserTest.Verify
FtpProxyScriptBrowserTest.Verify
FileProxyScriptBrowserTest.Verify
DataProxyScriptBrowserTest.Verify
HttpProxyScriptBrowserTest.Verify

See results here:

https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_site_isolation/builds/1642
https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_site_isolation/builds/1637
https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_site_isolation/builds/1636

Seems like the test for PAC file failed:

../../chrome/browser/net/proxy_browsertest.cc:47: Failure
Value of: result
  Actual: false
Expected: true

Please take a look to see why this test seems flaky.  Thanks.
Project Member

Comment 2 by chromium...@appspot.gserviceaccount.com, May 19 2016

Detected 3 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Comment 3 by agl@chromium.org, May 20 2016

Owner: ----
Project Member

Comment 4 by chromium...@appspot.gserviceaccount.com, Jun 16 2016

Labels: Sheriff-Chromium
Detected 4 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Labels: -Sheriff-Chromium
The latest report (comment #4) is different than the previous two. It is on a different bot (mac_chromium_gn_rel), and different tests.

Example:
https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_gn_rel/builds/128168

This failure was temporary and has resolved.

As for the previous failures, it has not happened since comment #2.
Project Member

Comment 6 by chromium...@appspot.gserviceaccount.com, Jun 27 2016

Labels: Sheriff-Chromium
Detected 3 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Project Member

Comment 7 by chromium...@appspot.gserviceaccount.com, Jun 28 2016

Detected 13 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 8 by chromium...@appspot.gserviceaccount.com, Jun 29 2016

Detected 30 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 9 by chromium...@appspot.gserviceaccount.com, Jul 1 2016

Detected 25 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 10 by chromium...@appspot.gserviceaccount.com, Jul 2 2016

Detected 17 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 11 by chromium...@appspot.gserviceaccount.com, Jul 4 2016

Detected 3 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 12 by chromium...@appspot.gserviceaccount.com, Jul 5 2016

Detected 13 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 13 by chromium...@appspot.gserviceaccount.com, Jul 6 2016

Detected 12 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 14 by chromium...@appspot.gserviceaccount.com, Jul 7 2016

Detected 39 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 15 by chromium...@appspot.gserviceaccount.com, Jul 8 2016

Detected 17 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 16 by chromium...@appspot.gserviceaccount.com, Jul 9 2016

Detected 18 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 17 by chromium...@appspot.gserviceaccount.com, Jul 10 2016

Detected 3 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 18 by chromium...@appspot.gserviceaccount.com, Jul 11 2016

Detected 5 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Labels: -Sheriff-Chromium
Status: WontFix (was: Unconfirmed)
Slaves are swarmed. No real bug.
Cc: nek...@chromium.org
Labels: Sheriff-Chromium
Status: Untriaged (was: WontFix)
nektar, can you please elaborate why do you think this is not a real bug and why does it make a difference that the tests are swarmed? I can see some recent flakes, e.g. https://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_rel_ng/builds/256797.
Project Member

Comment 21 by chromium...@appspot.gserviceaccount.com, Jul 16 2016

Detected 21 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Labels: -Sheriff-Chromium
This test has not been flaky in these 3 days. Removing Sheriff-Chromium label.
Project Member

Comment 23 by chromium...@appspot.gserviceaccount.com, Jul 30 2016

Labels: Sheriff-Chromium
Detected 3 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Project Member

Comment 24 by chromium...@appspot.gserviceaccount.com, Aug 2 2016

Detected 4 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 25 by chromium...@appspot.gserviceaccount.com, Aug 4 2016

Detected 4 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 26 by chromium...@appspot.gserviceaccount.com, Aug 8 2016

Detected 3 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 27 by chromium...@appspot.gserviceaccount.com, Aug 9 2016

Detected 3 new flakes for test/step "browser_tests (with patch)". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJQsSBUZsYWtlIhpicm93c2VyX3Rlc3RzICh3aXRoIHBhdGNoKQw. This message was posted automatically by the chromium-try-flakes app.
Mergedinto: 633067
Status: Duplicate (was: Untriaged)
Failures continue to trickle in. In all cases where I can see the logs, it's failures in PPAPINaClPNaClTest.*, so I'm duping this into issue 633067. No doubt there will be other failures in browser_tests at some point. If this is automatically reopened, check if the failures since now are PPAPINaClPNaClTest.* or something else. If something else, please rename issue to something more descriptive.

Sign in to add a comment