New issue
Advanced search Search tips

Issue 614360 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Jun 2016
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

"archive_webkit_tests_results" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, May 24 2016

Issue description

"archive_webkit_tests_results" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 3 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJwsSBUZsYWtlIhxhcmNoaXZlX3dlYmtpdF90ZXN0c19yZXN1bHRzDA.



This flaky test/step was previously tracked in  issue 610037 .
 
Components: -Tests>Flaky Infra
This is happening on several different try bots, and is affecting the ability to get CLs through the commit queue :(

It looks like the archive step is working, but *very* slowly. I've been following the stdout stream on my job (https://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_rel_ng/builds/227061/steps/archive_webkit_tests_results/logs/stdio), so I can see that it is progressing, but it is taking a very long time. Previous runs (the ones reported as flakes here) appear to have just timed out.

This step generally takes ~7 minutes; these failed runs are taking >1h30 before failing the job.
Components: -Infra Infra>CQ
Labels: -Sheriff-Chromium Infra-Troopers

Comment 4 by iannu...@google.com, May 24 2016

Components: Infra>Labs
Labs, can you see anything weird w.r.t bandwidth on these machines? One of the affected machines is vm334-m4 (looking at https://build.chromium.org/p/tryserver.chromium.win/builders/win_chromium_rel_ng/builds/227338/steps/archive_webkit_tests_results/logs/stdio)


Comment 5 by d...@chromium.org, May 24 2016

Nothing we can do about it. We've hit max limit for NAT bandwidth that our current peering equipment can handle. 

There's a maintenance next Tuesday to move us to new equipment and double the pipe.
Project Member

Comment 6 by chromium...@appspot.gserviceaccount.com, May 25 2016

Labels: Sheriff-Chromium
Detected 4 new flakes for test/step "archive_webkit_tests_results". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyJwsSBUZsYWtlIhxhcmNoaXZlX3dlYmtpdF90ZXN0c19yZXN1bHRzDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).

Comment 7 by no...@chromium.org, May 25 2016

Components: -Infra>CQ
This is labs issue

Comment 8 by hinoka@chromium.org, May 31 2016

Labels: -Infra-Troopers
Labels: -Sheriff-Chromium
Owner: d...@chromium.org
dba: Since we're past the Tuesday mentioned in comment 5, is this (likely) Fixed?

Assigning to you to close if so, or else clarify the updated status of this.

Comment 10 by d...@chromium.org, Jun 1 2016

I don't know if this particular problem is fixed, but our maintenance had to be rescheduled.

Comment 11 by d...@chromium.org, Jun 7 2016

Status: Fixed (was: Untriaged)
Bandwidth has now been officially doubled, so I'm going to close this.

Sign in to add a comment