New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 850219 link

Starred by 1 user

Issue metadata

Status: Fixed
Owner:
Closed: Sep 26
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

LogDog tumble queue is backed up

Project Member Reported by hinoka@chromium.org, Jun 6 2018

Issue description

The logdog tumble queue has 100000+ jobs, with a lot of jobs older than 2 days:
Task Queue: https://screenshot.googleplex.com/1Xm5C4o7CV2
Logs: https://screenshot.googleplex.com/Tik0NsTWXmM

A single sample of a 10min job that expired shows that the 9:30s timeout was never triggered, suggesting that the code is just stuck (deadlocked?) somewhere.

Last known log message: https://screenshot.googleplex.com/5ZdNmP6xF9n
 
Status: Available (was: Untriaged)
Owner: hinoka@chromium.org
Status: Fixed (was: Available)
We've drained the queue and added metrics.

Sign in to add a comment