LogDog tumble queue is backed up |
||
Issue descriptionThe logdog tumble queue has 100000+ jobs, with a lot of jobs older than 2 days: Task Queue: https://screenshot.googleplex.com/1Xm5C4o7CV2 Logs: https://screenshot.googleplex.com/Tik0NsTWXmM A single sample of a 10min job that expired shows that the 9:30s timeout was never triggered, suggesting that the code is just stuck (deadlocked?) somewhere. Last known log message: https://screenshot.googleplex.com/5ZdNmP6xF9n
,
Sep 26
We've drained the queue and added metrics. |
||
►
Sign in to add a comment |
||
Comment 1 by hinoka@chromium.org
, Jun 6 2018