New issue
Advanced search Search tips

Issue 913023 link

Starred by 1 user
Status: Duplicate
Owner: ----
Closed: Dec 7
Cc:
dgarr...@chromium.org
cmt...@chromium.org
hinoka@chromium.org
chromeos-continuous-integration-fire-hose@google.com
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 1
Type: Bug



Sign in to add a comment

Was there a LogDog outage this morning?

Project Member Reported by jclinton@chromium.org, Dec 7 
We have scattered reports of CrOS Swarming jobs failing to initialize LogDog connections:

infra_failure: <
  text: "failed to run recipe: failed to create LogDog Output instance: HTTP 503: no gRPC code. Body: \"\\n<html><head>\\n<meta http-equiv=\\\"content-type\\\" content=\\\"text/html;charset=utf-8\\\">\\n<title>503 Over Quota</title>\\n<style><!--\\nbody {font-family: arial,sans-serif}\\ndiv.nav {margin-top: 1ex}\\ndiv.nav A {font-size: 10pt; font-family: arial,sans-serif}\\nspan.nav {f...\""
  bootstrapper_call_stack: "original error: HTTP 503: no gRPC code. Body: \"\\n<html><head>\\n<meta http-equiv=\\\"content-type\\\" content=\\\"text/html;charset=utf-8\\\">\\n<title>503 Over Quota</title>\\n<style><!--\\nbody {font-family: arial,sans-serif}\\ndiv.nav {margin-top: 1ex}\\ndiv.nav A {font-size: 10pt; font-family: arial,sans-serif}\\nspan.nav {f...\""
  bootstrapper_call_stack: ""
  bootstrapper_call_stack: "goroutine 1:"
  bootstrapper_call_stack: "#0 go.chromium.org/luci/grpc/grpcutil/errors.go:99 - grpcutil.WrapIfTransient()"
  bootstrapper_call_stack: "  tag[\"this error is temporary\"]: true"
  bootstrapper_call_stack: ""
  bootstrapper_call_stack: "#1 go.chromium.org/luci/logdog/client/butler/output/logdog/output.go:164 - logdog.(*Config).Register.func1()"
  bootstrapper_call_stack: "#2 go.chromium.org/luci/common/retry/retry.go:92 - retry.Retry()"
  bootstrapper_call_stack: "#3 go.chromium.org/luci/logdog/client/butler/output/logdog/output.go:161 - logdog.(*Config).Register()"
  bootstrapper_call_stack: "#4 kitchen/cook_logdog.go:158 - main.(*cookRun).runWithLogdogButler()"
  bootstrapper_call_stack: "  reason: failed to create LogDog Output instance"
  bootstrapper_call_stack: ""
  bootstrapper_call_stack: "#5 kitchen/cook.go:185 - main.(*cookRun).ensureAndRunRecipe()"
  bootstrapper_call_stack: "  reason: failed to run recipe"
  bootstrapper_call_stack: ""
  bootstrapper_call_stack: "#6 kitchen/cook.go:486 - main.(*cookRun).run()"
  bootstrapper_call_stack: "#7 kitchen/cook.go:366 - main.(*cookRun).Run()"
  bootstrapper_call_stack: "#8 github.com/maruel/subcommands/subcommands.go:360 - subcommands.Run()"
  bootstrapper_call_stack: "#9 kitchen/kitchen.go:54 - main.main()"
  bootstrapper_call_stack: "#10 runtime/proc.go:201 - runtime.main()"
  bootstrapper_call_stack: "#11 runtime/asm_amd64.s:1333 - runtime.goexit()"
>

Comment 2 by jchin...@chromium.org, Dec 7

Mergedinto: 912838
Status: Duplicate (was: Untriaged)
Yes, this looks like a dupe of Issue 912838.
►

Sign in to add a comment