Tricium: Failed to call Tracker.WorkerDone ... missing output hash |
|||
Issue description
This is a common error that appears in the logs of tricium-dev:
Example:
2018-01-19 14:27:25.719 PST
[tracker] Worker done request (run ID: 5713990399295488, Worker: Spacey_UBUNTU)
2018-01-19 14:27:25.719 PST
[tracker] Failed to call Tracker.WorkerDone :: {"error":"rpc error: code = InvalidArgument desc = missing output hash"
Error is raised here:
https://cs.chromium.org/chromium/infra/go/src/infra/tricium/appengine/tracker/rpc_worker_done.go?l=37
Could be related to (causing?) bug 803996 .
,
Jan 25 2018
Additional note: The tasks in the tracker-queue task queue that are being repeatedly retried are all hitting this error.
,
Feb 21 2018
Related change: https://chromium-review.googlesource.com/c/infra/infra/+/848777 This is part of supporting aborted tasks, bug 798092 .
,
Feb 22 2018
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/d6542b90860752f9eff3354c526399fe93d21950 commit d6542b90860752f9eff3354c526399fe93d21950 Author: Quinten Yearsley <qyearsley@chromium.org> Date: Thu Feb 22 17:35:16 2018 Consider worker aborted the same as worker failed This CL changes it so that: - In a tracker "worker done" request, aborted workers are treated the same as failed workers, i.e. they cause their functions and workflows to be considered failure. - In a driver "collect" request, it's OK if there's no isolated input hash, since this is expected for tasks for aborted workers. Bug: 803998 Change-Id: I461259a27e446ad48bc635f38fd340a69e4a03c6 Reviewed-on: https://chromium-review.googlesource.com/929869 Reviewed-by: Marc-Antoine Ruel <maruel@chromium.org> Commit-Queue: Quinten Yearsley <qyearsley@chromium.org> [modify] https://crrev.com/d6542b90860752f9eff3354c526399fe93d21950/go/src/infra/tricium/appengine/driver/driver.infra_testing [modify] https://crrev.com/d6542b90860752f9eff3354c526399fe93d21950/go/src/infra/tricium/appengine/driver/rpc_collect_test.go [modify] https://crrev.com/d6542b90860752f9eff3354c526399fe93d21950/go/src/infra/tricium/appengine/tracker/rpc_worker_done.go [modify] https://crrev.com/d6542b90860752f9eff3354c526399fe93d21950/go/src/infra/tricium/appengine/driver/rpc_collect.go [modify] https://crrev.com/d6542b90860752f9eff3354c526399fe93d21950/go/src/infra/tricium/appengine/tracker/rpc_worker_done_test.go
,
Feb 22 2018
|
|||
►
Sign in to add a comment |
|||
Comment 1 by emso@chromium.org
, Jan 22 2018