Setup Tricium pubsub, launch swarming task reporting to that pubsub, collect results.
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e commit 577d5d0de1c92949fd60cf0b3d0e5367f6402b9e Author: emso <emso@chromium.org> Date: Wed Mar 15 09:29:41 2017 Adds swarming and isolate integration. * Triggers swarming tasks. * Receives notification of task completion via PubSub pull. * Collects results from swarming tasks. * Tracks results. BUG= 680123 Change-Id: Id4853a1874a83603573b41592bdebf3e1b00431e Reviewed-on: https://chromium-review.googlesource.com/427941 Commit-Queue: Emma Söderberg <emso@chromium.org> Reviewed-by: Marc-Antoine Ruel <maruel@chromium.org> [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/common/track/track.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/admin/v1/pb.discovery.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/admin/v1/driver.pb.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/tracker/rpc_worker_done_test.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/driver/rpc_trigger_test.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/v1/pb.discovery.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/driver/init.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/frontend/frontend.infra_testing [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/v1/tricium.proto [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/admin/v1/workflow_helpers.go [add] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/common/swarming.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/admin/v1/tracker.proto [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/tracker/rpc_worker_launched.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/driver/rpc_trigger.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/launcher/rpc_launch.go [add] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/common/isolate.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/admin/v1/tracker.pb.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/frontend/app.yaml [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/launcher/rpc_launch_test.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/driver/rpc_collect_test.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/frontend/rpc_analyze.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/api/admin/v1/driver.proto [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/tracker/rpc_worker_done.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/common/common.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/driver/rpc_collect.go [add] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/driver/handlers_test.go [modify] https://crrev.com/577d5d0de1c92949fd60cf0b3d0e5367f6402b9e/go/src/infra/tricium/appengine/driver/handlers.go
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/a13e78bf0472efa098daac087513a3aed2523c4c commit a13e78bf0472efa098daac087513a3aed2523c4c Author: emso <emso@chromium.org> Date: Thu Mar 16 14:26:18 2017 Adds data type to file path map. BUG= 680123 Change-Id: I364243227fc70e23b5522adf1c75d686e0d4b2ad Reviewed-on: https://chromium-review.googlesource.com/455837 Reviewed-by: Marc-Antoine Ruel <maruel@chromium.org> Commit-Queue: Emma Söderberg <emso@chromium.org> [modify] https://crrev.com/a13e78bf0472efa098daac087513a3aed2523c4c/go/src/infra/tricium/api/v1/data.pb.go [modify] https://crrev.com/a13e78bf0472efa098daac087513a3aed2523c4c/go/src/infra/tricium/api/v1/data.proto [modify] https://crrev.com/a13e78bf0472efa098daac087513a3aed2523c4c/go/src/infra/tricium/api/v1/pb.discovery.go [add] https://crrev.com/a13e78bf0472efa098daac087513a3aed2523c4c/go/src/infra/tricium/api/v1/data_helpers_test.go [modify] https://crrev.com/a13e78bf0472efa098daac087513a3aed2523c4c/go/src/infra/tricium/appengine/launcher/rpc_launch.go [add] https://crrev.com/a13e78bf0472efa098daac087513a3aed2523c4c/go/src/infra/tricium/api/v1/data_helpers.go [modify] https://crrev.com/a13e78bf0472efa098daac087513a3aed2523c4c/go/src/infra/tricium/appengine/common/isolate.go
The integration works for the local devserver and pull pubsub but needs to be tested with push pubsub on the dev appengine instance.
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/7855a6626539006b72f6ebaa012d19c0ecde250d commit 7855a6626539006b72f6ebaa012d19c0ecde250d Author: Emma <emso@chromium.org> Date: Mon Apr 10 05:39:11 2017 Adds a Tricium prefix to swarming task names BUG= 680123 Change-Id: I044611f82a8dbaffb488719ea38e99f00a336dcf Reviewed-on: https://chromium-review.googlesource.com/471547 Reviewed-by: Marc-Antoine Ruel <maruel@chromium.org> Commit-Queue: Emma Söderberg <emso@chromium.org> [modify] https://crrev.com/7855a6626539006b72f6ebaa012d19c0ecde250d/go/src/infra/tricium/appengine/common/swarming.go
Comment 1 by emso@chromium.org
, Jan 16 2017