lucifer: Add BigQuery
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/d3c29121a175da8c409d4d15ac68855a9e9f7a1a commit d3c29121a175da8c409d4d15ac68855a9e9f7a1a Author: Allen Li <ayatane@chromium.org> Date: Thu Apr 19 00:35:30 2018 gcp-bigquery: New package BUG= chromium:832966 TEST=sudo FEATURES=test emerge gapi-bigquery TEST=sudo FEATURES=test emerge gapi-gensupport TEST=sudo FEATURES=test emerge gapi-iterator TEST=sudo FEATURES=test emerge gapi-storage TEST=sudo FEATURES=test emerge genproto TEST=sudo FEATURES=test emerge gcp-bigquery TEST=sudo FEATURES=test emerge gcp-civil TEST=sudo FEATURES=test emerge gcp-internal TEST=sudo FEATURES=test emerge lucifer Change-Id: Ib14ed70d1ce38fa3648da5b21730a1d472b2bd68 Reviewed-on: https://chromium-review.googlesource.com/1013218 Commit-Ready: Allen Li <ayatane@chromium.org> Tested-by: Allen Li <ayatane@chromium.org> Reviewed-by: Rahul Chaudhry <rahulchaudhry@chromium.org> [modify] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/genproto/genproto-0.0.1.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-storage/gapi-storage-0.0.1.ebuild [rename] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/genproto/genproto-0.0.1-r3.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-gensupport/gapi-gensupport-0.0.1-r1.ebuild [modify] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-iterator/gapi-iterator-0.0.1.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-bigquery/gapi-bigquery-0.0.1-r1.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-gensupport/gapi-gensupport-0.0.1.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gcp-civil/gcp-civil-0.18.0.ebuild [modify] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/chromeos-base/lucifer/lucifer-9999.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gcp-civil/gcp-civil-0.18.0-r1.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gcp-bigquery/gcp-bigquery-0.18.0.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gcp-bigquery/gcp-bigquery-0.18.0-r1.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-storage/gapi-storage-0.0.1-r1.ebuild [rename] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-iterator/gapi-iterator-0.0.1-r3.ebuild [modify] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gcp-internal/gcp-internal-0.18.0.ebuild [add] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gapi-bigquery/gapi-bigquery-0.0.1.ebuild [rename] https://crrev.com/d3c29121a175da8c409d4d15ac68855a9e9f7a1a/dev-go/gcp-internal/gcp-internal-0.18.0-r2.ebuild
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/infra/lucifer/+/4b3072a824549c747203a8dfbc06692c6dfee009 commit 4b3072a824549c747203a8dfbc06692c6dfee009 Author: Allen Li <ayatane@google.com> Date: Fri May 11 19:13:37 2018 Add BigQuery BUG= chromium:832966 TEST=None Change-Id: Ifc0ba401862a8990348c8a46906bfa577b0372cd Reviewed-on: https://chromium-review.googlesource.com/1013138 Commit-Ready: Allen Li <ayatane@chromium.org> Tested-by: Allen Li <ayatane@chromium.org> Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org> [modify] https://crrev.com/4b3072a824549c747203a8dfbc06692c6dfee009/src/lucifer/cmd/lucifer_run_job/metrics.go [modify] https://crrev.com/4b3072a824549c747203a8dfbc06692c6dfee009/src/lucifer/Gopkg.lock [modify] https://crrev.com/4b3072a824549c747203a8dfbc06692c6dfee009/src/lucifer/cmd/lucifer_run_job/main.go [modify] https://crrev.com/4b3072a824549c747203a8dfbc06692c6dfee009/src/lucifer/Gopkg.toml [modify] https://crrev.com/4b3072a824549c747203a8dfbc06692c6dfee009/src/lucifer/monitoring/monitoring.go
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/infra/lucifer/+/62424595730bb99ca66a05321cd2c060aa9d6c2a commit 62424595730bb99ca66a05321cd2c060aa9d6c2a Author: Allen Li <ayatane@google.com> Date: Fri May 11 19:13:38 2018 Fix typo in comment BUG= chromium:832966 TEST=None Change-Id: I1482868ef6f842ef7a0837da45414598896b362d Reviewed-on: https://chromium-review.googlesource.com/1052816 Commit-Ready: Allen Li <ayatane@chromium.org> Tested-by: Allen Li <ayatane@chromium.org> Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org> [modify] https://crrev.com/62424595730bb99ca66a05321cd2c060aa9d6c2a/src/lucifer/cmd/skylab_swarming_worker/main.go
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/infra/lucifer/+/87cfc17aa3c20fd7ef62254f395ad3e1712027c1 commit 87cfc17aa3c20fd7ef62254f395ad3e1712027c1 Author: Allen Li <ayatane@google.com> Date: Fri May 11 19:13:38 2018 Reunite comment with the code it refers to BUG= chromium:832966 TEST=None Change-Id: Id828eed1e7580c6ac859297b3a1bb77c89efba5b Reviewed-on: https://chromium-review.googlesource.com/1052818 Commit-Ready: Allen Li <ayatane@chromium.org> Tested-by: Allen Li <ayatane@chromium.org> Reviewed-by: Prathmesh Prabhu <pprabhu@chromium.org> [modify] https://crrev.com/87cfc17aa3c20fd7ef62254f395ad3e1712027c1/src/lucifer/swarming/swarming.go [modify] https://crrev.com/87cfc17aa3c20fd7ef62254f395ad3e1712027c1/src/lucifer/cmd/skylab_swarming_worker/main.go
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/infra/lucifer/+/cddd249932ec1d3d2209228392f1648b58134e4f commit cddd249932ec1d3d2209228392f1648b58134e4f Author: Allen Li <ayatane@google.com> Date: Thu May 31 20:00:52 2018 lucifer_run_job: Fix host event schema The table and field names here do not match the table schema in BigQuery, so Put() returns an error. Change the names so that they match the BigQuery table schema. BUG= chromium:832966 TEST=Run one-off test command Change-Id: I71f0469a81fdbe2e82436820c4eb9fa8542d8549 Reviewed-on: https://chromium-review.googlesource.com/1079632 Commit-Ready: Allen Li <ayatane@chromium.org> Tested-by: Allen Li <ayatane@chromium.org> Reviewed-by: Craig Bergstrom <craigb@chromium.org> [modify] https://crrev.com/cddd249932ec1d3d2209228392f1648b58134e4f/src/lucifer/cmd/lucifer_run_job/metrics.go
Comment 1 by bugdroid1@chromium.org
, Apr 19 2018