Issue 866052  will act as a defacto reason to add pools.cfg everywhere. These configurations will live in pools.cfg.

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/3dc6d7117fb611d82ac2b2280675bc3e1bafb46c

commit 3dc6d7117fb611d82ac2b2280675bc3e1bafb46c
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Thu Aug 02 19:57:17 2018

swarming: add discriminant for bot monitoring

R=jbudorick@chromium.org, mikenichols@chromium.org

Bug: 864724
Change-Id: Ib5da3c654819598e9b0388efbeb9c681b2b2c816
Reviewed-on: https://chromium-review.googlesource.com/1145713
Reviewed-by: Mike Nichols <mikenichols@chromium.org>
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>

[modify] https://crrev.com/3dc6d7117fb611d82ac2b2280675bc3e1bafb46c/appengine/swarming/proto/pools.proto
[modify] https://crrev.com/3dc6d7117fb611d82ac2b2280675bc3e1bafb46c/appengine/swarming/proto/pools_pb2.py

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/190753b520911d7be9f9632284f0dbca283069a1

commit 190753b520911d7be9f9632284f0dbca283069a1
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Fri Aug 03 18:58:31 2018

[swarming] tweaks pools BotMonitoring proto.

Follow up on change 1145713.

Bug: 864724
Change-Id: Iceee957150eb9f99e56c63adf894ae73dba4b6f7
Reviewed-on: https://chromium-review.googlesource.com/1161978
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>

[modify] https://crrev.com/190753b520911d7be9f9632284f0dbca283069a1/appengine/swarming/proto/pools.proto
[modify] https://crrev.com/190753b520911d7be9f9632284f0dbca283069a1/appengine/swarming/proto/pools_pb2.py

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/aac9be846c855e0167d4b0228c6dee317fc23eda

commit aac9be846c855e0167d4b0228c6dee317fc23eda
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Fri Aug 03 19:21:58 2018

[swarming] add validation for bot_monitoring

No implementation yet, but this enables users to add filling their pools.cfg.

Bug: 864724
Change-Id: I533d83a7b8e7465462c153abeeecc2d4113bc71d
Reviewed-on: https://chromium-review.googlesource.com/1161112
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>

[modify] https://crrev.com/aac9be846c855e0167d4b0228c6dee317fc23eda/appengine/swarming/server/pools_config.py
[modify] https://crrev.com/aac9be846c855e0167d4b0228c6dee317fc23eda/appengine/swarming/server/pools_config_test.py
[modify] https://crrev.com/aac9be846c855e0167d4b0228c6dee317fc23eda/appengine/swarming/server/task_request_test.py
[modify] https://crrev.com/aac9be846c855e0167d4b0228c6dee317fc23eda/appengine/swarming/server/task_scheduler_test.py
[modify] https://crrev.com/aac9be846c855e0167d4b0228c6dee317fc23eda/appengine/swarming/test_env_handlers.py

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/457cd5f59b7a1b2eee837f48d86e42a677ebc962

commit 457cd5f59b7a1b2eee837f48d86e42a677ebc962
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Wed Aug 08 22:30:08 2018

[components] Migrate stats_framework into a package

This will be refactored a second time afterward to split out the logservice code
into a separate file. Not doing here to reduce the complexity of the CL.

Bug: 864724
Change-Id: I56b6d260d475e1576ae319502983a80b963a588f
Reviewed-on: https://chromium-review.googlesource.com/1167473
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>

[modify] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/components/components/README.md
[rename] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/components/components/stats_framework/__init__.py
[rename] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/components/components/stats_framework/stats_framework_test.py
[rename] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/components/components/stats_framework/stats_gviz.py
[add] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/components/components/stats_framework/test_support
[modify] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/components/test_support/stats_framework_mock.py
[modify] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/isolate/handlers_frontend.py
[modify] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/isolate/stats.py
[modify] https://crrev.com/457cd5f59b7a1b2eee837f48d86e42a677ebc962/appengine/isolate/stats_test.py

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/3afaf62b53431b761e7735bfefd80f78e546083a

commit 3afaf62b53431b761e7735bfefd80f78e546083a
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Sat Aug 11 01:28:08 2018

[components] refactor more stats_framework

Split logservice handling code from the storage code into stats_logs.

Do not split the unit test yet, mainly because I'm lazy and the bot monitoring
work needs to be fixed asap.

Bug: 864724
Change-Id: Ie5166489ce03531926be8a5508c9c76a5b6199c2
Reviewed-on: https://chromium-review.googlesource.com/1169827
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>

[modify] https://crrev.com/3afaf62b53431b761e7735bfefd80f78e546083a/appengine/components/components/stats_framework/__init__.py
[modify] https://crrev.com/3afaf62b53431b761e7735bfefd80f78e546083a/appengine/components/components/stats_framework/stats_framework_test.py
[add] https://crrev.com/3afaf62b53431b761e7735bfefd80f78e546083a/appengine/components/components/stats_framework/stats_logs.py
[rename] https://crrev.com/3afaf62b53431b761e7735bfefd80f78e546083a/appengine/components/test_support/stats_framework_logs_mock.py
[modify] https://crrev.com/3afaf62b53431b761e7735bfefd80f78e546083a/appengine/isolate/stats.py
[modify] https://crrev.com/3afaf62b53431b761e7735bfefd80f78e546083a/appengine/isolate/stats_test.py

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/b79439f9c66195d8dd161a39a82aace99fbba94a

commit b79439f9c66195d8dd161a39a82aace99fbba94a
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Mon Nov 19 21:02:09 2018

[swarming] expand BotEvent.ALLOWED_EVENTS to be more readable

As more event types will be added, the previous form was hard to
decipher. This will make issues  895378  and 905087 nicer to implement.

R=qyearsley@chromium.org

Bug: 864724
Change-Id: Icedf77516b72bc2e068624db400d893ba95d916a
Reviewed-on: https://chromium-review.googlesource.com/c/1343297
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>

[modify] https://crrev.com/b79439f9c66195d8dd161a39a82aace99fbba94a/appengine/swarming/server/bot_management.py

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/luci/luci-py.git/+/bd9ae51d3d87f6949fadd7165493a65d221d8cc1

commit bd9ae51d3d87f6949fadd7165493a65d221d8cc1
Author: Marc-Antoine Ruel <maruel@chromium.org>
Date: Fri Dec 07 12:59:01 2018

[swarming] Add cron job for both bot and task monitoring

They don't do anything, it is simply to ease the deployment by adding
the handlers right away so I can check in cron.yaml update soonish.

Start adding bot events in memcache; this will accelerate monitoring by
an order of magnitude.

Bug: 864722
Bug: 864724
Change-Id: I5702dccb6ee341414db6ebb69e1a207e748f5d29
Reviewed-on: https://chromium-review.googlesource.com/c/1366635
Commit-Queue: Marc-Antoine Ruel <maruel@chromium.org>
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>

[add] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/doc/Monitoring.md
[modify] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/handlers_backend.py
[modify] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/server/bot_management.py
[modify] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/server/bot_management_test.py
[add] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/server/stats_bots.py
[add] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/server/stats_bots_test.py
[add] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/server/stats_tasks.py
[add] https://crrev.com/bd9ae51d3d87f6949fadd7165493a65d221d8cc1/appengine/swarming/server/stats_tasks_test.py