Both PaygenTestCanary and PaygenTestDev substeps of Paygen have failed for several canary builders with this log snippet:

01-18-2017 [23:26:37] Created suite job: http://cautotest.corp.google.com/afe/#tab_id=view_job&object_id=96808164
@@@STEP_LINK@Link to suite@http://cautotest.corp.google.com/afe/#tab_id=view_job&object_id=96808164@@@
--create_and_return was specified, terminating now.
Will return from run_suite with status: OK
23:26:40: INFO: RunCommand: /b/cbuild/internal_master/chromite/third_party/swarming.client/swarming.py run --swarming chromeos-proxy.appspot.com --task-summary-json /tmp/cbuildbot-tmpkaKvdL/tmpqlRDgh/temp_summary.json --raw-cmd --task-name kefka-release/R57-9198.0.0-paygen_au_canary --dimension os Ubuntu-14.04 --dimension pool default --print-status-updates --timeout 14400 --io-timeout 14400 --hard-timeout 14400 --expiration 1200 '--tags=priority:Build' '--tags=suite:paygen_au_canary' '--tags=build:kefka-release/R57-9198.0.0' '--tags=task_name:kefka-release/R57-9198.0.0-paygen_au_canary' '--tags=board:kefka' -- /usr/local/autotest/site_utils/run_suite.py --build kefka-release/R57-9198.0.0 --board kefka --suite_name paygen_au_canary --pool bvt --file_bugs True --priority Build --timeout_mins 180 --retry True --suite_min_duts 2 -m 96808164
00:00:47: INFO: Refreshing due to a 401 (attempt 1/2)
00:00:47: INFO: Refreshing access_token
00:00:49: WARNING: HttpsMonitor.send received status 429: {
  "error": {
    "code": 429,
    "message": "Resource has been exhausted (e.g. check quota).",
    "status": "RESOURCE_EXHAUSTED"
  }
}

01:04:15: INFO: Refreshing due to a 401 (attempt 1/2)
01:04:15: INFO: Refreshing access_token
01:05:16: WARNING: HttpsMonitor.send received status 429: {
  "error": {
    "code": 429,
    "message": "Resource has been exhausted (e.g. check quota).",
    "status": "RESOURCE_EXHAUSTED"
  }
}

These involve timeouts so I am not sure if this is a new problem, or just additional logging that's been added recently.

For instance:

https://uberchromegw.corp.google.com/i/chromeos/builders/kefka-release/builds/776/steps/PaygenTestCanary/logs/stdio