analysis of builds of past 10 days: builder "Infra Presubmit" searching for all builds since 2016-06-12 17:09:06.554257891 -0700 PDT... patch/gerrit/chromium-review.googlesource.com/353352/2 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f88fa81aa4f6a10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2507 patch/gerrit/chromium-review.googlesource.com/351773/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f63db5974b12510 FAILURE https://luci-milo.appspot.com/swarming/prod/2f6391b1e2731710 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2311 FAILURE https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2308 FAILURE https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2307 patch/rietveld/codereview.chromium.org/2060753009/1 is inconsistent SUCCESS https://luci-milo.appspot.com/swarming/prod/2f6a285111421310 SUCCESS https://luci-milo.appspot.com/swarming/prod/2f6a2118e5f97710 SUCCESS https://luci-milo.appspot.com/swarming/prod/2f6a12c697268e10 FAILURE https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2345 patch/gerrit/chromium-review.googlesource.com/352243/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f651a1048629410 FAILURE https://luci-milo.appspot.com/swarming/prod/2f65192c4a01ef10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2329 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2328 patch/gerrit/chromium-review.googlesource.com/354112/3 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f88ec6f7cca4d10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2504 patch/gerrit/chromium-review.googlesource.com/354112/2 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f88288e8c212d10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2492 patch/gerrit/chromium-review.googlesource.com/352670/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f6a1668c7a0f110 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2350 FAILURE https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2346 patch/gerrit/chromium-review.googlesource.com/352057/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f645af9c39ab710 FAILURE https://luci-milo.appspot.com/swarming/prod/2f642b8863039210 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2315 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2312 patch/gerrit/chromium-review.googlesource.com/354260/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f892de90a371910 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2508 patch/gerrit/chromium-review.googlesource.com/352817/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f6f5eb0d8390f10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2380 patch/gerrit/chromium-review.googlesource.com/353352/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f88ee62bf023e10 FAILURE https://luci-milo.appspot.com/swarming/prod/2f74882715d5c910 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2505 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2427 patch/gerrit/chromium-review.googlesource.com/353481/2 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f7491a20bf2b110 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2428 patch/gerrit/chromium-review.googlesource.com/354112/4 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f88fa9a13052510 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2506 patch/gerrit/chromium-review.googlesource.com/352242/2 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f64ebe6371bf210 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2325 patch/gerrit/chromium-review.googlesource.com/353251/5 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f8d9d534bd79210 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2538 patch/gerrit/chromium-review.googlesource.com/352741/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f6f22dfb1c0f010 FAILURE https://luci-milo.appspot.com/swarming/prod/2f6f1e4670f23410 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2376 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2375 patch/gerrit/chromium-review.googlesource.com/353481/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f74762185c65010 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2424 patch/gerrit/chromium-review.googlesource.com/352817/2 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f739587112b3610 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2408 patch/gerrit/chromium-review.googlesource.com/352242/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f64bfc387260310 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2323 patch/gerrit/chromium-review.googlesource.com/353045/3 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f73f79b441f5b10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2413 patch/gerrit/chromium-review.googlesource.com/352670/3 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f6f1c0a12a28a10 FAILURE https://luci-milo.appspot.com/swarming/prod/2f6a62a5a8a23710 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2374 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2355 91.86% consistent build sets, 288 buildbot builds, 284 swarming builds
All these inconsistencies were due to issue 617472 and one flake on buildbot. This builder WAI
Analysis of builds that were scheduled since last analysis: searching for all builds since timestamp 1466640788 (98h32m14.99783346s ago)... skipped build 9009015842948592256 skipped build 9009025325370070736 patch/rietveld/codereview.chromium.org/2098613002/1 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f976557c60ffb10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2607 patch/gerrit/chromium-review.googlesource.com/353251/10 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2f97e57c7c87c210 FAILURE https://luci-milo.appspot.com/swarming/prod/2f97da0ff1cced10 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2614 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2613 96.83% consistent build sets, 65 buildbot builds, 67 swarming builds
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra.git/+/df10537c1d3778b89e2ac72a7e91c3c818983b94 commit df10537c1d3778b89e2ac72a7e91c3c818983b94 Author: nodir <nodir@chromium.org> Date: Tue Jun 28 23:14:15 2016 add swarmbucketcheck swarmbucketcheck is a tool that finds discrepancies between buildbot and swarming builds R=vadimsh@chromium.org BUG= 622950 Review-Url: https://codereview.chromium.org/2110453002 [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/OWNERS [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/README.md [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/cmd/swarmbucketcheck/.gitignore [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/cmd/swarmbucketcheck/README.md [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/cmd/swarmbucketcheck/infra-builders [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/cmd/swarmbucketcheck/luci-py-builders [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/cmd/swarmbucketcheck/main.go [add] https://crrev.com/df10537c1d3778b89e2ac72a7e91c3c818983b94/go/src/infra/tools/swarming-transition/cmd/swarmbucketcheck/swarmbucketcheck.infra_testing
https://luci-milo.appspot.com/swarming/prod/2f976557c60ffb10/steps/gclient_runhooks/0/stdout failed because of a gitiles flake, but cros_chromite treated it incorrectly. Addressing it in https://codereview.chromium.org/2108713004
swarming builds for chromium-review.googlesource.com/353251 failed because of issue 617472 this builder WAI
The following revision refers to this bug: https://chromium.googlesource.com/chromium/tools/build.git/+/bad355222fd53b0e8e238b7c84dab67f23e6f93c commit bad355222fd53b0e8e238b7c84dab67f23e6f93c Author: nodir <nodir@chromium.org> Date: Wed Jun 29 15:33:02 2016 chromite: check response status code ChromiteFetcher._GetText does not check response status code. Presumably it caused https://luci-milo.appspot.com/swarming/prod/2f976557c60ffb10/steps/gclient_runhooks/0/stdout R=dnj@chromium.org BUG= 622950 Review-Url: https://codereview.chromium.org/2108713004 [modify] https://crrev.com/bad355222fd53b0e8e238b7c84dab67f23e6f93c/scripts/common/cros_chromite.py
Moving this nonessential bug to the next milestone. For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
New consistency report: searching for all builds since timestamp 1466985600 till 1468017107... no buildbot builds for buildset patch/rietveld/codereview.chromium.org/2106643003/20001 no buildbot builds for buildset patch/rietveld/codereview.chromium.org/2133543002/1 patch/rietveld/codereview.chromium.org/2110963002/20001 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2fbccbb6229fe910 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2867 patch/rietveld/codereview.chromium.org/2105563002/1 is inconsistent SUCCESS https://luci-milo.appspot.com/swarming/prod/2fad3668efcdaf10 FAILURE https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2718 patch/rietveld/codereview.chromium.org/2109393002/20001 is inconsistent FAILURE https://luci-milo.appspot.com/swarming/prod/2fbca3aa8fc6e510 SUCCESS https://build.chromium.org/p/tryserver.infra/builders/Infra%20Presubmit/builds/2864 99.02% consistent build sets, 362 buildbot builds, 349 swarming builds swarming is 1.3x slower median times: buildbot 1m15s, swarming 1m41s
the inconsistencies in the last report are due to - presubmit hang - patch failure, CL was landed manually - gerrit flake
Comment 1 by no...@chromium.org
, Jun 24 2016