Below are two recent examples. https://findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVypwELEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCJxY2hyb21pdW0ud2luL1dpbjcgVGVzdHMgKGRiZykoMSkvNTk5MTcvYnJvd3Nlcl90ZXN0cy9RMjl0Y0c5dVpXNTBRMnh2ZFdSUWIyeHBZM2xVWlhOMExrbHVjM1JoYkd4T1pYZEZlSFJsYm5OcGIyND0MCxITTWFzdGVyRmxha2VBbmFseXNpcxgBDA https://findit-for-me.appspot.com/waterfall/flake?key=ag9zfmZpbmRpdC1mb3ItbWVytAILEhdNYXN0ZXJGbGFrZUFuYWx5c2lzUm9vdCL9AWNocm9taXVtLndpbi9XaW43IFRlc3RzIChkYmcpKDEpLzU5OTU3L2Jyb3dzZXJfdGVzdHMvVUhKbFpraGhjMmhDY205M2MyVnlWR1Z6ZEZWdWRISjFjM1JsWkVGa1pHbDBhVzl1Vkc5UWNtVm1jMEZtZEdWeVYybHdaVWx1YzNSaGJtTmxMMUJ5WldaSVlYTm9Rbkp2ZDNObGNsUmxjM1JWYm5SeWRYTjBaV1JCWkdScGRHbHZibFJ2VUhKbFpuTkJablJsY2xkcGNHVXVWVzUwY25WemRHVmtRV1JrYVhScGIyNVViMUJ5WldaelFXWjBaWEpYYVhCbEx6TT0MCxITTWFzdGVyRmxha2VBbmFseXNpcxgBDA
Design doc here: https://docs.google.com/a/google.com/document/d/1DiYSzSkzG_IGZuRIjjU2likdclW6T2dVUSF1yE7Cuyk/edit?usp=sharing
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/1638435172301dc74285c0cdab7fe9ab96a8db67 commit 1638435172301dc74285c0cdab7fe9ab96a8db67 Author: Brandon Wylie <wylieb@chromium.org> Date: Tue Jul 25 00:22:40 2017 [Findit] Flake Analyzer - Fix swarming timeouts for large iterations. This breaks up test iterations into 1-hour pieces. It calculates how many tests can run under that time constraint, and executes the 'buckets' until there are no more iterations to run. Bug:722547 Change-Id: I6903bb7b1e750d9ce7ef0ac821c75cdfc630386d Reviewed-on: https://chromium-review.googlesource.com/574696 Reviewed-by: Jeffrey Li <lijeffrey@chromium.org> Commit-Queue: Jeffrey Li <lijeffrey@chromium.org> [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/waterfall/test/waterfall_config_test.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/handlers/test/config_test.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/waterfall/test/wf_testcase.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/waterfall/flake/recursive_flake_pipeline.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/model/flake/test/master_flake_analysis_test.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/handlers/config.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/waterfall/flake/test/recursive_flake_pipeline_test.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/model/flake/master_flake_analysis.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/waterfall/flake/update_flake_analysis_data_points_pipeline.py [modify] https://crrev.com/1638435172301dc74285c0cdab7fe9ab96a8db67/appengine/findit/model/wf_config.py
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/82cb49e7e7224e43bda371361ecc5465c45d030d commit 82cb49e7e7224e43bda371361ecc5465c45d030d Author: Jeffrey Li <lijeffrey@chromium.org> Date: Thu Jul 27 20:18:59 2017 Revert "[Findit] Flake Analyzer - Fix swarming timeouts for large iterations." This reverts commit 1638435172301dc74285c0cdab7fe9ab96a8db67. Reason for revert: <INSERT REASONING HERE> Original change's description: > [Findit] Flake Analyzer - Fix swarming timeouts for large iterations. > > This breaks up test iterations into 1-hour pieces. It calculates how many tests > can run under that time constraint, and executes the 'buckets' until there are > no more iterations to run. > > Bug:722547 > Change-Id: I6903bb7b1e750d9ce7ef0ac821c75cdfc630386d > Reviewed-on: https://chromium-review.googlesource.com/574696 > Reviewed-by: Jeffrey Li <lijeffrey@chromium.org> > Commit-Queue: Jeffrey Li <lijeffrey@chromium.org> TBR=robertocn@chromium.org,lijeffrey@chromium.org,chanli@chromium.org,wylieb@chromium.org # Not skipping CQ checks because original CL landed > 1 day ago. Bug: 722547 Change-Id: I079bd3d5b2c0f02fda12c788e0520347282b9a93 Reviewed-on: https://chromium-review.googlesource.com/590097 Reviewed-by: Jeffrey Li <lijeffrey@chromium.org> Reviewed-by: Chan Li <chanli@chromium.org> Commit-Queue: Jeffrey Li <lijeffrey@chromium.org> [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/waterfall/test/waterfall_config_test.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/handlers/test/config_test.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/waterfall/test/wf_testcase.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/waterfall/flake/recursive_flake_pipeline.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/model/flake/test/master_flake_analysis_test.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/handlers/config.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/waterfall/flake/test/recursive_flake_pipeline_test.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/model/flake/master_flake_analysis.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/waterfall/flake/update_flake_analysis_data_points_pipeline.py [modify] https://crrev.com/82cb49e7e7224e43bda371361ecc5465c45d030d/appengine/findit/model/wf_config.py
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/f1cf828510416ff0b5d8af6e564c257762f7d61d commit f1cf828510416ff0b5d8af6e564c257762f7d61d Author: Brandon Wylie <wylieb@chromium.org> Date: Fri Aug 25 17:33:43 2017 [Findit] Flake Analyzer - FindTruePassRatePipeline so iterations not needed. Implemented the FindTruePassRatePipeline that samples the test to find out if the pass rate has converged. This eliminates the need for storing/using iterations. Bug:722547 Change-Id: Ieca5c984481586c807171ba28c71c18fe72dd36e Reviewed-on: https://chromium-review.googlesource.com/614287 Commit-Queue: Brandon Wylie <wylieb@chromium.org> Reviewed-by: Chan Li <chanli@chromium.org> Reviewed-by: Jeffrey Li <lijeffrey@chromium.org> [add] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/test/determine_true_pass_rate_pipeline_test.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/handlers/test/config_test.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/test/wf_testcase.py [add] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/test/analyze_flake_for_build_number_pipeline_test.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/test/flake_analysis_util_test.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/recursive_flake_pipeline.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/model/flake/test/master_flake_analysis_test.py [add] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/analyze_flake_for_build_number_pipeline.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/handlers/config.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/next_build_number_pipeline.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/flake_analysis_util.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/model/flake/master_flake_analysis.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/flake_constants.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/update_flake_analysis_data_points_pipeline.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/test/waterfall_config_test.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/test/recursive_flake_pipeline_test.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/test/next_build_number_pipeline_test.py [modify] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/model/wf_config.py [add] https://crrev.com/f1cf828510416ff0b5d8af6e564c257762f7d61d/appengine/findit/waterfall/flake/determine_true_pass_rate_pipeline.py
Comment 1 by wylieb@chromium.org
, May 17 2017