[Findit] Flake Analyzer - Determine to reuse or update data points based on user input |
||
Issue descriptionIf the user requests an analysis on a range that Findit has already analyzed but specifies a higher iteration count, some data points may need to be updated. 1. If the data point is stable with n = 100 runs, but the user specified n = 200 runs, the data point needs to be rerun and updated. 2. If the data point is flaky with n = anything, it can be reused since it's already been determined to be flaky regardless of what the user specifies for number of iterations. 3. If the data point is stable with n = 200 runs and the user requests n = 100 runs, the data point can be reused.
,
Jun 6 2017
The following revision refers to this bug: https://chromium.googlesource.com/infra/infra/+/99ce116a2f9931bc38bc120ddc46ebe9acf72e03 commit 99ce116a2f9931bc38bc120ddc46ebe9acf72e03 Author: Jeffrey Li <lijeffrey@chromium.org> Date: Tue Jun 06 20:54:49 2017 [Findit] Flake Analyzer - Discard stable points with too few iterations during manual rerun Bug: 727888 Change-Id: I9f924195905feb3e230b611ae56461718566a485 Reviewed-on: https://chromium-review.googlesource.com/520669 Commit-Queue: Jeffrey Li <lijeffrey@chromium.org> Reviewed-by: Chan Li <chanli@chromium.org> [modify] https://crrev.com/99ce116a2f9931bc38bc120ddc46ebe9acf72e03/appengine/findit/waterfall/flake/regression_range_analysis_pipeline.py [modify] https://crrev.com/99ce116a2f9931bc38bc120ddc46ebe9acf72e03/appengine/findit/waterfall/flake/recursive_flake_pipeline.py [modify] https://crrev.com/99ce116a2f9931bc38bc120ddc46ebe9acf72e03/appengine/findit/waterfall/flake/lookback_algorithm.py [modify] https://crrev.com/99ce116a2f9931bc38bc120ddc46ebe9acf72e03/appengine/findit/model/flake/test/master_flake_analysis_test.py [modify] https://crrev.com/99ce116a2f9931bc38bc120ddc46ebe9acf72e03/appengine/findit/waterfall/flake/test/recursive_flake_pipeline_test.py [modify] https://crrev.com/99ce116a2f9931bc38bc120ddc46ebe9acf72e03/appengine/findit/model/flake/master_flake_analysis.py [modify] https://crrev.com/99ce116a2f9931bc38bc120ddc46ebe9acf72e03/appengine/findit/waterfall/flake/test/regression_range_analysis_pipeline_test.py
,
Jun 6 2017
|
||
►
Sign in to add a comment |
||
Comment 1 by lijeffrey@chromium.org
, Jun 5 2017