Flake detection idea: automatically update and close a filed flake bug if that flake is not seen anymore |
||
Issue descriptionMight be a nice feature to have in the new flake detection logic. One caveat is that: If a flake is not seen anymore, the logic needs to make sure that that test is still running instead of being disabled. This can work with Flake Analyzer as a tool to help developers verify a flake is fixed!
,
Dec 27
+lijeffrey for more inputs. Currently we'll periodically check open bugs and save the updates to our datastore. But we'll not auto-close/auto-ping if the flakes stops to show up. Not sure if that's in a plan. For verifying a flake is fixed, we already have another solution: FA can run the test for certain iterations on tip-of-tree. In that sense I also lower the priority since this feature is more helpful on cleaning up stale issues. |
||
►
Sign in to add a comment |
||
Comment 1 by liaoyuke@chromium.org
, Aug 2