Currently auto revert will only revert newly-added tests within 24 hours. This window is generally safe to auto revert upon detection as it is unlikely the test is discovered to be flaky and fixed within that time by a human, however later we may auto revert other high-confidence results as well.

A safety measure for existing tests may be to check flakiness in a recent build before auto-reverting (which previously was implied by the check for having a bug associated, however due to limitations in bug filing this check was removed due to inaccuracies, e.g. hitting the daily bug limit causing it to bail out thus auto revert too would bail out)