If a test fails in 'with patch', and isn't found in 'without patch', then it's a newly introduced test [or else a renamed test]. 

It's highly likely that the CL is responsible for the failure/flakiness, so we should skip subsequent retry steps.