ios-simulator-full-configs green while some tests fails |
|||
Issue descriptionSee for example this run: https://build.chromium.org/p/chromium.mac/builders/ios-simulator-full-configs/builds/663 CredentialManagerEGTest/* tests from ios_chrome_integration_egtests have failed, but ios_chrome_integration_egtests is still green and whole test run is considered as a success; downstream bots are correctly marked as failed, compare with: https://uberchromegw.corp.google.com/i/internal.bling.main/builders/iphone11-device-x64/builds/1179
,
Nov 20 2017
Here retry-on-failure really mess up because the test only fail if run as part of the full suite. If run individually (or skipping all tests coming before) they pass. I think this is because they depend on some global state that is messed up by another test run before :-/
,
Nov 20 2017
huangml: Please reassign if this isn't yours.
,
Nov 20 2017
I think CredentialManagerEGTest fails because "--enable-features=SlimNavigationManager" is not passed in to integration_egtest suite. Same test with the flag is working fine on chromium.fyi. But not sure why they'll pass on retries. https://logs.chromium.org/v/?s=chromium%2Fbb%2Fchromium.fyi%2Fios-simulator%2F13049%2F%2B%2Frecipes%2Fsteps%2Fios_chrome_integration_egtests__iPhone_6s_iOS_11.0_%2F0%2Fstdout
,
Nov 23 2017
Can it be related to issue 788201's root cause (yet to be determined)?
,
May 31 2018
|
|||
►
Sign in to add a comment |
|||
Comment 1 by baxley@chromium.org
, Nov 20 2017