Flakes reported for SyncCustomizationFragmentTest |
||
Issue description(Original e-mail thread in https://groups.google.com/a/chromium.org/d/msg/chromium-dev/dPAB5aUQeZg/lQGnXWf7CQAJ) Assigning to dpranke@ for triage and rerouting. We've received flakiness alerts for chrome_sync_shell_test_apk on Android and it's hard to understand what's going on. In particular, org.chromium.chrome.browser.sync.SyncCustomizationFragmentTest tests are affected, see blocked bug. In the flakiness dashboard (e.g. https://test-results.appspot.com/dashboards/flakiness_dashboard.html#showAllRuns=true&testType=chrome_sync_shell_test_apk&tests=SyncCustomizationFragmentTest.*testSetupOnly), tryserver.chromium.android is marked as VERYFLAKY, and hovering over a black cell says something like "PASS PASS PASS .", and I fail to find an example of a test failure. I seems like the tests do fail "with patch", but that hopefully doesn't get treated as a flake on trunk.
,
Nov 5
Sure. I'd like to ask a few clarify questions first. mastiz@: where did you get the flakiness alerts? Do you want to see only the flake occurrences of this test or you prefer to see all the runs of this test in the past?
,
Nov 12
Thanks! And sorry for the silence. The original flakes were reported by chromium-try-flakes@appspot.gserviceaccount.com, see blocked bug. Wrt what I'd ideally like: 1. I'd like my flakiness dashboard green :-) 2. If it's not green, I'd like to be able to find a failing test. 3. I'd like that runs "with patch" don't influence the flakiness dashboard. As described earlier, the "PASS PASS PASS " cases are currently not actionable for us, and it's not easy to distinguish these from real flakes. Here's a similar example: https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=sync_integration_tests&tests=TwoClientAppsSyncTest.StartWithDifferentApps
,
Dec 3
Friendly ping: is there any updates here?
,
Jan 11
This issue has an owner, a component and a priority, but is still listed as untriaged or unconfirmed. By definition, this bug is triaged. Changing status to "assigned". Please reach out to me if you disagree with how I've done this. |
||
►
Sign in to add a comment |
||
Comment 1 by dpranke@chromium.org
, Nov 5Owner: st...@chromium.org