Issue metadata
Sign in to add a comment
|
Many Android bots not showing results in the flakiness dashboard |
||||||||||||||||||||||||
Issue descriptionIt looks like the numerous bots on the public Android waterfalls are not uploading its results to the upstream flakiness dashboard. The only builders that are listed for chrome_public_test_apk are: - chromium.linux:Android Tests - chromium.android:Android Swarm Builder - chromium.android:Marshmallow 64 bit Tester - chromium.android.fyi:Android Cloud Tests I was expecting to see many more bots, e.g. - Marshmallow Tablet Tester - Lollipop Phone Tester - Lollipop Low-end Tester - KitKat Tablet Tester - Android Tests (dbg) etc. It looks like these bots also aren't uploading results for other tests suites. Fore example, content_shell_test_apk only lists Android Tests, Android Swarm Builder, Android N5X Swarm Builder, Marshmallow 64 bit Tester and Cloud Tests.
,
Oct 5 2016
... and test-results.appspot.com seems to think they're uploading? http://test-results.appspot.com/testfile?master=chromium.android&testtype=chrome_public_test_apk ... and they're uploading populated JSONs: http://test-results.appspot.com/testfile?builder=Lollipop%20Phone%20Tester&name=full_results.json&master=chromium.android&testtype=chrome_public_test_apk&buildnumber=7153
,
Oct 5 2016
So maybe it's an issue with the flakiness dashboard itself?
,
Oct 5 2016
AFAICT, yeah. The four bots that show up are all running tests on swarming, while the ones that aren't are running tests locally. That may also be involved?
,
Oct 5 2016
Looks like these builders aren't being detected when scraping buildbot for builders with chrome_public_test_apk steps. http://test-results.appspot.com/builders?callback=LOAD_BUILDBOT_DATA I might be able to figure this out but I'm getting on a flight soon.
,
Oct 6 2016
This is working now. The problem was due to issue 405799 where the associations are derived from the first build it sees, even if that build failed early and didn't include important steps. The problem could come back but the associations are correct now. |
|||||||||||||||||||||||||
►
Sign in to add a comment |
|||||||||||||||||||||||||
Comment 1 by jbudorick@chromium.org
, Oct 5 2016