New issue
Advanced search Search tips

Issue 632084 link

Starred by 2 users

Issue metadata

Status: WontFix
Owner: ----
Closed: Jul 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 2
Type: Bug



Sign in to add a comment

Builder: Android WebView CTS L-MR1 (dbg) is somewhat flaky

Project Member Reported by hartma...@chromium.org, Jul 27 2016

Issue description

@@@STEP_CURSOR@Read test result and report failures@@@
@@@STEP_STARTED@@@
@@@STEP_LINK@stdout-->stdio@https://luci-logdog.appspot.com/v/?s=chromium%2Fbb%2Fchromium.android%2FAndroid_WebView_CTS_L-MR1__dbg_%2F13967%2F%2B%2Frecipes%2Fsteps%2FRead_test_result_and_report_failures%2F0%2Fstdout@@@
python -u /tmp/tmpXLrcgY.py /b/c/android_cts/unzipped/android-cts/tools/../../android-cts/repository/results/2016.07.27_11.12.29/testResult.xml /tmp/tmp3d9kXt
in dir /b/c/b/Android_WebView_CTS_L_MR1__dbg_:
 cmd: ['python', '-u', '/tmp/tmpXLrcgY.py', '/b/c/android_cts/unzipped/android-cts/tools/../../android-cts/repository/results/2016.07.27_11.12.29/testResult.xml', '/tmp/tmp3d9kXt']
 cwd: /b/c/b/Android_WebView_CTS_L_MR1__dbg_
 env: {'GOMA_SERVICE_ACCOUNT_JSON_FILE': '/creds/service_accounts/service-account-goma-client.json', 'PATH': '/b/c/b/Android_WebView_CTS_L_MR1__dbg_/src/third_party/android_tools/sdk/platform-tools:/b/c/b/Android_WebView_CTS_L_MR1__dbg_/src/build/android:%(PATH)s'}
 name: Read test result and report failures
full environment:
 AWS_CREDENTIAL_FILE: /b/build/site_config/.boto
 BOTO_CONFIG: /b/build/site_config/.boto
 BUILDBOT_BLAMELIST: [u'aboxhall@chromium.org', u'altimin@chromium.org', u'bmcquade@chromium.org', u'catapult-deps-roller@chromium.org', u'dglazkov@chromium.org', u'dpranke@chromium.org', u'dtapuska@chromium.org', u'jialiul@chromium.org', u'luoe@chromium.org', u'lushnikov@chromium.org', u'machenbach@chromium.org', u'mcasas@chromium.org', u'mdjones@chromium.org', u'qyearsley@chromium.org', u'sebmarchand@chromium.org']
 BUILDBOT_BRANCH: master
 BUILDBOT_BUILDBOTURL: https://build.chromium.org/p/chromium.android/
 BUILDBOT_BUILDERNAME: Android WebView CTS L-MR1 (dbg)
 BUILDBOT_BUILDNUMBER: 13967
 BUILDBOT_CLOBBER: 
 BUILDBOT_GOT_REVISION: None
 BUILDBOT_MASTERNAME: chromium.android
 BUILDBOT_REVISION: df2307f88ab1411ce0dddfc92020d19345be47f5
 BUILDBOT_SCHEDULER: None
 BUILDBOT_SLAVENAME: build68-b1
 CHROME_HEADLESS: 1
 DISPLAY: :0.0
 GIT_USER_AGENT: linux2 git/2.9.2 build68-b1.labs.chromium.org
 GOMA_SERVICE_ACCOUNT_JSON_FILE: /creds/service_accounts/service-account-goma-client.json
 HOME: /home/chrome-bot
 LANG: en_US.UTF-8
 LOGNAME: chrome-bot
 PAGER: cat
 PATH: /b/c/b/Android_WebView_CTS_L_MR1__dbg_/src/third_party/android_tools/sdk/platform-tools:/b/c/b/Android_WebView_CTS_L_MR1__dbg_/src/build/android:/home/chrome-bot/slavebin:/b/depot_tools:/usr/bin:/usr/bin:/bin:/usr/sbin:/sbin:/usr/local/bin
 PWD: /b/build/slave/Android_WebView_CTS_L-MR1__dbg_/build
 PYTHONPATH: /b/build/site_config:/b/build/scripts:/b/build/scripts/release:/b/build/third_party:/b/build/third_party/requests_2_10_0:/b/build_internal/site_config:/b/build_internal/symsrc:/b/build/slave:/b/build/third_party/buildbot_slave_8_4:/b/build/third_party/twisted_10_2:
 SHELL: /bin/bash
 USER: chrome-bot

@@@STEP_TEXT@<br/>unexpected failures:<br/>android.webkit.cts.GeolocationTest#testSimpleGeolocationRequestAcceptAlways<br/>android.webkit.cts.GeolocationTest#testSimpleGeolocationRequestAcceptOnce<br/>@@@
@@@STEP_FAILURE@@@
Cc: boliu@chromium.org torne@chromium.org

Comment 3 by boliu@chromium.org, Jul 27 2016

Status: WontFix (was: Untriaged)
Do what normally happens, file bug and disable test if sheriff thinks it's a good idea

The way to disable those tests is to add an entry here: https://cs.chromium.org/chromium/src/android_webview/tools/cts_config/expected_failure_on_bot.json

cts traditionally hasn't been super stable, and the tests don't actually live in chromium code, so it just kinda sucks all around. so this bot is never going to be on cq/main waterfall, so a few flakes is probably ok

this bug itself sounds like a wontfix though?

Sign in to add a comment