New issue
Advanced search Search tips

Issue 766953 link

Starred by 3 users

Issue metadata

Status: Assigned
Owner:
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: ----



Sign in to add a comment

SAMLTest/SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI flaky

Project Member Reported by vitaliii@chromium.org, Sep 20 2017

Issue description

browser_tests failing on chromium.memory/Linux Chromium OS ASan LSan Tests (1)

Builders failed on: 
- Linux Chromium OS ASan LSan Tests (1): 
  https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29



 
5 builds are red out of last 7 ones.
error log starts the same and then diverges. One example:

========
[8063:8063:0919/145446.128792:ERROR:input_method_manager_impl.cc(1028)] IMEEngine for "fgoepimhcoialccpbmpnnblemnepkkao" is not registered
[8063:8176:0919/145446.332707:WARNING:child_process_launcher_helper_posix.cc(118)] Ignoring invalid file v8_context_snapshot.bin
[8063:8162:0919/145446.532114:WARNING:freezer_cgroup_process_manager.cc(62)] Cgroup freezer does not exist or is not writable. Unable to freeze renderer processes.
[8063:8063:0919/145446.676819:ERROR:network_profile_handler.cc(83)] Manager properties returned from Shill don't contain the field Profiles
[8063:8063:0919/145446.677246:ERROR:network_sms_handler.cc(414)] NetworkSmsHandler: No list value for: Devices
[8063:8063:0919/145448.869498:ERROR:touch_devices_controller.cc(22)] Failed to set touchpad enabled state.
[8063:8063:0919/145453.243810:WARNING:CONSOLE(0)] "Styling master document from stylesheets defined in HTML Imports is deprecated, and is planned to be removed in M65, around March 2018. Please refer to https://goo.gl/EGXzpw for possible migration paths.", source:  (0)
[8063:8063:0919/145459.662185:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList
[8063:8063:0919/145505.213878:ERROR:device_event_log_impl.cc(156)] [14:55:05.213] Network: network_state_handler.cc:185 SetTechnologyEnabled() called for the Tether DeviceState, but the current state was: 0
[8063:8063:0919/145505.287839:INFO:CONSOLE(9487)] "Loading asset bundle oauth-enrollment", source: chrome://oobe/oobe.js (9487)
[8063:8063:0919/145505.330730:INFO:lock_screen_utils.cc(56)] GetUserLastInputMethod: no input method for this user
[8063:8063:0919/145508.865855:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList
[8063:8063:0919/145509.548338:INFO:signin_screen_handler.cc(1387)] Login WebUI >> active: 1, source: gaia-signin
[8063:8176:0919/145510.080018:WARNING:child_process_launcher_helper_posix.cc(118)] Ignoring invalid file v8_context_snapshot.bin
[8063:8063:0919/145510.337402:WARNING:error_screen.cc(193)] Network error screen message is shown
[8063:8063:0919/145511.040758:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList
[8063:8063:0919/145511.106685:INFO:signin_screen_handler.cc(1387)] Login WebUI >> active: 0, source: gaia-signin
[8063:8411:0919/145511.160531:WARNING:fake_gaia.cc(321)] Serving request /embedded/setup/v2/chromeos
127.0.0.1 - - [19/Sep/2017 14:55:11] "GET /embedded/setup/v2/chromeos?chrometype=chromedevice&client_id=dummytoken&client_version=63.0.3220.0&platform_version=0.0.0.0&endpoint_gen=1.0&mi=gm%2Cee%2C&hl=en-US HTTP/1.1" 200 -
[8063:8063:0919/145511.296972:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList
[8063:8063:0919/145511.446171:ERROR:CONSOLE(10004)] "TypeError: Cannot read property 'showStep' of null
    at Object.api.(anonymous function) [as showStep] (chrome://oobe/oobe.js:416:28)
    at <anonymous>:1:29", source: chrome://oobe/oobe.js (10004)
[8063:8063:0919/145511.446924:ERROR:CONSOLE(416)] "Uncaught TypeError: Cannot read property 'showStep' of null", source: chrome://oobe/oobe.js (416)
[8063:8063:0919/145511.900126:INFO:CONSOLE(9471)] "Finished loading asset bundle oauth-enrollment", source: chrome://oobe/oobe.js (9471)
[8063:8411:0919/145513.130918:ERROR:fake_gaia.cc(324)] Unhandled request /favicon.ico
[8063:8411:0919/145513.131285:WARNING:embedded_test_server.cc(229)] Request not handled. Returning 404: /favicon.ico
127.0.0.1 - - [19/Sep/2017 14:55:13] "GET /favicon.ico HTTP/1.1" 404 -
[8063:8063:0919/145513.148575:WARNING:enrollment_screen_handler.cc(467)] EnrollmentScreenHandler::UpdateState(): state=offline, reason=update
[8063:8063:0919/145514.177023:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.182852:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8411:0919/145514.292388:WARNING:fake_gaia.cc(321)] Serving request /embedded/setup/chromeos
127.0.0.1 - - [19/Sep/2017 14:55:14] "GET /embedded/setup/chromeos?client_id=dummytoken&hl=en-US&flow=enterprise HTTP/1.1" 200 -
[8063:8063:0919/145514.371179:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.372913:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.851439:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.853816:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.856465:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.914362:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.915851:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145514.918037:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147)
[8063:8063:0919/145519.701288:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList
[8063:8063:0919/145529.707803:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList
[8063:8063:0919/145539.706942:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList
========
I don't see related CLs in https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23728. Also the tests file was not touched recently as well as input_method_manager_impl.cc.
I've also checked the previous build 

https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23727

https://chromium-review.googlesource.com/666331 feels slightly related because it touches signin_screen_handler.cc, which is mentioned in the log.

I am disabling the tests.
Cc: alemate@chromium.org
Labels: -Sheriff-Chromium
Owner: xiy...@chromium.org
Status: Assigned (was: Started)
Could you redirect please?
Summary: SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI flaky on chromium.memory/Linux Chromium OS ASan LSan Tests (1) and Linux ChromiumOS Tests (was: browser_tests failing on chromium.memory/Linux Chromium OS ASan LSan Tests (1))
They are also flaky on Linux ChromiumOS Tests

https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29

2 fails out of 7 runs:

https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29/builds/30361

https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29/builds/30367
I am also disabling them on Chrome OS as well in the same CL.

The CL is https://chromium-review.googlesource.com/c/chromium/src/+/674864
Project Member

Comment 10 by bugdroid1@chromium.org, Sep 20 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/44981ca79807078dee70fec6dde7ea561e3097e7

commit 44981ca79807078dee70fec6dde7ea561e3097e7
Author: Vitalii Iarko <vitaliii@chromium.org>
Date: Wed Sep 20 09:51:27 2017

Disable SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI.

Disable them on ASAN/ChromeOS, because they are flaky.

TBR: xiyuan@chromium.org
Bug: 766953
Change-Id: I4281ab485c5668ec15675304ee1a7396b9879e2f
Reviewed-on: https://chromium-review.googlesource.com/674864
Commit-Queue: vitaliii <vitaliii@chromium.org>
Reviewed-by: vitaliii <vitaliii@chromium.org>
Cr-Commit-Position: refs/heads/master@{#503096}
[modify] https://crrev.com/44981ca79807078dee70fec6dde7ea561e3097e7/chrome/browser/chromeos/login/saml/saml_browsertest.cc

Cc: achuith@chromium.org
Components: Tests>Flaky Enterprise
Labels: -Pri-1 OS-Chrome Pri-2
Summary: SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI flaky (was: SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI flaky on chromium.memory/Linux Chromium OS ASan LSan Tests (1) and Linux ChromiumOS Tests)
Summary: SAMLTest/SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI flaky (was: SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI flaky)
 Issue 659992  has been merged into this issue.

Comment 15 by emaxx@chromium.org, Apr 12 2018

Cc: atwilson@chromium.org ljusten@chromium.org emaxx@chromium.org
+some enterprise folks - it's worrying that these important tests of SAML flow have been disabled for a long time (especially: SAMLEnrollmentTest.WithoutCredentialsPassingAPI and SAMLEnrollmentTest.WithCredentialsPassingAPI on Chrome OS and SamlTest.CredentialPassingAPI on Linux).

Sign in to add a comment