SAMLTest/SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI flaky |
|||||||
Issue descriptionbrowser_tests failing on chromium.memory/Linux Chromium OS ASan LSan Tests (1) Builders failed on: - Linux Chromium OS ASan LSan Tests (1): https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29
,
Sep 20 2017
Failures summary https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23728 (first red) SAMLEnrollmentTest.WithCredentialsPassingAPI SAMLEnrollmentTest.WithoutCredentialsPassingAPI https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23730 SAMLEnrollmentTest.WithCredentialsPassingAPI https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23731 SAMLEnrollmentTest.WithoutCredentialsPassingAPI https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23733 SAMLEnrollmentTest.WithCredentialsPassingAPI SAMLEnrollmentTest.WithoutCredentialsPassingAPI https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23734 SAMLEnrollmentTest.WithCredentialsPassingAPI
,
Sep 20 2017
error log starts the same and then diverges. One example: ======== [8063:8063:0919/145446.128792:ERROR:input_method_manager_impl.cc(1028)] IMEEngine for "fgoepimhcoialccpbmpnnblemnepkkao" is not registered [8063:8176:0919/145446.332707:WARNING:child_process_launcher_helper_posix.cc(118)] Ignoring invalid file v8_context_snapshot.bin [8063:8162:0919/145446.532114:WARNING:freezer_cgroup_process_manager.cc(62)] Cgroup freezer does not exist or is not writable. Unable to freeze renderer processes. [8063:8063:0919/145446.676819:ERROR:network_profile_handler.cc(83)] Manager properties returned from Shill don't contain the field Profiles [8063:8063:0919/145446.677246:ERROR:network_sms_handler.cc(414)] NetworkSmsHandler: No list value for: Devices [8063:8063:0919/145448.869498:ERROR:touch_devices_controller.cc(22)] Failed to set touchpad enabled state. [8063:8063:0919/145453.243810:WARNING:CONSOLE(0)] "Styling master document from stylesheets defined in HTML Imports is deprecated, and is planned to be removed in M65, around March 2018. Please refer to https://goo.gl/EGXzpw for possible migration paths.", source: (0) [8063:8063:0919/145459.662185:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList [8063:8063:0919/145505.213878:ERROR:device_event_log_impl.cc(156)] [14:55:05.213] Network: network_state_handler.cc:185 SetTechnologyEnabled() called for the Tether DeviceState, but the current state was: 0 [8063:8063:0919/145505.287839:INFO:CONSOLE(9487)] "Loading asset bundle oauth-enrollment", source: chrome://oobe/oobe.js (9487) [8063:8063:0919/145505.330730:INFO:lock_screen_utils.cc(56)] GetUserLastInputMethod: no input method for this user [8063:8063:0919/145508.865855:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList [8063:8063:0919/145509.548338:INFO:signin_screen_handler.cc(1387)] Login WebUI >> active: 1, source: gaia-signin [8063:8176:0919/145510.080018:WARNING:child_process_launcher_helper_posix.cc(118)] Ignoring invalid file v8_context_snapshot.bin [8063:8063:0919/145510.337402:WARNING:error_screen.cc(193)] Network error screen message is shown [8063:8063:0919/145511.040758:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList [8063:8063:0919/145511.106685:INFO:signin_screen_handler.cc(1387)] Login WebUI >> active: 0, source: gaia-signin [8063:8411:0919/145511.160531:WARNING:fake_gaia.cc(321)] Serving request /embedded/setup/v2/chromeos 127.0.0.1 - - [19/Sep/2017 14:55:11] "GET /embedded/setup/v2/chromeos?chrometype=chromedevice&client_id=dummytoken&client_version=63.0.3220.0&platform_version=0.0.0.0&endpoint_gen=1.0&mi=gm%2Cee%2C&hl=en-US HTTP/1.1" 200 - [8063:8063:0919/145511.296972:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList [8063:8063:0919/145511.446171:ERROR:CONSOLE(10004)] "TypeError: Cannot read property 'showStep' of null at Object.api.(anonymous function) [as showStep] (chrome://oobe/oobe.js:416:28) at <anonymous>:1:29", source: chrome://oobe/oobe.js (10004) [8063:8063:0919/145511.446924:ERROR:CONSOLE(416)] "Uncaught TypeError: Cannot read property 'showStep' of null", source: chrome://oobe/oobe.js (416) [8063:8063:0919/145511.900126:INFO:CONSOLE(9471)] "Finished loading asset bundle oauth-enrollment", source: chrome://oobe/oobe.js (9471) [8063:8411:0919/145513.130918:ERROR:fake_gaia.cc(324)] Unhandled request /favicon.ico [8063:8411:0919/145513.131285:WARNING:embedded_test_server.cc(229)] Request not handled. Returning 404: /favicon.ico 127.0.0.1 - - [19/Sep/2017 14:55:13] "GET /favicon.ico HTTP/1.1" 404 - [8063:8063:0919/145513.148575:WARNING:enrollment_screen_handler.cc(467)] EnrollmentScreenHandler::UpdateState(): state=offline, reason=update [8063:8063:0919/145514.177023:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.182852:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8411:0919/145514.292388:WARNING:fake_gaia.cc(321)] Serving request /embedded/setup/chromeos 127.0.0.1 - - [19/Sep/2017 14:55:14] "GET /embedded/setup/chromeos?client_id=dummytoken&hl=en-US&flow=enterprise HTTP/1.1" 200 - [8063:8063:0919/145514.371179:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.372913:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.851439:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.853816:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.856465:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.914362:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.915851:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145514.918037:WARNING:CONSOLE(18147)] "Unrecognized message from GAIA: clearOldAttempts", source: chrome://oobe/oobe.js (18147) [8063:8063:0919/145519.701288:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList [8063:8063:0919/145529.707803:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList [8063:8063:0919/145539.706942:ERROR:fake_shill_manager_client.cc(963)] Notify for unknown property: ServiceCompleteList ========
,
Sep 20 2017
I don't see related CLs in https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23728. Also the tests file was not touched recently as well as input_method_manager_impl.cc.
,
Sep 20 2017
I've also checked the previous build https://build.chromium.org/p/chromium.memory/builders/Linux%20Chromium%20OS%20ASan%20LSan%20Tests%20%281%29/builds/23727 https://chromium-review.googlesource.com/666331 feels slightly related because it touches signin_screen_handler.cc, which is mentioned in the log. I am disabling the tests.
,
Sep 20 2017
Could you redirect please?
,
Sep 20 2017
also flakiness dashboard https://test-results.appspot.com/dashboards/flakiness_dashboard.html#tests=SAMLEnrollmentTest
,
Sep 20 2017
They are also flaky on Linux ChromiumOS Tests https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29 2 fails out of 7 runs: https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29/builds/30361 https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29/builds/30367
,
Sep 20 2017
I am also disabling them on Chrome OS as well in the same CL. The CL is https://chromium-review.googlesource.com/c/chromium/src/+/674864
,
Sep 20 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/44981ca79807078dee70fec6dde7ea561e3097e7 commit 44981ca79807078dee70fec6dde7ea561e3097e7 Author: Vitalii Iarko <vitaliii@chromium.org> Date: Wed Sep 20 09:51:27 2017 Disable SAMLEnrollmentTest.{With,Without}CredentialsPassingAPI. Disable them on ASAN/ChromeOS, because they are flaky. TBR: xiyuan@chromium.org Bug: 766953 Change-Id: I4281ab485c5668ec15675304ee1a7396b9879e2f Reviewed-on: https://chromium-review.googlesource.com/674864 Commit-Queue: vitaliii <vitaliii@chromium.org> Reviewed-by: vitaliii <vitaliii@chromium.org> Cr-Commit-Position: refs/heads/master@{#503096} [modify] https://crrev.com/44981ca79807078dee70fec6dde7ea561e3097e7/chrome/browser/chromeos/login/saml/saml_browsertest.cc
,
Apr 12 2018
,
Apr 12 2018
,
Apr 12 2018
,
Apr 12 2018
Issue 659992 has been merged into this issue.
,
Apr 12 2018
+some enterprise folks - it's worrying that these important tests of SAML flow have been disabled for a long time (especially: SAMLEnrollmentTest.WithoutCredentialsPassingAPI and SAMLEnrollmentTest.WithCredentialsPassingAPI on Chrome OS and SamlTest.CredentialPassingAPI on Linux). |
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by vitaliii@chromium.org
, Sep 20 2017