New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 683161 link

Starred by 2 users

Issue metadata

Status: Verified
Owner:
Closed: May 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

SAMLPolicyTest.PRE_TransferCookiesUnaffiliated is flaky on Linux Chromium OS ASan LSan

Project Member Reported by jkrcal@chromium.org, Jan 20 2017

Issue description

The test SAMLPolicyTest.PRE_TransferCookiesUnaffiliated is rarely successful in the first run on the "Linux Chromium OS ASan LSan" bot.

+bartfab: You did touch the test for the last time...


The test dashboard:
https://test-results.appspot.com/dashboards/flakiness_dashboard.html#tests=SAMLPolicyTest.PRE_TransferCookiesUnaffiliated&testType=browser_tests


Detailed test output:

SAMLPolicyTest.PRE_TransferCookiesUnaffiliated (run #1):
[ RUN      ] SAMLPolicyTest.PRE_TransferCookiesUnaffiliated
HTTPS server started on 127.0.0.1:56211...
sending server_data: {"host": "127.0.0.1", "port": 56211} (36 bytes)
HTTPS server started on 127.0.0.1:55575...
sending server_data: {"host": "127.0.0.1", "port": 55575} (36 bytes)
[14412:14412:0120/061116.826496:WARNING:audio_manager.cc(321)] Multiple instances of AudioManager detected
[14412:14412:0120/061116.826586:WARNING:audio_manager.cc(278)] Multiple instances of AudioManager detected
Xlib:  extension "RANDR" missing on display ":99".
[14412:14412:0120/061117.898162:WARNING:signin_screen_policy_provider.cc(61)] Denying load of Extension  : mhjfbmdgcfjbbpaeojofohoefgiehjai / Chromium PDF Viewer because of 'signin_screen' is only allowed for packaged apps, but this is a extension.
[14412:14412:0120/061118.397944:ERROR:network_profile_handler.cc(83)] Manager properties returned from Shill don't contain the field Profiles
[14412:14412:0120/061118.398558:ERROR:network_sms_handler.cc(414)] NetworkSmsHandler: No list value for: Devices
[14412:14538:0120/061118.411022:WARNING:freezer_cgroup_process_manager.cc(61)] Cgroup freezer does not exist or is not writable. Unable to freeze renderer processes.
[14412:14412:0120/061118.418542:WARNING:server_backed_state_keys_broker.cc(76)] Failed to obtain server-backed state keys.
[14412:14412:0120/061118.627862:WARNING:signin_screen_policy_provider.cc(61)] Denying load of Extension  : mhjfbmdgcfjbbpaeojofohoefgiehjai / Chromium PDF Viewer because of 'signin_screen' is only allowed for packaged apps, but this is a extension.
[14412:14412:0120/061119.080559:INFO:remote_commands_service.cc(36)] Fetching remote commands.
[14412:14412:0120/061121.926190:WARNING:device_management_service.cc(281)] DMServer request failed, status: 3, error: -102
[14412:14412:0120/061121.926291:INFO:remote_commands_service.cc(161)] Remote commands fetched.
[14412:14412:0120/061121.926601:WARNING:device_management_service.cc(281)] DMServer request failed, status: 3, error: -102
[14412:14412:0120/061129.426892:WARNING:CONSOLE(1)] "This file is deprecated. Please use `iron-flex-layout/iron-flex-layout-classes.html`, and one of the specific dom-modules instead", source: chrome://resources/polymer/v1_0/iron-flex-layout/classes/iron-shadow-flex-layout-extracted.js (1)
[14412:14412:0120/061130.259254:WARNING:CONSOLE(1)] "This file is deprecated. Please use `iron-flex-layout/iron-flex-layout-classes.html`, and one of the specific dom-modules instead", source: chrome://resources/polymer/v1_0/iron-flex-layout/classes/iron-flex-layout-extracted.js (1)
[14412:14412:0120/061143.330829:WARNING:CONSOLE(3812)] "/deep/ combinator is deprecated. See https://www.chromestatus.com/features/6750456638341120 for more details.", source: chrome://resources/polymer/v1_0/polymer/polymer-extracted.js (3812)
[14412:14412:0120/061143.858183:ERROR:fake_shill_manager_client.cc(974)] Notify for unknown property: ServiceCompleteList
[14412:14412:0120/061156.038566:INFO:CONSOLE(7786)] "Loading asset bundle oauth-enrollment", source: chrome://oobe/oobe.js (7786)
[14412:14412:0120/061156.068001:ERROR:device_event_log_impl.cc(140)] [06:11:56.067] Network: network_type_pattern.cc:51 ShillNetworkTypeToFlag: Unknown type:
[14412:14412:0120/061156.075248:ERROR:device_event_log_impl.cc(140)] [06:11:56.075] Network: network_type_pattern.cc:51 ShillNetworkTypeToFlag: Unknown type:
[14412:14412:0120/061156.093574:ERROR:device_event_log_impl.cc(140)] [06:11:56.093] Network: network_type_pattern.cc:51 ShillNetworkTypeToFlag: Unknown type:
[14412:14412:0120/061156.110204:ERROR:device_event_log_impl.cc(140)] [06:11:56.110] Network: network_type_pattern.cc:51 ShillNetworkTypeToFlag: Unknown type:
[14412:14412:0120/061156.112520:ERROR:device_event_log_impl.cc(140)] [06:11:56.112] Network: network_type_pattern.cc:51 ShillNetworkTypeToFlag: Unknown type:
[14412:14412:0120/061156.295038:INFO:signin_screen_handler.cc(340)] GetUserLRUInputMethod(''): no input method for this user
[14412:14412:0120/061156.353595:WARNING:device_management_service.cc(281)] DMServer request failed, status: 3, error: -102
[14412:14412:0120/061205.082229:INFO:signin_screen_handler.cc(1349)] Login WebUI >> active: 1, source: gaia-signin
[14412:14641:0120/061211.523147:WARNING:fake_gaia.cc(312)] Serving request /embedded/setup/chromeos
localhost - - [20/Jan/2017 06:12:11] "GET /embedded/setup/chromeos?chrometype=chromedevice&client_id=dummytoken&manageddomain=example.com&client_version=58.0.2988.0&platform_version=0.0.0.0&endpoint_gen=1.0&hl=en-US HTTP/1.1" 200 -
BrowserTestBase received signal: Terminated. Backtrace:
#0 0x000000928bf1 __interceptor_backtrace
#1 0x000009e17b93 base::debug::StackTrace::StackTrace()
#2 0x00000b4b2555 content::(anonymous namespace)::DumpStackTraceSignalHandler()
#3 0x7f00c878b0b0 <unknown>
#4 0x7f00c883c993 __poll
#5 0x000000925618 __interceptor_poll
#6 0x7f00cd653ff6 <unknown>
#7 0x7f00cd654124 g_main_context_iteration
#8 0x000009e8c896 base::MessagePumpGlib::Run()
#9 0x000009e807fa base::MessageLoop::RunHandler()
#10 0x000009f0e5b1 base::RunLoop::Run()
#11 0x00000b5917a2 content::MessageLoopRunner::Run()
#12 0x00000b4bfadc content::DOMMessageQueue::WaitForMessage()
#13 0x000003283d12 chromeos::SamlTest::StartSamlAndWaitForIdpPageLoad()
#14 0x000003276d9e chromeos::SAMLPolicyTest::LogInWithSAML()
#15 0x00000327ed97 chromeos::SAMLPolicyTest_PRE_TransferCookiesUnaffiliated_Test::RunTestOnMainThread()
#16 0x00000a0b67b8 InProcessBrowserTest::RunTestOnMainThreadLoop()
#17 0x00000b4b1f84 content::BrowserTestBase::ProxyRunTestOnMainThreadLoop()
#18 0x00000a19be86 ChromeBrowserMainParts::PreMainMessageLoopRunImpl()
#19 0x00000a19987a ChromeBrowserMainParts::PreMainMessageLoopRun()
#20 0x000003d8f7cc chromeos::ChromeBrowserMainPartsChromeos::PreMainMessageLoopRun()
#21 0x000007673aca content::BrowserMainLoop::PreMainMessageLoopRun()
#22 0x00000833189e content::StartupTaskRunner::RunAllTasksNow()
#23 0x00000766e3c1 content::BrowserMainLoop::CreateStartupTasks()
#24 0x00000767ee6e content::BrowserMainRunnerImpl::Initialize()
#25 0x000007666744 content::BrowserMain()
#26 0x000009b67a7d content::RunNamedProcessTypeMain()
#27 0x000009b6951e content::ContentMainRunnerImpl::Run()
#28 0x000009b6603b content::ContentMain()
#29 0x00000b4b0ca8 content::BrowserTestBase::SetUp()
#30 0x00000a0b1c14 InProcessBrowserTest::SetUp()
#31 0x000003374aec chromeos::OobeBaseTest::SetUp()
#32 0x00000cda9a07 testing::Test::Run()
#33 0x00000cdabfe5 testing::TestInfo::Run()
#34 0x00000cdacdb7 testing::TestCase::Run()
#35 0x00000cdc0977 testing::internal::UnitTestImpl::RunAllTests()
#36 0x00000cdbfec8 testing::UnitTest::Run()
#37 0x00000a0f3c69 base::TestSuite::Run()
#38 0x000009ded6f4 ChromeTestSuiteRunner::RunTestSuite()
#39 0x00000b583afa content::LaunchTests()
#40 0x000009de7af9 main
#41 0x7f00c87767ed __libc_start_main
#42 0x0000008dd4b9 <unknown>
[0120/141214.423256:ERROR:nacl_helper_linux.cc(311)] NaCl helper process running without a sandbox!
Most likely you need to configure your SUID sandbox correctly
[0120/061214.423471:ERROR:nacl_helper_linux.cc(311)] NaCl helper process running without a sandbox!
Most likely you need to configure your SUID sandbox correctly
 
Cc: -bartfab@chromium.org
Labels: -Pri-3 -Sheriff-Chromium OS-Chrome Pri-2
Owner: bartfab@chromium.org
Status: Assigned (was: Untriaged)
I disabling the test in: https://codereview.chromium.org/2645283010/

bartfab: please investigate.
Cc: bartfab@chromium.org
Components: Enterprise
Owner: ----
Status: Available (was: Assigned)
Not my department. I no longer work on Chrome. But dropping this into the enterprise bug prioritization queue. Someone must have recently made a change that broke this.
Project Member

Comment 3 by bugdroid1@chromium.org, Jan 27 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ccc612ebe5cf17b20d71f5eced95cba4b04e4ca0

commit ccc612ebe5cf17b20d71f5eced95cba4b04e4ca0
Author: kjellander <kjellander@chromium.org>
Date: Fri Jan 27 14:53:36 2017

Disable SAMLPolicyTest.{PRE_,}TransferCookiesUnaffiliated tests

The SAMLPolicyTest.PRE_TransferCookiesUnaffiliated test is flaky on the bots.
Disabling it made SAMLPolicyTest.TransferCookiesUnaffiliated fail so that's also
disabled.

BUG= 683161 
TBR=bartfab@chromium.org

Review-Url: https://codereview.chromium.org/2645283010
Cr-Commit-Position: refs/heads/master@{#446666}

[modify] https://crrev.com/ccc612ebe5cf17b20d71f5eced95cba4b04e4ca0/chrome/browser/chromeos/login/saml/saml_browsertest.cc

Comment 4 by pbond@chromium.org, Feb 2 2017

Labels: Enterprise-Triaged
Owner: emaxx@chromium.org

Comment 5 by emaxx@chromium.org, Feb 13 2017

Cc: atwilson@chromium.org
I believe this may be just a time out of the test. When attempting to reproduce locally, they failed from time to time with default timeouts, but always succeeded to me with 10x timeouts (tested under stress too).

There is nothing obvious that may be sped up in the test.
Drew, do you have any ideas how to proceed with that? Maybe request increasing the browser tests time limit?
Cc: kjellander@chromium.org
I'm rather unhappy with globally disabling the tests - is it possible to just disable these tests on ASan rather than overall?

Alternative is to increase timeouts for ASan/LSan builds. Perhaps you should send an email to chromium-dev about these options - we can't be the first people to run into this.
Project Member

Comment 7 by bugdroid1@chromium.org, Apr 11 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/1e04e1de4401bf105333158e4cb314fa834c5fa8

commit 1e04e1de4401bf105333158e4cb314fa834c5fa8
Author: emaxx <emaxx@chromium.org>
Date: Tue Apr 11 23:34:31 2017

Re-enable TransferCookiesUnaffiliated test everywhere except MSAN,ASAN

This enables back the tests TransferCookiesUnaffiliated and
PRE_TransferCookiesUnaffiliated, as long as they are running with
neither MEMORY_SANITIZER nor ADDRESS_SANITIZER.

These tests were flaky probably only because they were timing out on
MSAN or ASAN.

BUG= 683161 

Review-Url: https://codereview.chromium.org/2812013002
Cr-Commit-Position: refs/heads/master@{#463834}

[modify] https://crrev.com/1e04e1de4401bf105333158e4cb314fa834c5fa8/chrome/browser/chromeos/login/saml/saml_browsertest.cc

Comment 8 by emaxx@chromium.org, Apr 28 2017

Status: Started (was: Available)
Project Member

Comment 9 by bugdroid1@chromium.org, May 1 2017

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d13854ee9bf02222c3a67552f9fa1875ed6e969e

commit d13854ee9bf02222c3a67552f9fa1875ed6e969e
Author: emaxx <emaxx@chromium.org>
Date: Mon May 01 22:19:27 2017

Disable TransferCookiesUnaffiliated test under Debug

The SAMLPolicyTest.TransferCookiesUnaffiliated test and its PRE-test
were timing out in Debug builds.

There is nothing obvious that can be improved in the test. Also the
timeout times agree to some degree with the slowdown of the Debug mode
measured locally.

Therefore disabling this test in Debug builds.

BUG= 683161 , 714167 

Review-Url: https://codereview.chromium.org/2845393002
Cr-Commit-Position: refs/heads/master@{#468452}

[modify] https://crrev.com/d13854ee9bf02222c3a67552f9fa1875ed6e969e/chrome/browser/chromeos/login/saml/saml_browsertest.cc

Cc: -kjellander@chromium.org
Status: Fixed (was: Started)
Status: Verified (was: Fixed)

Sign in to add a comment