New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 915027 link

Starred by 0 users

Issue metadata

Status: Assigned
Owner:
OOO until 4th Feb
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

telemetry on cros failures 12/13

Project Member Reported by achuith@chromium.org, Dec 13

Issue description

https://storage.cloud.google.com/chromeos-image-archive/amd64-generic-telemetry/R73-11396.0.0-b3225315/vm_test_results_1/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/debug/client.0.log

[208/1132] telemetry.internal.actions.key_event_unittest.KeyPressActionTest.testPressEndAndHome failed unexpectedly 25.5341s:
06:54:47 INFO |   DevTools console [network]: Failed to load resource: net::ERR_FAILED chrome-search://local-ntp/promo.js
06:54:47 INFO |   DevTools console [network]: Failed to load resource: net::ERR_FAILED chrome-search://local-ntp/one-google.js
06:54:47 INFO |   Traceback (most recent call last):
06:54:47 INFO |     File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/testing/browser_test_case.py", line 39, in WrappedMethod
06:54:47 INFO |       method(self)
06:54:47 INFO |     File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/actions/key_event_unittest.py", line 54, in testPressEndAndHome
06:54:47 INFO |       2 * self._window_height, self._scroll_position, delta=20)
06:54:47 INFO |   AssertionError: 1194 != 0 within 20 delta


09:20:06 INFO | [325/1132] telemetry.internal.backends.chrome_inspector.inspector_page_unittest.InspectorPageTest.testPageNavigateToNormalUrl failed unexpectedly 252.0447s:
09:20:06 INFO |   Failed with BrowserConnectionGoneException while starting the browser backend.
09:20:06 INFO |   Traceback (most recent call last):
09:20:06 INFO |     File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/testing/browser_test_case.py", line 78, in setUpClass
09:20:06 INFO |       cls._browser = cls._possible_browser.Create()
09:20:06 INFO |     File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/cros_browser_finder.py", line 105, in Create
09:20:06 INFO |       browser_backend, self._platform_backend, startup_args)
09:20:06 INFO |     File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/browser/browser.py", line 48, in __init__
09:20:06 INFO |       self._browser_backend.Start(startup_args, startup_url=startup_url)
09:20:06 INFO |     File "/usr/local/telemetry/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
09:20:06 INFO |       return func(*args, **kwargs)
09:20:06 INFO |     File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/cros_browser_backend.py", line 80, in Start
09:20:06 INFO |       self.BindDevToolsClient()
09:20:06 INFO |     File "/usr/local/telemetry/src/third_party/catapult/common/py_trace_event/py_trace_event/trace_event_impl/decorators.py", line 52, in traced_function
09:20:06 INFO |       return func(*args, **kwargs)
09:20:06 INFO |     File "/usr/local/telemetry/src/third_party/catapult/telemetry/telemetry/internal/backends/chrome/chrome_browser_backend.py", line 118, in BindDevToolsClient
09:20:06 INFO |       raise exceptions.BrowserConnectionGoneException(self.browser, e)
09:20:06 INFO |   BrowserConnectionGoneException: Timed out while waiting 240s for _GetDevToolsClient.

Many more tests have the same signature with the devtools client failure:
telemetry.internal.backends.chrome_inspector.inspector_runtime_unittest.InspectorRuntimeTest.testIFrame failed unexpectedly 251.9244s:
telemetry.internal.browser.extension_unittest.MultipleExtensionTest.testExtensionGetByExtensionId failed unexpectedly 250.2640s:
telemetry.internal.browser.extension_unittest.MultipleExtensionTest.testWebApp failed unexpectedly 249.7110s:
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testExtensionBasic failed unexpectedly 252.1374s:
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testExtensionGetByExtensionId failed unexpectedly 249.4236s:
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testExtensionNotLoaded failed unexpectedly 249.8035s:
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testWebApp failed unexpectedly 249.7862s:
telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testExtensionBasic failed unexpectedly 249.7380s:
telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testExtensionGetByExtensionId failed unexpectedly 249.8058s:
telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testWebApp failed unexpectedly 249.7193s:
telemetry.internal.browser.tab_unittest.ServiceWorkerTabTest.testClearDataForOrigin failed unexpectedly 249.6145s:
telemetry.internal.browser.tab_unittest.ServiceWorkerTabTest.testIsServiceWorkerActivatedOrNotRegistered failed unexpectedly 249.6122s:
telemetry.internal.browser.tab_unittest.TabTest.testActivateTab failed unexpectedly 249.5981s:
telemetry.internal.browser.tab_unittest.TabTest.testGetFirstRendererThread_multipleTabs failed unexpectedly 249.6242s:
telemetry.internal.browser.tab_unittest.TabTest.testGetFirstRendererThread_singleTab failed unexpectedly 249.6663s:



 
Components: Tests>Telemetry
I just tried some of these tests and they passed.
Previous run had 5 failures:
https://storage.cloud.google.com/chromeos-image-archive/amd64-generic-telemetry/R73-11395.0.0-b3224433/vm_test_results_1/telemetry_unit_server/test_harness/all/SimpleTestVerify/1_autotest_tests/results-1-telemetry_UnitTestsServer/telemetry_UnitTestsServer.user/debug/client.0.DEBUG

telemetry.page.page_run_end_to_end_unittest.ActualPageRunEndToEndTests.testSharedPageStateCannotRunOnBrowser
telemetry.core.tracing_controller_unittest.TracingControllerTest.testExceptionRaisedInStopTracing
telemetry.core.tracing_controller_unittest.TracingControllerTest.testFlushTracing
telemetry.core.tracing_controller_unittest.TracingControllerTest.testGotTrace
telemetry.core.tracing_controller_unittest.TracingControllerTest.testStartAndStopTraceMultipleTimes

Same stack, so tests are randomly failing on startup.
The 16 failing tests:
telemetry.internal.backends.chrome_inspector.inspector_runtime_unittest.InspectorRuntimeTest.testRuntimeEvaluateOfSomethingThatCantJSONize
telemetry.internal.browser.extension_unittest.MultipleExtensionTest.testExtensionGetByExtensionId
telemetry.internal.browser.extension_unittest.MultipleExtensionTest.testWebApp
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testExtensionBasic
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testExtensionGetByExtensionId
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testExtensionNotLoaded
telemetry.internal.browser.extension_unittest.NonExistentExtensionTest.testWebApp
telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testExtensionBasic
telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testExtensionGetByExtensionId
telemetry.internal.browser.extension_unittest.WebviewInExtensionTest.testWebApp
telemetry.internal.browser.tab_unittest.ServiceWorkerTabTest.testClearDataForOrigin
telemetry.internal.browser.tab_unittest.ServiceWorkerTabTest.testIsServiceWorkerActivatedOrNotRegistered
telemetry.internal.browser.tab_unittest.TabTest.testActivateTab
telemetry.internal.browser.tab_unittest.TabTest.testGetFirstRendererThread_multipleTabs
telemetry.internal.browser.tab_unittest.TabTest.testGetFirstRendererThread_singleTab
telemetry.internal.browser.tab_unittest.TabTest.testIsVideoCaptureRunning

looks like the bot has database failure due to space issue.

chrome log from last successful test.
------------
[9072:9072:1214/160141.003410:VERBOSE1:webui_login_view.cc(595)] Login WebUI >> login-prompt-visible
[9072:9072:1214/160141.044730:WARNING:server_backed_state_keys_broker.cc(75)] Failed to obtain server-backed state keys.
[9072:9072:1214/160142.061463:WARNING:CONSOLE(2651)] "Could not find style data in module named", source: chrome://resources/polymer/v1_0/polymer/polymer-extracted.js (2651)
[9072:9094:1214/160142.196728:WARNING:value_store_frontend.cc(44)] Reading iadeocfgjdjdmpenejdbfeaocpbikmab.alarms from  failed: IO error: .../MANIFEST-000347: FILE_ERROR_NO_SPACE (ChromeMethodBFE: 3::WritableFileAppend::8)
[9072:9094:1214/160142.203384:WARNING:value_store_frontend.cc(44)] Reading mppnpdlheglhdfmldimlhpnegondlapf.alarms from  failed: IO error: .../MANIFEST-000347: FILE_ERROR_NO_SPACE (ChromeMethodBFE: 3::WritableFileAppend::8)
[9072:9094:1214/160142.209677:WARNING:value_store_frontend.cc(44)] Reading mhjfbmdgcfjbbpaeojofohoefgiehjai.alarms from  failed: IO error: .../MANIFEST-000347: FILE_ERROR_NO_SPACE (ChromeMethodBFE: 3::WritableFileAppend::8)
[9072:9094:1214/160142.216557:WARNING:value_store_frontend.cc(44)] Reading fgoepimhcoialccpbmpnnblemnepkkao.alarms from  failed: IO error: .../MANIFEST

next chrome log that failed
---------------------------

[9338:9398:1214/160529.574954:ERROR:data_store_impl.cc(131)] Failed to open Data Reduction Proxy DB: 3
[9338:9394:1214/160529.624360:ERROR:database.cc(1808)] Passwords sqlite error 13, errno 0: database or disk is full, sql: INSERT OR REPLACE INTO meta (key,value) VALUES (?,?)
[9338:9394:1214/160529.637915:ERROR:database.cc(1808)] Passwords sqlite error 13, errno 0: database or disk is full, sql: INSERT OR REPLACE INTO meta (key,value) VALUES (?,?)
[9338:9394:1214/160529.638549:ERROR:database.cc(1808)] Passwords sqlite error 1, errno 0: cannot commit - no transaction is active, sql: COMMIT
[9338:9394:1214/160529.638794:ERROR:login_database.cc(639)] Unable to commit a transaction.
[9338:9338:1214/160529.642945:VERBOSE1:drm_display_host_manager.cc(248)] Got display event ADD for /dev/dri/card1
[9338:9394:1214/160529.643441:ERROR:password_store_default.cc(41)] Could not create/open login database.


Should we increase the diskspace for VM?


I did find real failure: testActivateTab. I'll file a separate bug for it.
Status: Assigned (was: Untriaged)
This issue has an owner, a component and a priority, but is still listed as untriaged or unconfirmed. By definition, this bug is triaged. Changing status to "assigned". Please reach out to me if you disagree with how I've done this.

Comment 9 by benhenry@google.com, Jan 16 (6 days ago)

Components: Test>Telemetry

Comment 10 by benhenry@google.com, Jan 16 (6 days ago)

Components: -Tests>Telemetry

Sign in to add a comment