New issue
Advanced search Search tips

Issue 659181 link

Starred by 1 user

Issue metadata

Status: Verified
Owner:
Closed: Oct 2016
Cc:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

interactive_ui_tests failed regularly on Linux ChromiumOS Tests (dbg)(1) Build

Project Member Reported by x...@chromium.org, Oct 25 2016

Issue description

It failed regularly on the builder starting from builder #19288: 
https://build.chromium.org/p/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%28dbg%29%281%29/builds/19288

Several tests are failed:
LoggedInSpokenFeedbackTest.NavigateNotificationCenter
TestAsNormalAndGuestUser/SpokenFeedbackTest.TypeInOmnibox/0
TestAsNormalAndGuestUser/SpokenFeedbackTest.TypeInOmnibox/1
TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxNavigateAndSelect/1
TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxNavigateAndSelect/0
TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxNextStickyMode/1
TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxNextStickyMode/0
TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxShiftSearch/1
TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxShiftSearch/0
TestAsNormalAndGuestUser/SpokenFeedbackTest.FocusShelf/0
TestAsNormalAndGuestUser/SpokenFeedbackTest.FocusShelf/1

Selected log for TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxNavigateAndSelect/0:
[22824:22824:1024/202144:INFO:speech_monitor.cc(96)] Speaking Title
../../chrome/browser/chromeos/accessibility/spoken_feedback_browsertest.cc:561: Failure
Value of: speech_monitor_.GetNextUtterance()
  Actual: "Title"
Expected: "Heading 1"
[22824:22824:1024/202144:INFO:touch_exploration_controller.cc(76)]
Keyboard event: ET_KEY_PRESSED
 Key code: 18, Flags: 131080, Is char: 0
[22824:22824:1024/202144:INFO:touch_exploration_controller.cc(76)]
Keyboard event: ET_KEY_RELEASED
 Key code: 18, Flags: 131072, Is char: 0
[22824:22824:1024/202144:INFO:speech_monitor.cc(96)] Speaking Heading 1
../../chrome/browser/chromeos/accessibility/spoken_feedback_browsertest.cc:565: Failure
Value of: speech_monitor_.GetNextUtterance()
  Actual: "Heading 1"
Expected: "Title"
[1:1:1024/202144:INFO:render_accessibility_impl.cc(366)] Accessibility event: layoutComplete on node id 4
AXTreeUpdate: root id 4
id=4 rootWebArea FOCUSABLE READONLY (0, 0)-(1100, 645) background_color=&FFFFFFFF color=&FF000000 scroll_x=0 scroll_y=0 scroll_x_min=0 scroll_y_min=0 scroll_x_max=0 scroll_y_max=0 value= font-family=Tinos url=data:text/html;charset=utf-8,<h1>Title</h1><button autofocus>Click me</button> html_tag=#document font_size=16 child_ids=9,5

[22824:22824:1024/202144:INFO:speech_monitor.cc(96)] Speaking Title
../../chrome/browser/chromeos/accessibility/spoken_feedback_browsertest.cc:566: Failure
Value of: speech_monitor_.GetNextUtterance()
  Actual: "Title"
Expected: "selected"
[22824:22824:1024/202144:INFO:touch_exploration_controller.cc(76)]
Keyboard event: ET_KEY_PRESSED
 Key code: 18, Flags: 131080, Is char: 0
[22824:22824:1024/202144:INFO:touch_exploration_controller.cc(76)]
Keyboard event: ET_KEY_RELEASED
 Key code: 18, Flags: 131072, Is char: 0
[22824:22824:1024/202144:INFO:CONSOLE(44)] "Speak (I) category=nav "Title"", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromevox/injected/console_tts.js (44)
[22824:22824:1024/202144:INFO:CONSOLE(44)] "Speak (Q) category=nav "selected"", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromevox/injected/console_tts.js (44)
[22824:22824:1024/202144:INFO:speech_monitor.cc(96)] Speaking selected
../../chrome/browser/chromeos/accessibility/spoken_feedback_browsertest.cc:570: Failure
Value of: speech_monitor_.GetNextUtterance()
  Actual: "selected"
Expected: "End selection"
[22824:22824:1024/202144:INFO:speech_monitor.cc(96)] Speaking End selection
[22824:22824:1024/202144:INFO:CONSOLE(44)] "Speak (I) category=nav "End selection"", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromevox/injected/console_tts.js (44)
../../chrome/browser/chromeos/accessibility/spoken_feedback_browsertest.cc:571: Failure
Value of: speech_monitor_.GetNextUtterance()
  Actual: "End selection"
Expected: "Title"
[22824:22824:1024/202144:INFO:CONSOLE(44)] "Speak (Q) category=nav "Title"", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromevox/injected/console_tts.js (44)
[22824:22824:1024/202144:WARNING:url_request_context_getter.cc(43)] URLRequestContextGetter leaking due to no owning thread.
[  FAILED  ] TestAsNormalAndGuestUser/SpokenFeedbackTest.ChromeVoxNavigateAndSelect/0, where GetParam() = 0 (11152 ms)


 

Comment 2 by x...@chromium.org, Oct 25 2016

Cc: x...@chromium.org
Owner: dtseng@chromium.org
Status: Assigned (was: Untriaged)
dtseng@, could you take a look at this? 

Comment 3 by dtseng@chromium.org, Oct 25 2016

Trying to reproduce; haven't been able to yet.
Project Member

Comment 4 by bugdroid1@chromium.org, Oct 25 2016

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/f66eb9d5822ec392f9b7262cf3662924e80b0b93

commit f66eb9d5822ec392f9b7262cf3662924e80b0b93
Author: dtseng <dtseng@chromium.org>
Date: Tue Oct 25 19:45:02 2016

Explicitly skip notification announcements in SpokenFeedbackTest

Since ChromeVox Next behaves slightly differently (it is more aggressive about placing initial focus), there are a lot more utterances that can occur on startup. In addition, it triggers a notification center alert which also causes output.

This cl skips those messages explicitly.

Also, disable
TypeInOmniBox
because on slower debug builds, it appears we're actually prepending when typing to about:blank.
NavigateNotificationCenter
This test is super brittle because it relies on the "Button" utterance to trigger tabbing.

In general, most of these tests are brittle because they rely upon a strict ordering of utterances with no tolerance for various UI events. This should be solved later hopefully with the js-based tests in chrome/browser/resources/chromeos/chromevox/cvox2/background/background_test.extjs as an example.

BUG= 659181 
TBR=dmazzoni@chromium.org

Review-Url: https://codereview.chromium.org/2449043004
Cr-Commit-Position: refs/heads/master@{#427444}

[modify] https://crrev.com/f66eb9d5822ec392f9b7262cf3662924e80b0b93/chrome/browser/chromeos/accessibility/speech_monitor.cc
[modify] https://crrev.com/f66eb9d5822ec392f9b7262cf3662924e80b0b93/chrome/browser/chromeos/accessibility/spoken_feedback_browsertest.cc

Comment 5 by dtseng@chromium.org, Oct 25 2016

Status: fixed (was: Assigned)

Comment 6 by dchan@google.com, Jan 21 2017

Labels: VerifyIn-57

Comment 7 by dchan@google.com, Mar 4 2017

Labels: VerifyIn-58

Comment 8 by dchan@google.com, Apr 17 2017

Labels: VerifyIn-59

Comment 9 by dchan@google.com, May 30 2017

Labels: VerifyIn-60
Labels: VerifyIn-61
Status: Verified (was: Fixed)
Closing. Please reopen it if its not fixed. Thanks!

Sign in to add a comment