New issue
Advanced search Search tips

Issue 751046 link

Starred by 1 user
Status: Assigned
Owner:
dtseng@chromium.org
Cc:
chanli@chromium.org
seanmccullough@chromium.org
liaoyuke@chromium.org
st...@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug



Sign in to add a comment

PanelTest.ActivateMenu and PanelTest.LinkMenu flaky on ChromiumOS

Project Member Reported by jkrcal@chromium.org, Aug 1 2017 
See the buildbot
https://uberchromegw.corp.google.com/i/chromium.chromiumos/builders/Linux%20ChromiumOS%20Tests%20%281%29?numbuilds=100

The ActivateMenu test had 3 recent flakes, the LinkMenu test only one. I'll disable both of them.

A sample error log:

[ RUN      ] PanelTest.ActivateMenu
[32058:32058:0731/161154.692742:WARNING:chrome_browser_main_chromeos.cc(562)] Running as stub user with profile dir: test-user
[32058:32118:0731/161155.172092:WARNING:freezer_cgroup_process_manager.cc(62)] Cgroup freezer does not exist or is not writable. Unable to freeze renderer processes.
ALSA lib confmisc.c:768:(parse_card) cannot find card '0'
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1251:(snd_func_refer) error evaluating name
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:4727:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM default
[32058:32130:0731/161157.101853:WARNING:alsa_util.cc(24)] PcmOpen: default,No such file or directory
ALSA lib confmisc.c:768:(parse_card) cannot find card '0'
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1251:(snd_func_refer) error evaluating name
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:4727:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM default
[32058:32130:0731/161157.102047:WARNING:alsa_util.cc(24)] PcmOpen: plug:default,No such file or directory
[32058:32058:0731/161157.980980:INFO:CONSOLE(821)] "Synchronous XMLHttpRequest on the main thread is deprecated because of its detrimental effects to the end user's experience. For more help, check https://xhr.spec.whatwg.org/.", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js (821)
[32058:32124:0731/161158.226013:ERROR:component_loader.cc(93)] Can't load /usr/share/chromeos-assets/speech_synthesis/patts/manifest.json: Manifest file is missing or unreadable.
ALSA lib confmisc.c:768:(parse_card) cannot find card '0'
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4248:(_snd_config_evaluate) [32058:32058:0731/161158.269570:INFO:CONSOLE(0)] "Error in event handler for childrenChanged during phase 1: TypeError: Cannot read property 'start' of null
    at DesktopAutomationHandler.createTextEditHandlerIfNeeded_ (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1761:127)
    at DesktopAutomationHandler.onFocus (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1736:70)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1720:89)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1719:2293)
    at Object.installAutomationEvent [as callback] (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1643:567)", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/cvox2/background/background.html (0)
function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1251:(snd_func_refer) error evaluating name
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:4727:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM default
[32058:32130:0731/161158.309573:WARNING:alsa_util.cc(24)] PcmOpen: default,No such file or directory
ALSA lib confmisc.c:768:(parse_card) cannot find card '0'
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_card_driver returned error: No such file or directory
ALSA lib confmisc.c:392:(snd_func_concat) error evaluating strings
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_concat returned error: No such file or directory
ALSA lib confmisc.c:1251:(snd_func_refer) error evaluating name
ALSA lib conf.c:4248:(_snd_config_evaluate) function snd_func_refer returned error: No such file or directory
ALSA lib conf.c:4727:(snd_config_expand) Evaluate error: No such file or directory
ALSA lib pcm.c:2239:(snd_pcm_open_noupdate) Unknown PCM default
[32058:32130:0731/161158.309751:WARNING:alsa_util.cc(24)] PcmOpen: plug:default,No such file or directory
[32058:32058:0731/161158.310068:INFO:CONSOLE(996)] "Speak (Q) category=nav """, source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js (996)
[32058:32058:0731/161158.310107:INFO:CONSOLE(996)] "Speak (Q) category=nav "Alert"", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js (996)
[32058:32058:0731/161158.310129:INFO:CONSOLE(996)] "Speak (Q) category=nav "Connected to eth1"", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js (996)
[1:25:0731/161158.310180:WARNING:PushPullFIFO.cpp(182)] PushPullFIFO: underflow while pulling (underflowCount=1, availableFrames=0, requestedFrames=441, fifoLength=8192)
[32058:32058:0731/161158.310414:INFO:CONSOLE(0)] "Error in event handler for loadComplete during phase 2: TypeError: Cannot read property 'start' of null
    at DesktopAutomationHandler.createTextEditHandlerIfNeeded_ (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1761:127)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1744:13)
    at DesktopAutomationHandler.onLoadComplete (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1743:149)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1643:8)", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/cvox2/background/background.html (0)
[32058:32058:0731/161158.310481:INFO:CONSOLE(0)] "Error in event handler for loadComplete during phase 2: TypeError: Cannot read property 'start' of null
    at DesktopAutomationHandler.createTextEditHandlerIfNeeded_ (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1761:127)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1744:13)
    at DesktopAutomationHandler.onLoadComplete (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1743:149)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1643:8)", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/cvox2/background/background.html (0)
[32058:32058:0731/161158.310554:INFO:CONSOLE(996)] "Speak (Q) "ChromeVox spoken feedback is ready"", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js (996)
[32058:32058:0731/161158.325499:INFO:CONSOLE(7723)] "Running TestCase PanelTest.ActivateMenu", source: panel_test.extjs (7723)
[32058:32058:0731/161158.325575:INFO:CONSOLE(7024)] "ReferenceError: axs is not defined
    at PanelTest.get accessibilityAuditConfig [as accessibilityAuditConfig] (panel_test.extjs:6693:46)
    at PanelTest.setUp (panel_test.extjs:6834:12)
    at TestCase.setUp (panel_test.extjs:6982:22)
    at TestCase.run (panel_test.extjs:7020:14)
    at RUN_TEST_F (panel_test.extjs:7724:21)
    at panel_test.extjs:7522:20
    at runTestFunction (panel_test.extjs:7592:37)
    at runTest (panel_test.extjs:7566:18)
    at panel_test.extjs:9190:1", source: panel_test.extjs (7024)
[32058:32128:0731/161158.424026:ERROR:service_manager.cc(156)] Connection InterfaceProviderSpec prevented service: content_browser from binding interface: content::mojom::Child exposed by: nacl_loader
[1,477607808:23:11:58.427495] Native Client module will be loaded at base address 0x0000733400000000
[32058:32058:0731/161158.439003:INFO:CONSOLE(0)] "Error in event handler for focus during phase 1: TypeError: Cannot read property 'start' of null
    at DesktopAutomationHandler.createTextEditHandlerIfNeeded_ (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1761:127)
    at DesktopAutomationHandler.onFocus (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1736:70)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1643:8)", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/cvox2/background/background.html (0)
[32058:32058:0731/161158.486098:INFO:CONSOLE(0)] "Unchecked runtime.lastError while running automationInternal.performAction: Ignoring action on destroyed node
    at Background.setCurrentRange (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1937:70)
    at DesktopAutomationHandler.<anonymous> (chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js:1757:247)", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/cvox2/background/background.html (0)
[32058:32058:0731/161158.500694:INFO:CONSOLE(613)] "loaded liblouis Native Client instance", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js (613)
[32058:32058:0731/161158.583554:INFO:CONSOLE(1789)] "Injecting into 2", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVox2ChromeBackgroundScript.js (1789)
[32058:32058:0731/161158.586780:INFO:CONSOLE(2026)] "ChromeVox waiting for background page: data:text/html,<!doctype html><a href="#">apple</a> <a href="#">grape</a> <a href="#">banana</a>. Will try again in 100ms", source: chrome-extension://mndnfokpggljbaajbnioimlmbfngpief/chromeVoxChromePageScript.js (2026)
[32058:32058:0731/161158.654163:INFO:CONSOLE(2026)] "ChromeVox waiting for background page: about:blank. Will try again in 100ms", source: chrome-extension://chromevox/chromeVoxChromePageScript.js (2026)
[32058:32058:0731/161200.606657:INFO:CONSOLE(9025)] "Still waiting for Speak 'Click On Current Item ChromeVox+Space'", source: panel_test.extjs (9025)
[32058:32058:0731/161200.806267:INFO:CONSOLE(9028)] "Pending speech utterances:
  'Link'
  ", source: panel_test.extjs (9028)
[32058:32058:0731/161200.806306:INFO:CONSOLE(9028)] "Pending braille:
  'tab created' startIndex=-1 endIndex=-1
  'alrt ChromeVox Updated
Press ChromeVox o, n to learn more about ChromeVox Next.
' startIndex=-1 endIndex=-1
  'data:text/html,<!doctype html><a href="#">apple</a> <a href="#">grape</a> <a href="#">banana</a>' startIndex=-1 endIndex=-1
  'apple lnk' startIndex=-1 endIndex=-1
  ", source: panel_test.extjs (9028)
[32058:32058:0731/161200.806333:INFO:CONSOLE(9028)] "Pending earcons:
  'object_open'
  'page_start_loading'
  'object_select'
  'page_finish_loading'
  'alert_nonmodal'
  'link'
  ", source: panel_test.extjs (9028)
[32058:32058:0731/161205.260869:ERROR:tab_manager_delegate_chromeos.cc(81)] Set OOM score error:
[32058:32058:0731/161205.260922:ERROR:tab_manager_delegate_chromeos.cc(81)] Set OOM score error:
BrowserTestBase received signal: Terminated. Backtrace:
#0 0x000001e1e9bc base::debug::StackTrace::StackTrace()
#1 0x00000218f018 content::(anonymous namespace)::DumpStackTraceSignalHandler()
#2 0x7f1d74149cb0 <unknown>
#3 0x7f1d74211283 epoll_wait
#4 0x00000219991d epoll_dispatch
#5 0x00000219737d event_base_loop
#6 0x000001e39f57 base::MessagePumpLibevent::Run()
#7 0x000001e578d3 base::RunLoop::Run()
#8 0x00000219378e content::MessageLoopRunner::Run()
#9 0x00000219008f content::DOMMessageQueue::WaitForMessage()
#10 0x00000218ff2e content::(anonymous namespace)::ExecuteScriptHelper()
#11 0x00000218fc47 content::ExecuteScriptAndExtractString()
#12 0x000000432b23 extensions::browsertest_util::ExecuteScriptInBackgroundPage()
#13 0x000000434d15 ExtensionJSBrowserTest::RunJavascriptTestF()
#14 0x00000045504e PanelTest_ActivateMenu_Test::RunTestOnMainThread()
#15 0x00000218ed8f content::BrowserTestBase::ProxyRunTestOnMainThreadLoop()
#16 0x000001ec9066 ChromeBrowserMainParts::PreMainMessageLoopRunImpl()
#17 0x000001ec806d ChromeBrowserMainParts::PreMainMessageLoopRun()
#18 0x0000012a6e5f chromeos::ChromeBrowserMainPartsChromeos::PreMainMessageLoopRun()
#19 0x000000b7c571 content::BrowserMainLoop::PreMainMessageLoopRun()
#20 0x000000e92857 content::StartupTaskRunner::RunAllTasksNow()
#21 0x000000b7abdc content::BrowserMainLoop::CreateStartupTasks()
#22 0x000000b7eb73 content::BrowserMainRunnerImpl::Initialize()
#23 0x000000b78507 content::BrowserMain()
#24 0x000001ddc9b5 content::ContentMainRunnerImpl::Run()
#25 0x000003515ecc service_manager::Main()
#26 0x000001ddb6a4 content::ContentMain()
#27 0x00000218ea87 content::BrowserTestBase::SetUp()
#28 0x00000218d061 InProcessBrowserTest::SetUp()
#29 0x0000005f7641 testing::Test::Run()
#30 0x0000005f7e60 testing::TestInfo::Run()
#31 0x0000005f8347 testing::TestCase::Run()
#32 0x0000005fe867 testing::internal::UnitTestImpl::RunAllTests()
#33 0x0000005fe4e7 testing::UnitTest::Run()
#34 0x0000054adf3e base::TestSuite::Run()
#35 0x00000218c559 ChromeTestSuiteRunner::RunTestSuite()
#36 0x0000021909ba content::LaunchTests()
#37 0x00000218a1eb main
#38 0x7f1d74134f45 __libc_start_main
#39 0x0000004329f3 <unknown>
Project Member

Comment 1 by bugdroid1@chromium.org, Aug 1 2017 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/12af72412d3a767b6d2ce5ab607ca05f30afb011

commit 12af72412d3a767b6d2ce5ab607ca05f30afb011
Author: Jan Krcal <jkrcal@chromium.org>
Date: Tue Aug 01 09:45:39 2017

[Sheriff] Disabling PanelTest.* on ChromiumOS

The tests are flaky on ChromiumOS.

TBR=dtseng@chromium.org, yutak@chromium.org
NOTRY=true

Bug: 751046
Cq-Include-Trybots: master.tryserver.chromium.linux:closure_compilation
Change-Id: Id28f1ba7cb1c42c617b041c74a3698937d21eed5
Reviewed-on: https://chromium-review.googlesource.com/595589
Commit-Queue: Jan Krcal <jkrcal@chromium.org>
Reviewed-by: Jan Krcal <jkrcal@chromium.org>
Cr-Commit-Position: refs/heads/master@{#490929}
[modify] https://crrev.com/12af72412d3a767b6d2ce5ab607ca05f30afb011/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs
Project Member

Comment 2 by bugdroid1@chromium.org, Aug 1 2017 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/3770f366b4a020347844f8f6c7366a7c4ab3a985

commit 3770f366b4a020347844f8f6c7366a7c4ab3a985
Author: Friedrich Horschig <fhorschig@chromium.org>
Date: Tue Aug 01 10:14:01 2017

Revert "[Sheriff] Disabling PanelTest.* on ChromiumOS"

This reverts commit 12af72412d3a767b6d2ce5ab607ca05f30afb011.

Reason for revert: Please realnd without NOTRY as it caused compile failure.
Compile log: test_data/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs gen/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test-gen.cc 
python ../../tools/gypv8sh.py ./v8_shell ../../chrome/third_party/mock4js/mock4js.js ../../chrome/test/data/webui/test_api.js ../../chrome/test/base/js2gtest.js extension --external=y ../../chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs gen/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test-gen.cc test_data/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs
undefined:68: SyntaxError: Invalid or unexpected token
#if defined(OS_CHROMEOS)
^
SyntaxError: Invalid or unexpected token
    at ../../chrome/test/base/js2gtest.js:462:6


Original change's description:
> [Sheriff] Disabling PanelTest.* on ChromiumOS
> 
> The tests are flaky on ChromiumOS.
> 
> TBR=dtseng@chromium.org, yutak@chromium.org
> NOTRY=true
> 
> Bug: 751046
> Cq-Include-Trybots: master.tryserver.chromium.linux:closure_compilation
> Change-Id: Id28f1ba7cb1c42c617b041c74a3698937d21eed5
> Reviewed-on: https://chromium-review.googlesource.com/595589
> Commit-Queue: Jan Krcal <jkrcal@chromium.org>
> Reviewed-by: Jan Krcal <jkrcal@chromium.org>
> Cr-Commit-Position: refs/heads/master@{#490929}

TBR=dtseng@chromium.org,yutak@chromium.org,jkrcal@chromium.org

Change-Id: I0e62ca5b253292bd0ae4ef5e4f12e065589494db
No-Presubmit: true
No-Tree-Checks: true
No-Try: true
Bug: 751046
Cq-Include-Trybots: master.tryserver.chromium.linux:closure_compilation
Reviewed-on: https://chromium-review.googlesource.com/595687
Reviewed-by: Friedrich Horschig <fhorschig@chromium.org>
Commit-Queue: Friedrich Horschig <fhorschig@chromium.org>
Cr-Commit-Position: refs/heads/master@{#490934}
[modify] https://crrev.com/3770f366b4a020347844f8f6c7366a7c4ab3a985/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs

Comment 3 by jkrcal@chromium.org, Aug 2 2017 

More precise view of recent flakes:
https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=chromevox_tests&showAllRuns=true&showExpectations=true&tests=PanelTest

There were always rare timeouts in the past but it got worse around 
7/31/2017 6pm GMT. I cannot see any clear culprit.

Comment 4 by jkrcal@chromium.org, Aug 2 2017 

For the reference, the first ~20 CLs here are the candidates (where I see no culprit):
https://chromium.googlesource.com/chromium/src/+log/74b2febbaa58ff81e43ece6cf6af8a250216eeae/?s=7c009a74388dd45218c73c149579b5bf48b64a44

It could be also some infra change on the buildbots?

Comment 5 by ynovikov@chromium.org, Oct 5 2017

Labels: -Pri-3 Sheriff-Chromium Pri-1
This test is flaky in the CQ.
https://build.chromium.org/p/tryserver.chromium.linux/builders/linux_chromium_chromeos_rel_ng/builds/523152

Sheriffs, can you land the revert attempted in #1?

Comment 6 by grunell@chromium.org, Oct 9 2017

Cc: -dtseng@chromium.org
Labels: -Pri-1 OS-Chrome Pri-2
Owner: dtseng@chromium.org
Status: Assigned (was: Untriaged)
Project Member

Comment 7 by bugdroid1@chromium.org, Oct 9 2017 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/e2dedafabc961d68eb2b5318f73e3bc208890599

commit e2dedafabc961d68eb2b5318f73e3bc208890599
Author: Henrik Grunell <grunell@chromium.org>
Date: Mon Oct 09 11:07:07 2017

Disable flaky Chromevox panel tests.

TBR=dtseng@chromium.org

Bug: 751046
Cq-Include-Trybots: master.tryserver.chromium.linux:closure_compilation
Change-Id: I344e85bdda9fce04da6ca7261fc905502b7f0d15
Reviewed-on: https://chromium-review.googlesource.com/707011
Reviewed-by: Henrik Grunell <grunell@chromium.org>
Commit-Queue: Henrik Grunell <grunell@chromium.org>
Cr-Commit-Position: refs/heads/master@{#507352}
[modify] https://crrev.com/e2dedafabc961d68eb2b5318f73e3bc208890599/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs

Comment 8 by grunell@chromium.org, Oct 9 2017

Labels: -Sheriff-Chromium
Project Member

Comment 9 by bugdroid1@chromium.org, Oct 9 2017 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/7d7e5dde14bdadfb575489de9ff594bf6b51216a

commit 7d7e5dde14bdadfb575489de9ff594bf6b51216a
Author: Henrik Grunell <grunell@chromium.org>
Date: Mon Oct 09 13:43:51 2017

Add comments with bug reference to previously disabled tests.

Tests were disabled in https://chromium-review.googlesource.com/707011.

TBR=dtseng@chromium.org

Bug: 751046
Cq-Include-Trybots: master.tryserver.chromium.linux:closure_compilation
Change-Id: I1289bc557ad0a3409e174083c861a7e5151d0006
Reviewed-on: https://chromium-review.googlesource.com/707095
Reviewed-by: Henrik Grunell <grunell@chromium.org>
Commit-Queue: Henrik Grunell <grunell@chromium.org>
Cr-Commit-Position: refs/heads/master@{#507368}
[modify] https://crrev.com/7d7e5dde14bdadfb575489de9ff594bf6b51216a/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs
Project Member

Comment 10 by bugdroid1@chromium.org, Oct 20 2017 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/ac97286cb65c89d7e6ee8f05a21044270b0d2e48

commit ac97286cb65c89d7e6ee8f05a21044270b0d2e48
Author: David Tseng <dtseng@chromium.org>
Date: Fri Oct 20 03:10:51 2017

Re-enable chromevox_tests PanelTest.*

The related change:
https://chromium-review.googlesource.com/728302

exposed flakes in tests against the ChromeVox Panel and seems to resolve them.
It is worth trying to re-enable this suite after the above change.

Bug: 751046
Cq-Include-Trybots: master.tryserver.chromium.linux:closure_compilation
Change-Id: Ieff40dab0f4e272225c28478fa4146cf51b06623
Reviewed-on: https://chromium-review.googlesource.com/728999
Reviewed-by: Dominic Mazzoni <dmazzoni@chromium.org>
Commit-Queue: David Tseng <dtseng@chromium.org>
Cr-Commit-Position: refs/heads/master@{#510313}
[modify] https://crrev.com/ac97286cb65c89d7e6ee8f05a21044270b0d2e48/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs
Project Member

Comment 11 by bugdroid1@chromium.org, Dec 20 2017 

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/05db5cce0ff2f6b7dcad67b9f63af15e0f484a59

commit 05db5cce0ff2f6b7dcad67b9f63af15e0f484a59
Author: Mitsuru Oshima <oshima@chromium.org>
Date: Wed Dec 20 20:57:55 2017

[Sheriff] Disable flaky PanelTest.ActivateMenu test

BUG=795840, 751046
TEST=None
TBR=dtseng@chromium.org, grunell@chromium.org, dpranke@chromium.org, jkrcal@chromium.org, rogerm@chromium.org

Cq-Include-Trybots: master.tryserver.chromium.linux:closure_compilation
Change-Id: I13ac4e0e2649acab576c0a70a7dff888219e6c77
Reviewed-on: https://chromium-review.googlesource.com/836734
Commit-Queue: Roger McFarlane <rogerm@chromium.org>
Reviewed-by: David Tseng <dtseng@chromium.org>
Reviewed-by: Dirk Pranke <dpranke@chromium.org>
Reviewed-by: Mitsuru Oshima <oshima@chromium.org>
Reviewed-by: Roger McFarlane <rogerm@chromium.org>
Cr-Commit-Position: refs/heads/master@{#525448}
[modify] https://crrev.com/05db5cce0ff2f6b7dcad67b9f63af15e0f484a59/chrome/browser/resources/chromeos/chromevox/cvox2/background/panel_test.extjs

Comment 12 by tbuck...@chromium.org, Jan 19 2018

Components: Infra>Flakiness

Comment 13 by dpranke@chromium.org, Jan 22 2018

Labels: Test-Disabled
Adding Test-Disabled label, the Tests>Disabled component is going away.

Comment 14 by cthomp@chromium.org, Feb 16 2018 

It looks like PanelTest.LinkMenu was re-enabled, but it now appears to be quite flaky again. A majority of runs appear to be timing out:

https://test-results.appspot.com/dashboards/flakiness_dashboard.html#testType=chromevox_tests&tests=PanelTest.LinkMenu&showExpectations=true

And lots of builds are failing with and without patches:

https://ci.chromium.org/buildbot/tryserver.chromium.chromiumos/linux-chromeos-rel/?limit=200

(Related: Retrying a recent CL got it through this test after failing multiple times due to timing out https://ci.chromium.org/buildbot/tryserver.chromium.chromiumos/linux-chromeos-rel/61959)
►

Sign in to add a comment