New issue
Advanced search Search tips

Issue 805998 link

Starred by 2 users

Issue metadata

Status: Duplicate
Merged: issue 622387
Owner:
Closed: Apr 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Linux , Windows , Chrome , Mac
Pri: 1
Type: Bug
Team-Accessibility



Sign in to add a comment

"DumpAccessibilityTreeTest.AccessibilityIframePadding" is flaky

Project Member Reported by chromium...@appspot.gserviceaccount.com, Jan 25 2018

Issue description

"DumpAccessibilityTreeTest.AccessibilityIframePadding" is flaky.

This issue was created automatically by the chromium-try-flakes app. Please find the right owner to fix the respective test/step and assign this issue to them. If the step/test is infrastructure-related, please add Infra-Troopers label and change issue status to Untriaged. When done, please remove the issue from Sheriff Bug Queue by removing the Sheriff-Chromium label.

We have detected 10 recent flakes. List of all flakes can be found at https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyPwsSBUZsYWtlIjREdW1wQWNjZXNzaWJpbGl0eVRyZWVUZXN0LkFjY2Vzc2liaWxpdHlJZnJhbWVQYWRkaW5nDA.

Flaky tests should be disabled within 30 minutes unless culprit CL is found and reverted. Please see more details here: https://sites.google.com/a/chromium.org/dev/developers/tree-sheriffs/sheriffing-bug-queues#triaging-auto-filed-flakiness-bugs
 
[ RUN      ] DumpAccessibilityTreeTest.AccessibilityIframePadding
DevTools listening on ws://127.0.0.1:55824/devtools/browser/c83ed2bf-493d-4634-8002-61ced2bf67ee
[29128:6151:0125/072110.378178:WARNING:vt_video_decode_accelerator_mac.cc(177)] Failed to create VTDecompressionSession: Error Domain=NSOSStatusErrorDomain Code=-8973 "The operation couldn’t be completed. (OSStatus error -8973.)" (codecOpenErr) (-8973)
[29128:6151:0125/072110.380127:WARNING:vt_video_decode_accelerator_mac.cc(199)] Failed to create hardware VideoToolbox session
[29128:6151:0125/072110.477994:ERROR:vt_video_encode_accelerator_mac.cc(517)]  VTCompressionSessionCreate failed: -12908
[29123:7175:0125/072110.767894:INFO:dump_accessibility_browsertest_base.cc(240)] Testing: /b/swarm_slave/w/ir/content/test/data/accessibility/html/iframe-padding.html
[29123:7175:0125/072110.768059:INFO:dump_accessibility_browsertest_base.cc(242)] Expected output: /b/swarm_slave/w/ir/content/test/data/accessibility/html/iframe-padding-expected-blink.txt
../../content/browser/accessibility/dump_accessibility_browsertest_base.cc:371: Failure
Value of: is_different
  Actual: true
Expected: false
[29123:7175:0125/072111.194014:ERROR:dump_accessibility_browsertest_base.cc(396)] Diff:
* Line Expected
- ---- --------
     1 rootWebArea pageLocation=(0, 0)
     2 ++iframe pageLocation=(0, 0) pageSize=(300, 100)
     3 ++++rootWebArea pageLocation=(0, 0) pageSize=(300, 100)
     4 ++++++genericContainer pageLocation=(0, 0) pageSize=(300, 100)
     5 ++++++++button pageLocation=(25, 25) pageSize=(250, 50) name='Ordinary Button'
     6 ++iframe pageLocation=(30, 230) pageSize=(300, 100)
     7 ++++rootWebArea pageLocation=(30, 230) pageSize=(300, 100)
*    8 ++++++genericContainer pageLocation=(30, 230) pageSize=(300, 100)
     9 ++++++++button pageLocation=(55, 255) pageSize=(250, 50) name='Ordinary Button'
    10 <-- End-of-file -->
Actual
------
rootWebArea pageLocation=(0, 0)
++iframe pageLocation=(0, 0) pageSize=(300, 100)
++++rootWebArea pageLocation=(0, 0) pageSize=(300, 100)
++++++genericContainer pageLocation=(0, 0) pageSize=(300, 100)
++++++++button pageLocation=(25, 25) pageSize=(250, 50) name='Ordinary Button'
++iframe pageLocation=(30, 230) pageSize=(300, 100)
++++rootWebArea pageLocation=(30, 230) pageSize=(300, 100)
<-- End-of-file -->
[29123:7175:0125/072111.258955:INFO:dump_accessibility_browsertest_base.cc(225)] File not found: /b/swarm_slave/w/ir/content/test/data/accessibility/html/iframe-padding-expected-mac.txt
[29123:7175:0125/072111.259041:INFO:dump_accessibility_browsertest_base.cc(226)] No expectation file present, ignoring test on this platform. To run this test anyway, create /b/swarm_slave/w/ir/content/test/data/accessibility/html/iframe-padding-expected-mac.txt (it can be empty) and then run content_browsertests with the switch: --generate-accessibility-test-expectations
[29123:35335:0125/072111.334700:WARNING:discardable_shared_memory_manager.cc(436)] Some MojoDiscardableSharedMemoryManagerImpls are still alive. They will be leaked.
[  FAILED  ] DumpAccessibilityTreeTest.AccessibilityIframePadding, where TypeParam =  and GetParam() =  (1557 ms)
Labels: -Sheriff-Chromium OS-Chrome OS-Linux OS-Mac OS-Windows
Owner: dmazz...@chromium.org
The test is flaky on all the platforms. Moving to dmazzoni@
Project Member

Comment 3 by chromium...@appspot.gserviceaccount.com, Jan 26 2018

Labels: Sheriff-Chromium
Detected 11 new flakes for test/step "DumpAccessibilityTreeTest.AccessibilityIframePadding". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyPwsSBUZsYWtlIjREdW1wQWNjZXNzaWJpbGl0eVRyZWVUZXN0LkFjY2Vzc2liaWxpdHlJZnJhbWVQYWRkaW5nDA. This message was posted automatically by the chromium-try-flakes app. Since flakiness is ongoing, the issue was moved back into Sheriff Bug Queue (unless already there).
Project Member

Comment 4 by chromium...@appspot.gserviceaccount.com, Jan 27 2018

Detected 5 new flakes for test/step "DumpAccessibilityTreeTest.AccessibilityIframePadding". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyPwsSBUZsYWtlIjREdW1wQWNjZXNzaWJpbGl0eVRyZWVUZXN0LkFjY2Vzc2liaWxpdHlJZnJhbWVQYWRkaW5nDA. This message was posted automatically by the chromium-try-flakes app.
Project Member

Comment 5 by chromium...@appspot.gserviceaccount.com, Jan 29 2018

Detected 3 new flakes for test/step "DumpAccessibilityTreeTest.AccessibilityIframePadding". To see the actual flakes, please visit https://chromium-try-flakes.appspot.com/all_flake_occurrences?key=ahVzfmNocm9taXVtLXRyeS1mbGFrZXNyPwsSBUZsYWtlIjREdW1wQWNjZXNzaWJpbGl0eVRyZWVUZXN0LkFjY2Vzc2liaWxpdHlJZnJhbWVQYWRkaW5nDA. This message was posted automatically by the chromium-try-flakes app.
Cc: aboxhall@chromium.org
Components: UI>Accessibility
Labels: Test-D
Disabling the test in Win, the CL is https://chromium-review.googlesource.com/c/chromium/src/+/891318.
Project Member

Comment 7 by bugdroid1@chromium.org, Jan 29 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/d62a496e14718110435ff7ff4d4d571348b9bc08

commit d62a496e14718110435ff7ff4d4d571348b9bc08
Author: vitaliii <vitaliii@chromium.org>
Date: Mon Jan 29 16:07:50 2018

Disable DumpAccessibilityTreeTest.AccessibilityIframePadding on Win.

Disable DumpAccessibilityTreeTest.AccessibilityIframePadding in Win,
because it fails flakily on Win7 and Win10.

TBR=dmazzoni@chromium.org

Bug:  805998 
Change-Id: I05e798cf1249cc8d568c4ed580f0041606cfba3f
Reviewed-on: https://chromium-review.googlesource.com/891318
Commit-Queue: vitaliii <vitaliii@chromium.org>
Reviewed-by: vitaliii <vitaliii@chromium.org>
Cr-Commit-Position: refs/heads/master@{#532447}
[modify] https://crrev.com/d62a496e14718110435ff7ff4d4d571348b9bc08/content/browser/accessibility/dump_accessibility_tree_browsertest.cc

Labels: -Sheriff-Chromium -Test-D Test-Disabled
Cc: linds...@chromium.org
Status: Assigned (was: Untriaged)
@dmazzoni@ can you PTAL as this disable reduces test coverage?
Labels: a11y-secondary
Project Member

Comment 12 by bugdroid1@chromium.org, Feb 26 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/90f0020c78656929254daa261e2cb50217cba1b1

commit 90f0020c78656929254daa261e2cb50217cba1b1
Author: Dominic Mazzoni <dmazzoni@chromium.org>
Date: Mon Feb 26 22:24:28 2018

Fix flakiness in DumpAccessibilityTreeTest.AccessibilityIframePadding

We have logic to iterate over all frames and wait for them to finish
loading, but that logic doesn't work if there are two frames with the
same url. Change the test to use frames with different urls.

Bug:  805998 
Change-Id: I4d7d514cc0d638a95b2ddf445a7dbf59f1d73cef
Tbr: aboxhall@chromium.org
Reviewed-on: https://chromium-review.googlesource.com/938028
Reviewed-by: Dominic Mazzoni <dmazzoni@chromium.org>
Commit-Queue: Dominic Mazzoni <dmazzoni@chromium.org>
Cr-Commit-Position: refs/heads/master@{#539288}
[modify] https://crrev.com/90f0020c78656929254daa261e2cb50217cba1b1/content/browser/accessibility/dump_accessibility_tree_browsertest.cc
[add] https://crrev.com/90f0020c78656929254daa261e2cb50217cba1b1/content/test/data/accessibility/html/frame/button2.html
[modify] https://crrev.com/90f0020c78656929254daa261e2cb50217cba1b1/content/test/data/accessibility/html/iframe-padding-expected-blink.txt
[modify] https://crrev.com/90f0020c78656929254daa261e2cb50217cba1b1/content/test/data/accessibility/html/iframe-padding.html

Thank you! Is this fixed now?
Labels: Hotlist-DisableReview
Just to update:

DumpAccessibilityTreeTest.AccessibilityIframePadding

Same flaky issue observed on Mac 64 build on official desktop builder.

Builder URL:
------------
https://uberchromegw.corp.google.com/i/official.desktop/builders/mac64/builds/2780

Error log URL:
-------------
https://logs.chromium.org/v/?s=chrome%2Fbb%2Fofficial.desktop%2Fmac64%2F2780%2F%2B%2Frecipes%2Fsteps%2FUpload_to_test-results__browser_tests_%2F0%2Fstdout

Thanks..!

Mergedinto: 622387
Status: Duplicate (was: Started)

Sign in to add a comment