New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 822132 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Apr 2018
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Android
Pri: 2
Type: Bug



Sign in to add a comment

Ringmark test fail

Reported by ruch...@samsung.com, Mar 15 2018

Issue description

Steps to reproduce the problem:
1. Open url rng.io in chrome browser
2. Observe

What is the expected behavior?
Ringmark is a web-based test suite that measures how well a mobile browser supports the capabilities that modern mobile web apps require. The main result from running a mobile browser through the Ringmark test suite is the number of the highest ring that the browser passed. The Ringmark test suite has been developed by Facebook and Bocoup.

Ringmark test should not fail.

What went wrong?
Ringmark Test failed.

Did this work before? N/A 

Does this work in other browsers? N/A

Chrome version: 64.0.3282.137  Channel: n/a
OS Version: O-OS
Flash Version: 

Device model number (e.g. G955W): J737V
Android version: O-OS
Chrome version : 64.0.3282.137
 

Comment 1 by ruch...@samsung.com, Mar 15 2018

Please find the attached logs and screenshot.
Additional failures have been highlighted. The highlighted failures are newly observed and were not seen in other models.
log_J737VVRU0ARC3_201803081518.7z
3.8 MB Download
Screenshot_20180308-150913_Chrome.jpg
153 KB View Download
Screenshot_20180308-150946_Chrome.jpg
138 KB View Download
Labels: Needs-triage-Mobile
Cc: sandeepkumars@chromium.org
Components: Blink>WebRTC
Labels: Target-67 FoundIn-67 M-65 M-67 Triaged-Mobile Target-66
Status: Untriaged (was: Unconfirmed)
Tested the issue in Android and able to reproduce the issue as per the steps mentioned in original comment. Observed Ringmark Test failed

Chrome versions tested:
65.0.3325.109(Stable), 67.0.3371.0(Canary)

OS:
Android 7.0.0

Android Devices:
Samsung J7

Please navigate to below link for log's and video--
go/chrome-androidlogs/822132

This seems to be a Non-Regression as same behavior is seen since M58.

Thanks!!

Comment 4 by guidou@chromium.org, Mar 16 2018

Components: -Blink>WebRTC
Removing Blink>WebRTC for further triaging. 
I tested rng.io in a couple of devices and Chrome versions and WebRTC tests always passed. Other tests failed.

Comment 5 by cmasso@google.com, Mar 21 2018

Components: Blink
Components: -Blink Blink>SecurityFeature
screenshot shows iframe sandboxing issues related to allowScript

Comment 7 by mkwst@chromium.org, Mar 27 2018

Components: -Blink>SecurityFeature
The iframe sandbox issue is a problem with the test, not with our support. It's checking the following:

```
assert(!c.contentWindow, "sandbox iframe is blocked")
```

That assertion is incorrect: the parent frame can reference the window (it couldn't otherwise do `postMessage()` for instance).

Dropping the security component, can leave this open for the other failures.
Components: Blink

Comment 9 by rtoy@chromium.org, Mar 29 2018

Cc: rtoy@chromium.org
Components: -Blink Blink>CSS
Not sure what the video in c#3 is supposed to show.  It doesn't even run rng.io.

Even on desktop (Linux, chrome 66 beta),  I see failures in ring 1 and 2:

Ring 1:
CSS Overflow Scrolling
HTML5 Forms, Inputs (datetime missing?)
Media Capture Input

Ring 2:
Animation timing
CSS Element
CSS Flexbox
CSS3 Images
CSS3 Images, Standard
CSS Overflow Scrolling, Standard
iframe SandBoxing
Network Info

For further triage, setting component to CSS to triage this first issue.

Comment 10 by e...@chromium.org, Mar 30 2018

Cc: futhark@chromium.org cbiesinger@google.com
Status: Available (was: Untriaged)
Status: WontFix (was: Available)
Ringmark is very outdated. Overflow scrolling is a -webkit- prefixes property which was removed in 2013. The flexbox test failures are for properties which may have been part of a spec ages ago.

If you think there are failing tests which are real bugs, file them separately with references to recent specs.

Sign in to add a comment