web-platform-test html/browsers/origin/origin-of-data-document.html fails |
||||||
Issue descriptionSee this trybot on the autoroller CL trying to import the test: https://build.chromium.org/p/tryserver.chromium.mac/builders/mac_chromium_rel_ng/builds/296147 It looks like this test was added in https://github.com/w3c/web-platform-tests/pull/3663 to reflect https://github.com/whatwg/html/issues/1753 changing the HTML spec to match Blink's behaviour, but nonetheless the test fails in Blink.
,
Sep 14 2016
Hrm. That's surprising. https://w3c-test.org/html/browsers/origin/origin-of-data-document.html passes when I load it in canary. I wonder why content shell decides that function shouldn't throw... I'll take a look, thanks!
,
Sep 15 2016
Running ToT `content_shell` against https://w3c-test.org/html/browsers/origin/origin-of-data-document.html shows a passing test, and copy-pasting the test into a local layout tests seems successful as well (see https://codereview.chromium.org/2344833002). Strange! :) Are we modifying the test in some way when importing it? Is our `testharness.js` up to date? Can I run the importer locally to see what's going on?
,
Sep 15 2016
Maybe it's because the he tests are being imported into imported/wpt/, not http/? Regardless, patching in the roll CL allows me to reproduce this locally: https://codereview.chromium.org/2331373005
,
Sep 15 2016
Hrm. Are these tests not being run through the WPT server, but from a `file:` URL or something similar?
,
Sep 15 2016
I don't understand what's going on here. I can also reproduce the error if I load that patch locally, but if I load the file itself (e.g. file:///ssd/blink/src/third_party/WebKit/LayoutTests/imported/wpt/html/browsers/origin/origin-of-data-document.html) then the test passes. I need to munge paths though to ensure that testharness loads correctly... I'm not sure how the test works at all if the file is being loaded directly. Do we parse the file at all when importing to make `/resources/` mean something different? There's probably a wiki page on this process somewhere...
,
Sep 15 2016
Looks like it should be running wptserve: https://cs.chromium.org/chromium/src/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/servers/wptserve.py.
,
Sep 15 2016
#6 is correct. All imported/wpt tests are being loaded as file:, unless the flag --enable-wptserve is given when running the tests. In the future we'd like to enable wptserve ( bug 360762 ) but in the meantime we've been blacklisting such tests by putting them in W3CImportExpectations. We do parse the file to make file:///{common,images,media,resources}/ redirect to third_party/WebKit/LayoutTests/imported/wpt/* (https://cs.chromium.org/chromium/src/content/shell/renderer/layout_test/blink_test_runner.cc?l=224) So the next step for this is just to add a line to W3CTestExpectations to skip that test for now (OR: when importing, add a Failure expectations in TestExpectations and a Pass expectation in WPTServeExpectations.)
,
Sep 16 2016
> So the next step for this is just to add a line to W3CTestExpectations to skip that test for now Looks like that has been done already: https://chromium.googlesource.com/chromium/src/+/ccabfd31fd88e080dfb577e6fcc3376ef1f56238 The timing looks close, perhaps this one build just didn't have that commit -- the commit just adds the [Skip] line; the test appears to have been imported previously.
,
Sep 16 2016
Removing Sheriff label, but I'll leave it to mkwst / qyearsley to actually mark it as fixed, once everyone agrees that's true.
,
Sep 16 2016
Thanks iclelland -- the file is now listed in W3CTestExpectations under " crbug.com/490940 : Needs to load extra HTML resources." -- but arguably it should be listed under "Requires http server." This might matter because later if we enable wptserve then we'll try to enable all those tests in that category at once, and if it's under " crbug.com/490940 " then we might forget to try to enable it. mkwst, what do you think?
,
Nov 10 2017
,
Feb 18 2018
|
||||||
►
Sign in to add a comment |
||||||
Comment 1 by jbroman@chromium.org
, Sep 14 2016