New issue
Advanced search Search tips

Issue 893466 link

Starred by 3 users
Status: Available
Owner: ----
Cc:
robertma@chromium.org
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Feature



Sign in to add a comment

Improve Web Platform Tests changes flow

Project Member Reported by fbeaufort@chromium.org, Oct 9 
I'd like to make sure my Chromium changes affect Web Platform Tests in a way I intended to.

And here's what the flow could be:

1. Open CL
2. Blink WPT Bot catches up changes (even though third_party/WebKit/LayoutTests may not be updated)
3. Blink WPT Bot offers a UI such as https://wpt.fyi/results/
  - This allows me to see existing Chrome Dev, Firefox Nightly, Edge, and Safari Technology Preview results with my Web Platform Test changes (updated or not)
  - There's an extra column for the Chromium build (latest patch) I'm working on
  - A diff between the Chromium build (with and without patch) would be great as well.

Comment 1 by foolip@chromium.org, Oct 9

Cc: robertma@chromium.org
robertma@ can you assess feasibility / work involved?

In order to get results onto wpt.fyi, at the very least we would need to produce a wpt_report.json in of the `./wpt run --log-wptreport` variety for upload to wpt.fyi.

If the tests were modified, then for other browsers (including Chrome Dev) we'd need to rely on results from the export PR, which we'll have for at least Chrome Dev and Firefox Nightly, but perhaps also Safari Technology Preview, soon.

For the diff, we'd need a wpt_report.json for content_shell without the changes. We could get approximately this from the waterfall builders, or exactly this if we store *all* expected results in-tree.

Comment 2 by foolip@chromium.org, Oct 11

Status: Available (was: Unconfirmed)
►

Sign in to add a comment