New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 707891 link

Starred by 2 users

Issue metadata

Status: Verified
Owner:
Closed: Nov 16
Cc:
Components:
EstimatedDays: ----
NextAction: 2017-12-11
OS: ----
Pri: 3
Type: ----


Sign in to add a comment

Support webkit layout tests once they run on Swarming

Project Member Reported by st...@chromium.org, Apr 3 2017

Issue description

Webkit layout tests are to be run on Swarming soon.

To support it, Findit needs to know how to parse its output format for the output file on Isolate server.

Some command line switches are also needed in the webkit layout test runner.
 

Comment 1 by st...@chromium.org, Apr 4 2017

Blockedon: 650747
Components: -Tools>Test>FindIt>Flakiness Tools>Test>FindIt

Comment 2 by st...@chromium.org, Apr 21 2017

Blocking: 666132

Comment 3 by st...@chromium.org, Apr 21 2017

Cc: jeffcarp@chromium.org qyears...@chromium.org
 Issue 666119  has been merged into this issue.

Comment 4 by st...@chromium.org, Nov 6 2017

Cc: robertma@chromium.org foolip@chromium.org
NextAction: 2018-03-01

Comment 5 by st...@chromium.org, Nov 7 2017

NextAction: 2017-12-11
sync up between Findit team and Ecosystem Infra team.
The NextAction date has arrived: 2017-12-11
Hi everyone! How's the Q1 planning going? Shall we have a quick sync on this task?

Comment 8 by st...@chromium.org, Jan 25 2018

Cc: -chanli@chromium.org dpranke@chromium.org seanmccullough@chromium.org
Components: Blink>Infra>Ecosystem
Owner: chanli@chromium.org
Status: Started (was: Available)
The mapped-out details are all in https://docs.google.com/document/d/1D74Avu19avncJLZFrEPj39FtK-NkTzsKCh_4IyTC5fs/edit

Assigned to chanli@ to follow up.

Comment 9 by chanli@chromium.org, Jan 25 2018

Blockedon: 806002
 Issue 650747  has been fixed, is there anything more needed for this to progress?
At Findit side, I need to implement the parser to parse the json_test_results_format. I plan to do this next week. I'll update the  bug 806002  when I have progress.
Blockedon: 831337
Blockedon: 836994
Blockedon: 828605
Project Member

Comment 15 by bugdroid1@chromium.org, May 30 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra/+/79e0cdcb73a57b4b3e8a710a7408a73c455a6417

commit 79e0cdcb73a57b4b3e8a710a7408a73c455a6417
Author: Chan <chanli@chromium.org>
Date: Wed May 30 23:49:41 2018

[Findit] Modify step_mapper to make sure it doesn't only work for one kind of test results.

Step_mapper checks test_reuslt['all_tests'] before, but this is a gtest specific logic, update the logic to be test_result type nutral.

Bug:  707891 
Change-Id: Idfda428dd4b29d13595be594fbf2f723e2e42d38
Reviewed-on: https://chromium-review.googlesource.com/1079813
Reviewed-by: Jeffrey Li <lijeffrey@chromium.org>
Commit-Queue: Chan Li <chanli@chromium.org>

[modify] https://crrev.com/79e0cdcb73a57b4b3e8a710a7408a73c455a6417/appengine/findit/waterfall/flake/step_mapper.py

Project Member

Comment 16 by bugdroid1@chromium.org, Jun 1 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra/+/981cbe0b51755736035e6a0caac1fad9ad859eb4

commit 981cbe0b51755736035e6a0caac1fad9ad859eb4
Author: Chan <chanli@chromium.org>
Date: Fri Jun 01 00:32:13 2018

[Findit] Check step_name to determine if a test step is supported by Flake Analyzer.

Bug:707891
Change-Id: I7b39e71fc698ed0045dec5b45ed973d5fd2796bf
Reviewed-on: https://chromium-review.googlesource.com/1081507
Reviewed-by: Shuotao Gao <stgao@chromium.org>
Commit-Queue: Chan Li <chanli@chromium.org>

[modify] https://crrev.com/981cbe0b51755736035e6a0caac1fad9ad859eb4/appengine/findit/waterfall/flake/test/step_mapper_test.py
[modify] https://crrev.com/981cbe0b51755736035e6a0caac1fad9ad859eb4/appengine/findit/waterfall/flake/step_mapper.py

I am running some tests and here is a successful Findit analysis on a consistent test failure in webkit_layout_tests: https://15779-7ba6196-dot-waterfall-frontend-dot-findit-for-me.appspot.com/waterfall/build-failure?url=https://luci-milo.appspot.com/buildbot/chromium.webkit/WebKit%20Win10/35742

I'll run more tests (both for findit analysis and flake analysis) to make sure it's stable.

Blockedon: 850255 851639
I believed that we could close this bug, since Webkit layout tests were supported back in June.
Status: Verified (was: Started)

Sign in to add a comment