New issue
Advanced search Search tips

Issue 692866 link

Starred by 1 user

Issue metadata

Status: WontFix
Owner: ----
Closed: Jan 3
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: ----
Pri: 3
Type: Bug



Sign in to add a comment

Remove --fully-parallel flag of run-webkit-tests

Project Member Reported by tansell@chromium.org, Feb 16 2017

Issue description

Running webkit layout tests with --fully-parallel doesn't really do anything that useful.

The --fully-parallel flag splits every test (which isn't inside a virtual suite) into its own "shard". The worker kills the driver (content shell) after every "shard". There is a hack which keeps a virtual suite together.

This effectively means that fully-parallel is pretty much identical to run-singular.

This behaviour could be happening because;
 * The worker use to only restart the driver if flag changed?
 * The resize function use to combined shards back together in some way?

We should either;
 * Remove --fully-parallel
 * Make it do something useful.

 
My general feeling is usually: if something appears not to be necessary, then removing it is usually the easiest way to go, and you probably won't miss it :-D
Cc: jeffcarp@chromium.org
Owner: ----
Status: Available (was: Assigned)
I think we should just remove the flag.
qyearsley@ / jeffcarp@ - What is the status of this? Is someone going to remove it?
Labels: Hotlist-CodeHealth Hotlist-GoodFirstBug
No current plans, but I support removing it. This bug is free for anyone to take :-)
Summary: Remove --fully-parallel flag of run-webkit-tests (was: LayoutTests --fully-parallel is broken / not particularly useful)
Cc: mstensho@chromium.org
I'd like to revert this. I'm using -f all the time.

When running fast/multicol/ tests locally now:
Found 628 tests; running 628, skipping 0.
WARNING: fully_parallel flag is deprecated.
Running 9 content_shells in parallel.

Before this CL:
Found 628 tests; running 628, skipping 0.
Running 56 content_shells in parallel.                                                      

(I have 56 logical cores)
Cc: dpranke@chromium.org
Alright -

My original understanding of this bug was:
 (1) --fully-parallel appeared to be equivalent to --run-singly
 (2) --fully-parallel wasn't clearly useful

Since it appears this isn't actually the case, I think we actually want to keep this flag. I've confirmed that on my machine, after this CL 9 content_shells are run in parallel

Although, I seem to recall that rwt used to always set the number of parallel content_shells to match the number of logical cores... maybe I'm remembering incorrectly?
Seems to me that the number of parallel content_shells won't be larger than the number of subdirectories.

Unless you use -f. Then the number of parallel content_shells will be min(the number of tests, the number of logical cores).

Unless we're talking about tests in virtual/. Then we're limited by the number of subdirectories again, even with -f.

Thanks for reverting!
Cc: -jeffcarp@chromium.org
I believe we want to just close this as WontFix after https://crrev.com/c/847872 lands.
Project Member

Comment 13 by bugdroid1@chromium.org, Jan 3 2018

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/17bf9b43456ca673be66f5b72bd0e432b6339547

commit 17bf9b43456ca673be66f5b72bd0e432b6339547
Author: Quinten Yearsley <qyearsley@chromium.org>
Date: Wed Jan 03 01:09:59 2018

Revert "Remove --fully-parallel from tests."

This reverts commit e71979baadfbc952e5173e9e1df739f422bdf461.

Reason for revert: mstensho@ reports that this flag is actually still useful and we still want to keep it.

Original change's description:
> Remove --fully-parallel from tests.
> 
> Bug:  692866 
> Change-Id: I0530db53a88da0eaf8c813f41047832ed6bbbc0d
> Reviewed-on: https://chromium-review.googlesource.com/741106
> Commit-Queue: Quinten Yearsley <qyearsley@chromium.org>
> Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>
> Cr-Commit-Position: refs/heads/master@{#525379}

TBR=qyearsley@chromium.org,mjkim610@gmail.com

# Not skipping CQ checks because original CL landed > 1 day ago.

Bug:  692866 
Change-Id: I1d694c1ef7437f784aa2cb2de47850fd68b4d3ab
Reviewed-on: https://chromium-review.googlesource.com/847872
Reviewed-by: Quinten Yearsley <qyearsley@chromium.org>
Reviewed-by: Morten Stenshorne <mstensho@chromium.org>
Commit-Queue: Quinten Yearsley <qyearsley@chromium.org>
Cr-Commit-Position: refs/heads/master@{#526559}
[modify] https://crrev.com/17bf9b43456ca673be66f5b72bd0e432b6339547/docs/testing/layout_tests.md
[modify] https://crrev.com/17bf9b43456ca673be66f5b72bd0e432b6339547/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner.py
[modify] https://crrev.com/17bf9b43456ca673be66f5b72bd0e432b6339547/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/controllers/layout_test_runner_unittest.py
[modify] https://crrev.com/17bf9b43456ca673be66f5b72bd0e432b6339547/third_party/WebKit/Tools/Scripts/webkitpy/layout_tests/run_webkit_tests.py

Project Member

Comment 14 by sheriffbot@chromium.org, Jan 3

Labels: Hotlist-Recharge-Cold
Status: Untriaged (was: Available)
This issue has been Available for over a year. If it's no longer important or seems unlikely to be fixed, please consider closing it out. If it is important, please re-triage the issue.

Sorry for the inconvenience if the bug really should have been left as Available.

For more details visit https://www.chromium.org/issue-tracking/autotriage - Your friendly Sheriffbot
Status: WontFix (was: Untriaged)
WontFix as per comment 12.

Sign in to add a comment