Add functionality to update expectations files based on failures. |
|||||||
Issue descriptionAfter updating w3c tests, we want to wait until there are try job results, look at the failures on different platforms, and depending on the failures we then want to update TestExpectations or W3CImportExpectations. This is required for issue 625253 .
,
Jul 7 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/56797ef5d98f8aaebe5c534ad760b4ad9befb194 commit 56797ef5d98f8aaebe5c534ad760b4ad9befb194 Author: dcampb <dcampb@google.com> Date: Thu Jul 07 03:45:01 2016 Add get_issue_number function to webkitpy/common/checkout/scm/git.py This CL adds a "git cl issue" function that returns the issue number if one is associated with a branch and "None" otherwise. Also adds unit test located in webkitpy/common/checkout/scm/scm_unittest.py BUG= 625254 Review-Url: https://codereview.chromium.org/2129733002 Cr-Commit-Position: refs/heads/master@{#404065} [modify] https://crrev.com/56797ef5d98f8aaebe5c534ad760b4ad9befb194/third_party/WebKit/Tools/Scripts/webkitpy/common/checkout/scm/git.py [modify] https://crrev.com/56797ef5d98f8aaebe5c534ad760b4ad9befb194/third_party/WebKit/Tools/Scripts/webkitpy/common/checkout/scm/scm_unittest.py
,
Jul 7 2016
,
Jul 7 2016
,
Jul 8 2016
,
Jul 9 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/f0fd6054bf41efe4882888b877b438bc61e1e21c commit f0fd6054bf41efe4882888b877b438bc61e1e21c Author: dcampb <dcampb@google.com> Date: Sat Jul 09 18:46:26 2016 Add "didnt_run_as_expected_results" to layouttestresults.py. BUG= 625254 Review-Url: https://codereview.chromium.org/2132193002 Cr-Commit-Position: refs/heads/master@{#404565} [modify] https://crrev.com/f0fd6054bf41efe4882888b877b438bc61e1e21c/third_party/WebKit/Tools/Scripts/webkitpy/common/net/layouttestresults.py
,
Jul 21 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/22c2cad13b358a133ae399532ce910c1ebb96073 commit 22c2cad13b358a133ae399532ce910c1ebb96073 Author: dcampb <dcampb@google.com> Date: Thu Jul 21 16:16:34 2016 Create Test Expectation lines automatically from failing test results. BUG= 625254 Review-Url: https://codereview.chromium.org/2136723002 Cr-Commit-Position: refs/heads/master@{#406868} [add] https://crrev.com/22c2cad13b358a133ae399532ce910c1ebb96073/third_party/WebKit/Tools/Scripts/update-w3c-test-expections [add] https://crrev.com/22c2cad13b358a133ae399532ce910c1ebb96073/third_party/WebKit/Tools/Scripts/webkitpy/w3c/update_w3c_test_expectations.py [add] https://crrev.com/22c2cad13b358a133ae399532ce910c1ebb96073/third_party/WebKit/Tools/Scripts/webkitpy/w3c/update_w3c_test_expectations_unittest.py
,
Jul 23 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/e2d465d888b64ea9053cd03ab2af8623dc05a4de commit e2d465d888b64ea9053cd03ab2af8623dc05a4de Author: dcampb <dcampb@google.com> Date: Sat Jul 23 04:02:14 2016 Adds functionality to update-w3c-test-expectations This cl adds functionality to the skip so that it skips adding the failing test line if it already exists in TestExpectations. BUG= 625254 Review-Url: https://codereview.chromium.org/2174073002 Cr-Commit-Position: refs/heads/master@{#407349} [modify] https://crrev.com/e2d465d888b64ea9053cd03ab2af8623dc05a4de/third_party/WebKit/Tools/Scripts/webkitpy/w3c/update_w3c_test_expectations.py [modify] https://crrev.com/e2d465d888b64ea9053cd03ab2af8623dc05a4de/third_party/WebKit/Tools/Scripts/webkitpy/w3c/update_w3c_test_expectations_unittest.py
,
Jul 25 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/9756dcab651b7c31a1bc029d68800e71bc6dae16 commit 9756dcab651b7c31a1bc029d68800e71bc6dae16 Author: dcampb <dcampb@google.com> Date: Mon Jul 25 00:48:12 2016 Change w3c-test-expectations file name Fix the spelling error in the file name. expection --> expectations. BUG= 625254 Review-Url: https://codereview.chromium.org/2176983002 Cr-Commit-Position: refs/heads/master@{#407394} [rename] https://crrev.com/9756dcab651b7c31a1bc029d68800e71bc6dae16/third_party/WebKit/Tools/Scripts/update-w3c-test-expectations
,
Jul 27 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/201b0fae1eb4cbd645603683631fa3959faf74b9 commit 201b0fae1eb4cbd645603683631fa3959faf74b9 Author: dcampb <dcampb@google.com> Date: Wed Jul 27 19:48:59 2016 Removes build and builder object references along with minor bug fixes This CL: 1. Removes the uses of build and builder objects in main and get_failing_results_dict. 2. Returns a new dictionary with merged_keys in merge_same_valued_keys. 3. Adds more test failure types to get_expectations to return more accurate expectations. 4. Modifies create_line_list to only create a line if the test name starts with 'imported'. 5. Changes variable names in main. 6. Adds unit tests to cover multiple actual and expected results in get_expectations. BUG= 625254 Review-Url: https://codereview.chromium.org/2183913002 Cr-Commit-Position: refs/heads/master@{#408217} [modify] https://crrev.com/201b0fae1eb4cbd645603683631fa3959faf74b9/third_party/WebKit/Tools/Scripts/webkitpy/w3c/update_w3c_test_expectations.py [modify] https://crrev.com/201b0fae1eb4cbd645603683631fa3959faf74b9/third_party/WebKit/Tools/Scripts/webkitpy/w3c/update_w3c_test_expectations_unittest.py
,
Jul 29 2016
,
Aug 3 2016
,
Aug 3 2016
|
|||||||
►
Sign in to add a comment |
|||||||
Comment 1 by qyears...@chromium.org
, Jul 1 2016Labels: -Type-Bug Type-Feature