rebaseline-cl should bail on missing results |
||
Issue descriptionChris reminded me to file this, but I no longer have the output - reporting from memory, sorry. Ran into this issue with https://codereview.chromium.org/2513303002: - some of the trybots failed to upload the results for whatever reason (e.g. https://storage.googleapis.com/chromium-layout-test-archives/mac10_11_retina_blink_rel/1321/layout-test-results/results.html: NoSuchKey) - rebaseline-cl logged something ("could not download results for platform foo" IIRC), but proceeded with the rebaseline anyway If would be nice if rebaseline-cl failed in this case - otherwise the problem is easy to overlook.
,
Dec 7 2016
The following revision refers to this bug: https://chromium.googlesource.com/chromium/src.git/+/ff4522901de3100f338fc1f606e301ede5e96c3d commit ff4522901de3100f338fc1f606e301ede5e96c3d Author: qyearsley <qyearsley@chromium.org> Date: Wed Dec 07 16:45:32 2016 In webkit-patch rebaseline-cl, abort if results are missing. Reason: In general, if layout test results for some builder cannot be found in GS, and they are not downloaded, then when baselines are deduped, some old (incorrect) baselines may be left behind for those platforms that we couldn't get results for. As-is, rebaseline-cl sort of depends on having results for all support platforms whenever rebaselining in order to get correct results. Main changes in this CL: 1. Results are always fetched, even if tests are directly passed. This way the behavior is consistent regardless of whether the list of tests to rebaseline is explicitly specified or decided based on results. 2. Fetching of the results is done in a method called _fetch_results(), which may raise an exception if any results are missing; this exception is caught in execute(), and an error message is printed. 3. _builds_to_tests is removed, and part of _tests_to_rebaseline is moved to _fetch_results(). buildbot.fetch_results is used instead of buildbot.fetch_layout_test_results. Later, we might consider adding a flag to force continuing with rebaselining even if some results are not available, but I'm not sure if this is necessary. BUG= 669653 Review-Url: https://codereview.chromium.org/2547153002 Cr-Commit-Position: refs/heads/master@{#436982} [modify] https://crrev.com/ff4522901de3100f338fc1f606e301ede5e96c3d/third_party/WebKit/Tools/Scripts/webkitpy/tool/commands/rebaseline_cl.py [modify] https://crrev.com/ff4522901de3100f338fc1f606e301ede5e96c3d/third_party/WebKit/Tools/Scripts/webkitpy/tool/commands/rebaseline_cl_unittest.py
,
Dec 11 2016
|
||
►
Sign in to add a comment |
||
Comment 1 by qyears...@chromium.org
, Nov 30 2016Labels: -Pri-3 Pri-2