Write an autotest that will download and run every PPD we have through CUPS. Do this with 1-3 PDFs. This should be run periodically (weekly?) but not in the CQ as it will be resource intensive and might be a little flaky.
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/892f9e2ea047ef5d77587976266730ca061385d7 commit 892f9e2ea047ef5d77587976266730ca061385d7 Author: ChromeOS Developer <pawliczek@google.com> Date: Thu Aug 23 20:21:04 2018 New autotest for testing large number of PPD files. The purpose of this autotest is to verify that given subset of PPD files work in ChromeOS. Each PPD file is tested with the following procedure: 1. A printer driver is added to CUPS server. 2. Test documents are printed on the configured printer. 3. Raw output from the CUPS server is intercepted by FakePrinter. 4. Obtained outputs are verified (see readme.txt file for details). 5. The printer driver is removed from CUPS server. This procedure is repeated for every PPD file. The number of PPD files may be large (3K+ files). To decrease amount of time needed by the autotest several PPD files are tested simultaneously in parallel threads. BUG= chromium:862784 TEST=Tested on ~20 different boards and all 3.2K PPD files Change-Id: I732bc5e118411258304aa221a0a36f3e8bcc322f Reviewed-on: https://chromium-review.googlesource.com/1173355 Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com> Tested-by: Piotr Pawliczek <pawliczek@chromium.org> Reviewed-by: Kalin Stoyanov <kalin@chromium.org> [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/control.100_digests [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/test_fake_printer.py [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/control.all_digests [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/multithreaded_processor.py [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/platform_PrinterPpds.py [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/readme.txt [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/helpers.py [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/digests/annotation_highlight_square_with_ap.pdf.digests [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/docs/split_streams.pdf [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/control.all [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/digests/embedded_images.pdf.digests [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/docs/embedded_images.pdf [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/digests_blacklist.txt [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/digests/split_streams.pdf.digests [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/fake_printer.py [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/control.all_outputs [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/ppds_all.tar.xz [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/docs/annotation_highlight_square_with_ap.pdf [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/test_multithreaded_processor.py [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/download_ppds_make_archive.py [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/ppds_100.tar.xz [add] https://crrev.com/892f9e2ea047ef5d77587976266730ca061385d7/client/site_tests/platform_PrinterPpds/control.100
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/overlays/chromiumos-overlay/+/43bd5b727bcfbee25082b3936447c5366d52a09c commit 43bd5b727bcfbee25082b3936447c5366d52a09c Author: ChromeOS Developer <pawliczek@chromium.org> Date: Fri Aug 31 02:34:01 2018 New autotest platform_PrinterPpds added to ebuild autotest-tests. The test platform_PrinterPpds is added in another commit. BUG= chromium:862784 TEST=Tested on nautilus ChromeBook CQ-DEPEND=CL:1173355 Change-Id: Idea3b4a3953fdeaa7c2b7d83e1066613fb0613fd Reviewed-on: https://chromium-review.googlesource.com/1173357 Commit-Ready: Kalin Stoyanov <kalin@chromium.org> Tested-by: Piotr Pawliczek <pawliczek@chromium.org> Reviewed-by: Sean Kau <skau@chromium.org> [modify] https://crrev.com/43bd5b727bcfbee25082b3936447c5366d52a09c/chromeos-base/autotest-tests/autotest-tests-9999.ebuild
Are we waiting to setup the weekly suite before closing this out?
Right. i would like to get infra team input before I add a new suite.
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/ad0b897354366724d3ce5eeeab933b99e3a273f0 commit ad0b897354366724d3ce5eeeab933b99e3a273f0 Author: Piotr Pawliczek <pawliczek@chromium.org> Date: Sat Oct 27 00:19:16 2018 New version of autotest for PPD files verification New version of autotest for testing all PPD files. It introduces the following changes: - It can analyze a pipeline dumped by CUPS and rerun it outside CUPS server. It allows for separate analysis of each pipeline's step. For now, this kind of analysis requires CUPS patching and must be started by hand. See readme.txt file for more details. - New class Archiver for on-the-fly compression of gathered output files. It allows to store on the device large number of similar files in compressed form. - Improved procedure for digest calculation. - Updated archives with PPD files to test. BUG= chromium:862784 ,chromium:880935 TEST=Tested on nautilus, veyron_minnie and elm Change-Id: Ia0eb469fdf4fcd5326d2363cf7169c4fd876f3e6 Reviewed-on: https://chromium-review.googlesource.com/1291869 Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com> Tested-by: Piotr Pawliczek <pawliczek@chromium.org> Reviewed-by: Sean Kau <skau@chromium.org> Reviewed-by: Kalin Stoyanov <kalin@chromium.org> [add] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/cups_log_pipelines.patch [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/digests/annotation_highlight_square_with_ap.pdf.digests [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/ppds_100.tar.xz [add] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/archiver.py [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/control.all_digests [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/digests/embedded_images.pdf.digests [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/digests/split_streams.pdf.digests [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/multithreaded_processor.py [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/control.all [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/control.all_outputs [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/digests_blacklist.txt [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/ppds_all.tar.xz [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/platform_PrinterPpds.py [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/readme.txt [modify] https://crrev.com/ad0b897354366724d3ce5eeeab933b99e3a273f0/client/site_tests/platform_PrinterPpds/helpers.py
Ping - Is this one fixed?
Yes, this should be fixed. The test started running. problems with execution will be tracked in new bug(s).
Comment 1 by skau@chromium.org
, Aug 13Status: Assigned (was: Available)