add alerts to most graphics tests |
|||
Issue descriptionTake a look at the messages in chromeos-gfx-alerts. Right now the dashboard emails us when performance gets worse. Recording of numbers happens using the output_perf_value() function. To do: 1) Memory values should only be recorded from graphics_WebGLAquarium. All other graphics tests should not record memory from GSC anymore. Memory changes are just too noisy, and a bit ill-defined outside of measuring the browser. 2) We want to use the alerts for tracking regressions. The best way we have right now is to record the number of *failures* encountered by a test. In particular these tests should be changed (do one change each starting from top down): a) graphics_Sanity b) graphics_Gralloc c) graphics_Idle d) graphics_dEQP.gles2-master graphics_dEQP.gles3-master graphics_dEQP.gles31-master graphics_dEQP.vk-master.hasty e) Maybe combine the control files first like in graphics_Gralloc graphics_Drm f) graphics_LibDRM g) maybe too noisy graphics_Stress
,
May 8 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/2cf181995719a3ac5ec8d87216dca84158b4496c commit 2cf181995719a3ac5ec8d87216dca84158b4496c Author: Po-Hsien Wang <pwang@chromium.org> Date: Mon May 08 19:41:02 2017 chromeos-gfx-alerts: don't report memory to dashboard Memory values from test other than graphics_WebGLAquarium will not be reported as memory changes are too noisy and ill-defined outside of measuring the browser. BUG= chromium:717664 TEST=test_that Change-Id: Iddeabb6562f23fe261ed49c956cfd877373faf29 Reviewed-on: https://chromium-review.googlesource.com/495115 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_KernelMemory/graphics_KernelMemory.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_WebGLPerformance/graphics_WebGLPerformance.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_GpuReset/graphics_GpuReset.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_WebGLClear/graphics_WebGLClear.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_GLES2ConformChrome/graphics_GLES2ConformChrome.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_GLMark2/graphics_GLMark2.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_GLBench/graphics_GLBench.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_SanAngeles/graphics_SanAngeles.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_Stress/graphics_Stress.py [modify] https://crrev.com/2cf181995719a3ac5ec8d87216dca84158b4496c/client/site_tests/graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep.py
,
May 8 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/24c5abe03501cc39150385180ea5d21998028c7e commit 24c5abe03501cc39150385180ea5d21998028c7e Author: Po-Hsien Wang <pwang@chromium.org> Date: Mon May 08 19:41:00 2017 graphics_Sanity: report of failure times Use the failure encountered by a test as a alert to track regressions. BUG= chromium:717664 TEST=test_that Change-Id: I9b6f6104b9d1d0a80f4cbb6233b381c69d431f4d Reviewed-on: https://chromium-review.googlesource.com/495116 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/24c5abe03501cc39150385180ea5d21998028c7e/client/site_tests/graphics_Sanity/graphics_Sanity.py
,
May 9 2017
As mentioned elsewhere you will also need to add not yet listed graphics_ tests here to report to the dashboard https://cs.corp.google.com/chromeos_public/src/third_party/autotest/files/tko/perf_upload/perf_dashboard_config.json?q=graphics_SanAngeles+package:%5Echromeos_public$&l=63 (and clean up stale tests).
,
May 10 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/e6c94575afaa0005db9bec96a2ed0da9706d1cdc commit e6c94575afaa0005db9bec96a2ed0da9706d1cdc Author: Po-Hsien Wang <pwang@chromium.org> Date: Wed May 10 18:58:22 2017 perf_dashboard_config.jsoon: Add tests to perf dashboard This CL adds serverl graphics tests to the chrome dashboard located in https://chromeperf.appspot.com BUG= chromium:717664 TEST=jsonlint.com Change-Id: I8efbed0307b4aa7ce1d5ba2b738c89a0057e8afa Reviewed-on: https://chromium-review.googlesource.com/501507 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/e6c94575afaa0005db9bec96a2ed0da9706d1cdc/tko/perf_upload/perf_dashboard_config.json
,
May 12 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/602c866b51bff9a4692d6cfbd3c4593d1334e1b2 commit 602c866b51bff9a4692d6cfbd3c4593d1334e1b2 Author: Po-Hsien Wang <pwang@chromium.org> Date: Fri May 12 05:27:49 2017 graphics_Gralloc.py: report of failure times Use the failure encountered by a test as regressions alert. BUG= chromium:717664 TEST=test_that Change-Id: I4f5d77363594873e1664debe1a28112ecfe2b73a Reviewed-on: https://chromium-review.googlesource.com/498975 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/602c866b51bff9a4692d6cfbd3c4593d1334e1b2/client/site_tests/graphics_Gralloc/graphics_Gralloc.py
,
May 12 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/1dd6af940b1c58aefaad1c218a0309a79512db3e commit 1dd6af940b1c58aefaad1c218a0309a79512db3e Author: Po-Hsien Wang <pwang@chromium.org> Date: Fri May 12 05:27:47 2017 graphics_Idle.py: report of failure counts Use the failure encountered as a regression alert. BUG= chromium:717664 TEST=test_that Change-Id: I18a7285044a8842395e6964cc9761e137af032ed Reviewed-on: https://chromium-review.googlesource.com/503492 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/1dd6af940b1c58aefaad1c218a0309a79512db3e/client/site_tests/graphics_Idle/graphics_Idle.py
,
May 13 2017
We have a graph for graphics_Idle but at the moment not yet for graphics_Gralloc https://chromeperf.appspot.com/report?sid=8ff3ed6bff06d382f3f61603157e78db680427dbc60217fbfb5c02cd046dea5d Should check next week again, but it is looking good so far.
,
May 16 2017
We have graph of graphics_Idle, graphics_Sanity, graphics_Gralloc now. https://chromeperf.appspot.com/report?sid=452105ec92dbcd24d61f9492b2e285a488bc9c5d3df8f606c21f36c9dd2f6d76 graphics_Drm, graphics_LibDRM, graphics_Stress is still pending for review.
,
May 19 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/51809f1dc5415a8fa5c9e6489054ed0fa586d618 commit 51809f1dc5415a8fa5c9e6489054ed0fa586d618 Author: Po-Hsien Wang <pwang@chromium.org> Date: Fri May 19 20:58:00 2017 graphics_LibDRM.py: report of failure count Use failure counts for regression alerts in chromeos-gfx-alerts. BUG= chromium:717664 TEST=test_that on samus Change-Id: Idf708d90109d31036ed30fdd10fad619225ca433 Reviewed-on: https://chromium-review.googlesource.com/503438 Commit-Ready: Ilja H. Friedel <ihf@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/51809f1dc5415a8fa5c9e6489054ed0fa586d618/client/site_tests/graphics_LibDRM/graphics_LibDRM.py
,
May 24 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/3c4fc6f2de5790dad28868d7203cc644e2405dc4 commit 3c4fc6f2de5790dad28868d7203cc644e2405dc4 Author: Po-Hsien Wang <pwang@chromium.org> Date: Wed May 24 21:24:03 2017 [common_lib/test.py]: add append opt to output_perf_value Add append_mode parameter to determine a new perf report should be appended if a existing key is existed or not. If the parameter is set to false, the new perf report will override any existing value. BUG= chromium:717664 TEST=autotest_lib.client.common_lib.test_unittest Change-Id: I54816624cea455408094b66e2d14a1f2783a8c5b Reviewed-on: https://chromium-review.googlesource.com/511222 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/3c4fc6f2de5790dad28868d7203cc644e2405dc4/client/common_lib/test_unittest.py [modify] https://crrev.com/3c4fc6f2de5790dad28868d7203cc644e2405dc4/client/common_lib/test.py
,
May 24 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/461336c81d6c6f16f248d55cdf45c7958a359f60 commit 461336c81d6c6f16f248d55cdf45c7958a359f60 Author: Po-Hsien Wang <pwang@chromium.org> Date: Wed May 24 21:24:03 2017 Add GraphicsTest base class for graphic tests 1) Wrapper class for graphic_* tests 2) Help tests to instantiate GraphicsStateChecker in initialize step 3) Help tests to finalize GraphicsStateChecker in cleanup step 4) Report the Timeout_Reboot status to chrome perf dashboard 5) Report Failures count to chrome perf dashboard BUG= chromium:717664 TEST=test_that glimmer graphics_Idle test_that glimmer graphics_Idle.arc test_that glimmer graphics_LibDRM test_that glimmer graphics_Sanity test_that glimmer graphics_Stress test_that glimmer graphics_Gralloc reboot while test_that glimmer graphics_Sanity Change-Id: I992838ea7db87609dd7ea1a69407097054610bf8 Reviewed-on: https://chromium-review.googlesource.com/511223 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Ilja H. Friedel <ihf@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/461336c81d6c6f16f248d55cdf45c7958a359f60/client/cros/graphics/graphics_utils.py [modify] https://crrev.com/461336c81d6c6f16f248d55cdf45c7958a359f60/client/site_tests/graphics_LibDRM/graphics_LibDRM.py [modify] https://crrev.com/461336c81d6c6f16f248d55cdf45c7958a359f60/client/site_tests/graphics_Stress/graphics_Stress.py [modify] https://crrev.com/461336c81d6c6f16f248d55cdf45c7958a359f60/client/site_tests/graphics_Gralloc/graphics_Gralloc.py [modify] https://crrev.com/461336c81d6c6f16f248d55cdf45c7958a359f60/client/site_tests/graphics_Sanity/graphics_Sanity.py [modify] https://crrev.com/461336c81d6c6f16f248d55cdf45c7958a359f60/client/site_tests/graphics_Idle/graphics_Idle.py
,
May 29 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/b37088622d955642578dd3e517c4074ccca5cbb2 commit b37088622d955642578dd3e517c4074ccca5cbb2 Author: Po-Hsien Wang <pwang@chromium.org> Date: Mon May 29 05:39:13 2017 graphics_Drm.py: Change of test framework 1) Combining persistent passing test into one control file 2) Keep other tests in individual control file as before 3) Change graphics_Drm.py to handle running multiple tests at once BUG= chromium:717664 TEST=test_that on glimmer Change-Id: I4410fed061f45bdca9c45c400c8b15041a66eb03 Reviewed-on: https://chromium-review.googlesource.com/503436 Commit-Ready: Ilja H. Friedel <ihf@chromium.org> Tested-by: Ilja H. Friedel <ihf@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/b37088622d955642578dd3e517c4074ccca5cbb2/client/site_tests/graphics_Drm/control.vgem_test [delete] https://crrev.com/365049f691c80802030f62cf2fce345bb670e00d/client/site_tests/graphics_Drm/control.linear_bo_test [rename] https://crrev.com/b37088622d955642578dd3e517c4074ccca5cbb2/client/site_tests/graphics_Drm/control.bvt [modify] https://crrev.com/b37088622d955642578dd3e517c4074ccca5cbb2/client/site_tests/graphics_Drm/control.mmap_test [delete] https://crrev.com/365049f691c80802030f62cf2fce345bb670e00d/client/site_tests/graphics_Drm/control.vk_glow_test [delete] https://crrev.com/365049f691c80802030f62cf2fce345bb670e00d/client/site_tests/graphics_Drm/control.swrast_test [modify] https://crrev.com/b37088622d955642578dd3e517c4074ccca5cbb2/client/site_tests/graphics_Drm/graphics_Drm.py [rename] https://crrev.com/b37088622d955642578dd3e517c4074ccca5cbb2/client/site_tests/graphics_Drm/control [modify] https://crrev.com/b37088622d955642578dd3e517c4074ccca5cbb2/client/site_tests/graphics_Drm/control.gamma_test [copy] https://crrev.com/b37088622d955642578dd3e517c4074ccca5cbb2/client/site_tests/graphics_Drm/control.vk_glow [delete] https://crrev.com/365049f691c80802030f62cf2fce345bb670e00d/client/site_tests/graphics_Drm/control.drm_cursor_test
,
May 31 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/a9788694a6bf1668324622298116af784e9c186c commit a9788694a6bf1668324622298116af784e9c186c Author: Po-Hsien Wang <pwang@chromium.org> Date: Wed May 31 09:15:27 2017 graphics_Drm.py: report Failure Count Report failure count to chrome perf dashboard as graphics_gfx regression alerts. BUG= chromium:717664 TEST=test_that test graphics_Drm test_that test graphics_Drm.bvt Change-Id: Ic5ed79692c531bc6b3679372100e12cd4cec26a0 Reviewed-on: https://chromium-review.googlesource.com/518266 Commit-Ready: Po-Hsien Wang <pwang@chromium.org> Tested-by: Po-Hsien Wang <pwang@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/a9788694a6bf1668324622298116af784e9c186c/client/site_tests/graphics_Drm/graphics_Drm.py [modify] https://crrev.com/a9788694a6bf1668324622298116af784e9c186c/client/site_tests/graphics_Drm/control.bvt
,
Jun 7 2017
Should we report the failure alerts for other graphics tests such as 1. graphics_WebGLAquarium/ 2. graphics_GLMark2 3. graphics_Gbm/ 4. graphics_GLBench/ 5. graphics_GLAPICheck/ ... As some of them seems quite stable and it should be good to catch failure regression by the email.
,
Jun 7 2017
Yes please. Good idea!
,
Jun 13 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/b6aed51feee1d07fa2465fa3b2fe53cd3f247def commit b6aed51feee1d07fa2465fa3b2fe53cd3f247def Author: Po-Hsien Wang <pwang@chromium.org> Date: Tue Jun 13 05:33:23 2017 Report failure for most of the graphics_test Report failures for most of the graphics_test to chrome perf dashboard for regression detection. 1) Add docstring to graphics_utils.GraphicsTest 2) Add helper function failure_report and failure_report_decorator to GraphicsTest class to help report failures to chrome perf dashboard if function does not finish executation normally. 3) Add failure report for following tests graphics_WebGLAquarium graphics_GLMark2 graphics_Gbm graphics_SanAngeles graphics_WebGLManyPlanetsDeep graphics_GLAPICheck graphics_WebGLPerformance 4) Remaining tests to report failures graphics_GLBench graphics_WebGLClear graphics_KernelMemory graphics_dEQP graphics_GpuReset graphics_PerfControl graphics_VTSwitch 5) Modified tko/perf_upload/perf_dashboard_config.json BUG= chromium:717664 TEST=[1] test_that graphics_WebGLAquarium /tmp/test_that_results_YvUmYu/results-1-graphics_WebGLAquarium [ PASSED ] --------------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[2] test_that graphics_GLMark2 /tmp/test_that_results_IaISZ2/results-1-graphics_GLMark2 [ PASSED ] --------------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[3] test_that graphics_Gbm /tmp/test_that_results_Lz1rvI/results-1-graphics_Gbm [ PASSED ] --------------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[4] test_that graphics_SanAngeles /tmp/test_that_results_4600Gs/results-1-graphics_SanAngeles [ PASSED ] --------------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[5] test_that graphics_WebGLManyPlanetsDeep /tmp/test_that_results_Yw8aAt/results-1-graphics_WebG... [ PASSED ] --------------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[6] test_that graphics_GLAPICheck /tmp/test_that_results_lq1ryW/results-1-graphics_GLAP... [ PASSED ] --------------------------------------------------------------------------- Total PASS: 2/2 (100% TEST=[7] test_that graphics_WebGLPerformance /tmp/test_that_results_9xQJ3_/results-1-graphics_WebG... [ PASSED ] --------------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST= http://jsonlint.com --- Valid JSON Change-Id: Ic3d33373f7d1903472c3951e7e915c1f1afc5fa6 Reviewed-on: https://chromium-review.googlesource.com/528366 Commit-Ready: Ilja H. Friedel <ihf@chromium.org> Tested-by: Ilja H. Friedel <ihf@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/site_tests/graphics_GLMark2/graphics_GLMark2.py [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/cros/graphics/graphics_utils.py [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/tko/perf_upload/perf_dashboard_config.json [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/site_tests/graphics_WebGLPerformance/graphics_WebGLPerformance.py [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/site_tests/graphics_Gbm/graphics_Gbm.py [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/site_tests/graphics_GLAPICheck/graphics_GLAPICheck.py [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/site_tests/graphics_SanAngeles/graphics_SanAngeles.py [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/site_tests/graphics_WebGLManyPlanetsDeep/graphics_WebGLManyPlanetsDeep.py [modify] https://crrev.com/b6aed51feee1d07fa2465fa3b2fe53cd3f247def/client/site_tests/graphics_WebGLAquarium/graphics_WebGLAquarium.py
,
Jul 14 2017
The following revision refers to this bug: https://chromium.googlesource.com/chromiumos/third_party/autotest/+/e4d500e51125622d9cc10d15a5216be4f7aed336 commit e4d500e51125622d9cc10d15a5216be4f7aed336 Author: Po-Hsien Wang <pwang@chromium.org> Date: Fri Jul 14 02:46:15 2017 Report failure for most of the graphics_test Use chrome perf dashboard for regression alerts for graphics tests 1) Add several tests to report failures graphics_GLBench/ graphics_GpuReset/ graphics_KernelMemory/ graphics_PerfControl/ graphics_VTSwitch/ graphics_WebGLClear/ (no control file associated) BUG= chromium:717664 TEST=[1] test_that dut graphics_GLBench /tmp/test_that_results_ucjKLm/results-1-graphics_GLBench [ PASSED ] ----------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[2] test_that dut graphics_GpuReset /tmp/test_that_results_jRFyhv/results-1-graphics_GpuReset [ PASSED ] ----------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[3] test_that dut graphics_KernelMemory /tmp/test_that_results_XwyCEE/results-1-graphics_Kern... [ PASSED ] ----------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[4] test_that dut graphics_PerfControl /tmp/test_that_results_liG7CL/results-1-graphics_Perf... [ PASSED ] ----------------------------------------------------------------------- Total PASS: 2/2 (100%) TEST=[5] test_that dut graphics_VTSwitch /tmp/test_that_results_61NrD4/results-1-graphics_VTS... [ PASSED ] ----------------------------------------------------------------------- Total PASS: 2/2 (100%) Change-Id: Ifd7c08cc88825556fe3919dc3b2d4f694aac574d Reviewed-on: https://chromium-review.googlesource.com/529769 Commit-Ready: Ilja H. Friedel <ihf@chromium.org> Tested-by: Ilja H. Friedel <ihf@chromium.org> Reviewed-by: Ilja H. Friedel <ihf@chromium.org> [modify] https://crrev.com/e4d500e51125622d9cc10d15a5216be4f7aed336/client/site_tests/graphics_KernelMemory/graphics_KernelMemory.py [modify] https://crrev.com/e4d500e51125622d9cc10d15a5216be4f7aed336/client/site_tests/graphics_GpuReset/graphics_GpuReset.py [modify] https://crrev.com/e4d500e51125622d9cc10d15a5216be4f7aed336/client/site_tests/graphics_WebGLClear/graphics_WebGLClear.py [modify] https://crrev.com/e4d500e51125622d9cc10d15a5216be4f7aed336/client/site_tests/graphics_PerfControl/graphics_PerfControl.py [modify] https://crrev.com/e4d500e51125622d9cc10d15a5216be4f7aed336/client/site_tests/graphics_GLBench/graphics_GLBench.py [modify] https://crrev.com/e4d500e51125622d9cc10d15a5216be4f7aed336/client/site_tests/graphics_VTSwitch/graphics_VTSwitch.py
,
Aug 3 2017
All client tests now send alert to chromeperf.
,
Jan 22 2018
|
|||
►
Sign in to add a comment |
|||
Comment 1 by ihf@chromium.org
, May 4 2017