Our invocation of the tests should match as closely as possible the one done by the bots in chromium.perf.
This would take care of the issue with xvfb
The following revision refers to this bug: https://chromium.googlesource.com/chromium/tools/build.git/+/bb72a43136123fc0ca3dbce531813d82657d36c1 commit bb72a43136123fc0ca3dbce531813d82657d36c1 Author: robertocn@chromium.org <robertocn@chromium.org> Date: Thu Apr 21 21:29:41 2016 Changing bisect_tester module to invoke run_test.py This is instead of calling the test command directly. One of the reasons for this is letting run_test deal with xvfb when appropriate. R=prasadv BUG= 596214 Review URL: https://codereview.chromium.org/1875263002 git-svn-id: svn://svn.chromium.org/chrome/trunk/tools/build@300093 0039d316-1c4b-4281-b951-d872f2087c98 [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipe_modules/bisect_tester/perf_test.py [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_fyi_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_nexus5X_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_nexus5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_nexus6_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_nexus7_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_nexus9_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_one_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_s5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_s5_perf_cq.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_android_webview_aosp_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_fyi_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_nexus5X_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_nexus5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_nexus6_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_nexus7_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_nexus9_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_one_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_s5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_s5_perf_cq.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_metric_android_webview_aosp_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_fyi_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_nexus5X_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_nexus5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_nexus6_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_nexus7_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_nexus9_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_one_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_s5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_s5_perf_cq.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_perf_tryjob_with_revisions_android_webview_aosp_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_fyi_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_nexus5X_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_nexus5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_nexus6_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_nexus7_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_nexus9_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_one_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_s5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_s5_perf_cq.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/basic_recipe_android_webview_aosp_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_fyi_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_nexus5X_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_nexus5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_nexus6_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_nexus7_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_nexus9_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_one_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_s5_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_s5_perf_cq.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/android_bisect.expected/perf_tryjob_failed_test_android_webview_aosp_perf_bisect.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/desktop_bisect.expected/basic_linux_bisect_tester_recipe.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/desktop_bisect.expected/basic_linux_bisect_tester_recipe_ret_code.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/desktop_bisect.expected/basic_perf_tryjob.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/desktop_bisect.expected/basic_perf_tryjob_with_metric.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/desktop_bisect.expected/basic_perf_tryjob_with_revisions.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/bisection/desktop_bisect.expected/perf_tryjob_failed_test.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/chromium.expected/full_tryserver_chromium_perf_linux_perf_bisector.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/chromium.expected/full_tryserver_chromium_perf_linux_perf_tester.json [modify] https://crrev.com/bb72a43136123fc0ca3dbce531813d82657d36c1/scripts/slave/recipes/chromium.expected/full_tryserver_chromium_perf_win64_nv_tester.json
The following revision refers to this bug: http://goto.ext.google.com/viewvc/chrome-internal?view=rev&revision=86916 ------------------------------------------------------------------ r86916 | recipe-roller@chromium.org | 2016-04-22T01:23:13.929346Z -----------------------------------------------------------------
Comment 1 by robert...@chromium.org
, Mar 18 2016Status: Assigned (was: Untriaged)