I don't think provision suite is tested in test push at all, that would be a good idea.

auron_paine is experimental, so it shouldn't break the CQ.  It's the only place provision suite is enabled currently.

 Issue 787233  reveals a gap in staging test.

There are two separate issues

The other one is https://bugs.chromium.org/p/chromium/issues/detail?id=784564

For https://bugs.chromium.org/p/chromium/issues/detail?id=787233, it would be caught by adding provision suite to test push.  That is not needed now since provision suite is not deployed yet.

For https://bugs.chromium.org/p/chromium/issues/detail?id=784564 staging test does not exercise the "check for minimum DUTs" logic.

The following revision refers to this bug:
  https://chromium.googlesource.com/chromiumos/third_party/autotest/+/64edf06917ba24f1ec7c31ceaa467fa7c81b4772

commit 64edf06917ba24f1ec7c31ceaa467fa7c81b4772
Author: Allen Li <ayatane@chromium.org>
Date: Thu Nov 30 15:09:45 2017

[autotest] Test minimum DUTs logic in test push

BUG= chromium:787251 
TEST=None

Change-Id: Ibb928d74c6111143a92667fd9a9feb174d1ea886
Reviewed-on: https://chromium-review.googlesource.com/792290
Commit-Ready: ChromeOS CL Exonerator Bot <chromiumos-cl-exonerator@appspot.gserviceaccount.com>
Tested-by: Allen Li <ayatane@chromium.org>
Reviewed-by: Shuqian Zhao <shuqianz@chromium.org>

[modify] https://crrev.com/64edf06917ba24f1ec7c31ceaa467fa7c81b4772/site_utils/test_push.py