This is Sana's 50% CQ experiment.

I'd advocate we either go forward, get more bots and eventually add it to CQ, or stop the experiment.

Thanks, that makes sense. Can we at least have the experiment percentage match the existing capacity and scale them together?

We should get more bots and add this to CQ. Can you recommend capacity requirements here?

IMHO we should be tracking infra failures affecting CQ production builders first and only then look at experimental and git-cl-try. There is a query that I wrote earlier today to find all infra flakes in the last month: https://plx.corp.google.com/script/#a=qo%7Ci=google%253A%253Ascript_90._75e2b5_7f29_4087_a09d_662b4da37318. It uses completed_builds table and filters builds using `category` field.

Issue 498330 has been merged into this issue.

Is there a link to some information about this experiment? It's not clear to me from this issue how it is related.

Any builder with an experiment percentage doesn't block CLs from landing so they can't actually contribute to false CQ rejections and are less interesting to us. The builder is defined here:
https://cs.chromium.org/chromium/src/infra/config/cq.cfg?rcl=0&l=73&q=mac_chromium_10.10_rel_ng

It looks like CATEGORY_CQ is an appropriate filter for measuring flakes causing false rejections since there's also a CATEGORY_CQ_EXPERIMENTAL.

We already do filter by CATEGORY_CQ, see query in #4. It has

build.category = 'CATEGORY_CQ' AND

Can this bug be closed?

The following revision refers to this bug:
  https://chromium.googlesource.com/chromium/src.git/+/86e29baab34cd4e0bf09d17f043e57d8f259c25b

commit 86e29baab34cd4e0bf09d17f043e57d8f259c25b
Author: jam <jam@chromium.org>
Date: Fri Oct 28 22:06:05 2016

Scale back Mac 10.10 swarming experiment to 10% instead of 50%.

There aren't enough VMs for it and it's taking resources from the main waterfall.

BUG=653677, 649042 
TBR=smut@chromium.org

Review-Url: https://codereview.chromium.org/2465523002
Cr-Commit-Position: refs/heads/master@{#428510}

[modify] https://crrev.com/86e29baab34cd4e0bf09d17f043e57d8f259c25b/infra/config/cq.cfg

Katie, you're already filtering infra failures using CATEGORY_CQ build category, right? In that case we can close this.

Yup