The culprit page actually shows 2 analyses, one with high and one with low confidence. both tests pointed to the same CL for introducing flakiness. It was the high confidence analysis that led to the culprit being notified, not the low confidence one.

https://findit-for-me.appspot.com/waterfall/flake/flake-culprit?key=ag9zfmZpbmRpdC1mb3ItbWVyQwsSDEZsYWtlQ3VscHJpdCIxY2hyb21pdW0vYTUxODJkY2NmM2Y0OTQ3MWI5NzYxZTYwMThhYzlkMDk3N2ExM2NlNww

So in this case Findit's behavior is actually correct. I'm thinking we show confidence score on the flake culprit page too to make it clear which test is actually more likely impacted by the change

Ideas (can be implemented independently):
1. Introduce confidence score to flake_culprit page to help differentiate between false positives and true culprits
2. In the dashboard, make it more clear which analysis triggered the code review notification, since currently they are all either "True/False" for notified. Can also have a 3rd value for "Already Done" or another string indicating that another analysis already notified the same code review

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra/+/cc8c14881d5f8290d2b7f74307400888a258ac08

commit cc8c14881d5f8290d2b7f74307400888a258ac08
Author: Jeffrey Li <lijeffrey@chromium.org>
Date: Thu Nov 16 21:26:56 2017

[Findit] Flake Analyzer - Add confidence score to flake culprit page

Bug:  785314 
Change-Id: I4175ae7e8aeb8dd00f8a26c1b5a52b118087462b
Reviewed-on: https://chromium-review.googlesource.com/775559
Reviewed-by: Shuotao Gao <stgao@chromium.org>
Commit-Queue: Jeffrey Li <lijeffrey@chromium.org>

[modify] https://crrev.com/cc8c14881d5f8290d2b7f74307400888a258ac08/appengine/findit/handlers/flake/test/flake_culprit_test.py
[modify] https://crrev.com/cc8c14881d5f8290d2b7f74307400888a258ac08/appengine/findit/templates/flake/flake-culprit.html
[modify] https://crrev.com/cc8c14881d5f8290d2b7f74307400888a258ac08/appengine/findit/handlers/flake/flake_culprit.py

The following revision refers to this bug:
  https://chromium.googlesource.com/infra/infra/+/6f8050b96d895ba33acb00fd0449ab41168b72f3

commit 6f8050b96d895ba33acb00fd0449ab41168b72f3
Author: Jeffrey Li <lijeffrey@chromium.org>
Date: Fri Nov 17 17:29:39 2017

[Findit] Flake Analyzer - Link flake culprit pages to dashboard

The culprit notified True/False fields should now include links to the
flake culprit pages to easily view all analyses that had the same culprit.

Bug:  785314 
Change-Id: Iedbe9e50bc4bb077878a0afb8c9d4f13a1ab8ed2
Reviewed-on: https://chromium-review.googlesource.com/775656
Reviewed-by: Shuotao Gao <stgao@chromium.org>
Commit-Queue: Jeffrey Li <lijeffrey@chromium.org>

[modify] https://crrev.com/6f8050b96d895ba33acb00fd0449ab41168b72f3/appengine/findit/templates/flake/dashboard.html
[modify] https://crrev.com/6f8050b96d895ba33acb00fd0449ab41168b72f3/appengine/findit/model/base_suspected_cl.py