It's easy for perf waterfall changes to break Pinpoint, and hard to predict the ways in which Pinpoint will break. We need testing to ensure the two play well together.

We'll want to focus on commit-queue testing. It is important to detect breakages before they happen, because even if you fix a breakage, it will still be in the revision history. Since Pinpoint is always running on old revisions, a "fixed breakage" will continue breaking in Pinpoint forever (or until people forget about it).