The main thing I see as being useful here is that somebody looks at the metrics for the experiments. This person doesn't even need to come to the meeting.

Yeah, looking at the heartbeat speed metrics, and checking if anything stands out when the experiment is enabled on perfbots is definitely the first thing I thought about.