What steps will reproduce the problem?
(1) Add Needs-Feedback label to a bug.
(2) The original reporter responds on the bug.
(3) Start typing response to the reporter and hit send. In the meanwhile, SheriffBot updates the bug saying "Thank you for providing more feedback. Adding requester "xyz@chromium.org" to the cc list and removing "Needs-Feedback" label."

What is the expected result?
I can update the bug.

What happens instead?
Monorail complains because Sheriffbot intervened and updated the bug before me.

Sheriffbot has a 5 minute delay before it sends the update. It's possible that the Sheriff will respond immediately to the reporter so a longer delay (e.g. 15 minutes) might be better.