UserAgent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/61.0.3163.100 Safari/537.36

Steps to reproduce the problem:
I have produced a minimal repro at http://chromebug.stevearc.com/

1) Create a beforeunload handler that returns a non-null value (so the confirm dialog will appear) and also makes a call to history.replaceState.

window.onbeforeunload = function() {
   window.history.replaceState(1, '', window.location.href);
   return '';
}

2) After loading the page and interacting, type a different location in the URL bar and navigate away

What is the expected behavior?
Expected behavior is that Chrome will display a confirmation popup that allows the user to remain on the page or to navigate away

What went wrong?
Chrome will show the popup, but then navigate away anyway without any user input.

Did this work before? N/A 

Chrome version: 61.0.3163.100  Channel: n/a
OS Version: OS X 10.12.6
Flash Version: 

There are several similar and likely related problems. If you navigate away using a bookmark, it does pause at the modal but will navigate away no matter which option you choose. If you refresh but then select "Don't Reload," the page will still refresh (this one doesn't repro when devtools are open).