Yes.

Omri, could you explain exactly when this issue happens?
Is it after reboot, or for new user?
And 'forever' means how many seconds/minutes?

I just tried reproducing it on a Samus in-front of yhanada@ (by enabling the VK flag) and it took 25 seconds to load the VK (which is one of the worst I've seen. 

I restarted Chrome with the button once I went to chrome://flags

Note that Chrome did reload some of my windows as well, so probably slowed things down a bit.

It takes about 800ms to load chrome-extension://jkghodnilhceideoidjikpgommlajknk/inputview.html (xkb extension). Ditto for Mozc (Google Japanese/Korean input).
This loading time is the dominant part of the overall latency.
Maybe we should cache the page and make changing IME fast for the second time.

Sorry I was commenting on the wrong thread. Please disregard the above comment.

Looking at the UMA. Initial load takes ~ 1.5s on average.
https://uma.googleplex.com/histograms?endDate=20170305&dayCount=28&histograms=VirtualKeyboard.InitLatency.FirstLoad&fixupData=true&showMax=true&filters=isofficial%2Ceq%2CTrue&implicitFilters=isofficial

oka@ I'm seeing a lot worse numbers and also only see very few users. What am I doing wrong?
https://screenshot.googleplex.com/MLJS1o47seS.png
Source:
https://uma.googleplex.com/histograms?endDate=latest&dayCount=28&histograms=VirtualKeyboard.InitLatency.FirstLoad&fixupData=true&showMax=true&filters=isofficial%2Ceq%2CTrue&implicitFilters=isofficial

The initial latency should be improved with preemptive loading 724908.