New issue
Advanced search Search tips
Note: Color blocks (like or ) mean that a user may not be available. Tooltip shows the reason.

Issue 668449 link

Starred by 1 user

Issue metadata

Status: Verified
Owner:
Last visit > 30 days ago
Closed: May 2017
Cc:
Components:
EstimatedDays: ----
NextAction: ----
OS: Chrome
Pri: 2
Type: Bug


Participants' hotlists:
Fixing-touch


Sign in to add a comment

Enrolling a Chromebox using only a MIMO as a keyboard does not work

Project Member Reported by cederberg@chromium.org, Nov 24 2016

Issue description

Version: M52
OS: Chrome OS

What steps will reproduce the problem?
(1) wipe a chromebox
(2) plug in a mimo and another screen
(3) Fail to enroll

What is the expected result?
I did not expect the enrollment to work, but we need it to work in the future.

What happens instead?
No keyboard is found.

 
Labels: -Pri-3 Pri-2
Owner: yhanada@chromium.org
Status: Assigned (was: Untriaged)
Virtual keyboard should kick in in this case.

Why is this marked Restrict-View-Google?
Labels: -Restrict-View-Google
I succeeded to repro this bug and confirmed that I can enroll the device when only one touchable display is connected (no non-touchable display). I think  crbug.com/589989  is related.

cederberg@: Could you check that the enrollment works when only one mimo is connected?
Cc: abodenha@chromium.org
Cc: bkemler@chromium.org
Yes, I can confirm this case works.

As I wrote when filing the bug, I did not expect the other scenario to work, and in fact I am not even sure what it would mean to enroll using the Mimo as a keyboard. This seems more like a product decision than an eng decision to me.

Maybe bkemler@ and/or mnilsson@ can weigh in here?
Does it make sense to just detect a situation where we have one regular display and one touch screen during OOBE and automatically popup the the VK on the touchscreen?
I think that would work.
Components: UI>Input>VirtualKeyboard Internals>Input>Touch>Screen
In this case, the touch screen isn't associated with any display, so IIUC any touching doesn't emit a touch event on displays. Hence, even if the VK shows up on the touch display, we cannot use it.

Note: I used a LG touch display (http://www.lg.com/us/monitors/lg-23ET83V-W-led-monitor) for testing. The display has 1080p resolution for the display, but it has 4096x4096 resolution for touch.
MIMO is a bit different than the LG display you tested with.  Since both the display and touch interface go over the same USB connection we have a heuristic to automatically associate the screen and touch surface.
Ah, I see.

 https://crbug.com/303429  is a similar issue and the fix (https://crrev.com/2445293002) is already landed. If touch surface is associated with the screen, VK automatically should show up on the touchscreen.
I'm worried about the case of:
1: User connects a normal display.
2: User connects a MIMO
3: User goes through OOBE

If the OOBE UI shows on the normal display it would make sense to bring up the VK on the MIMO
Can't we, at least for the duration of the Chromeos OOBE, select the MIMO as the primary screen? And use it for the remainder of the OOBE. Maybe only when some other criteria is met, such as no mouse is connected. At the end of OOBE, restore the primary screen back to what it was.

Rationale: There are other things that the user needs to do besides typing on a virtual keyboard: Tap on buttons, select items in dropdown lists, etc. None of that will work if just the keyboard moves but the UI remains on the non-touch screen.
Owner: jdufault@chromium.org
That actually sounds easier.

jdufault@ any thoughts on comment #12?
#12 sounds reasonable to me as well - though I think all of the UI should be accessible via the keyboard arrow keys + enter.

I wonder if we can figure out a way to make the VK work better in this case as well (ie, only popup VK on touch display if there is no keyboard + mouse attached).
Owner: felixe@chromium.org
Project Member

Comment 16 by bugdroid1@chromium.org, May 11 2017

Cc: dsunk...@chromium.org
Status: Fixed (was: Assigned)
Labels: VerifyIn-61
Status: Verified (was: Fixed)

Sign in to add a comment