25/04/2020

How We Type: Eye and Finger Movement Strategies in Mobile Typing

Xinhui Jiang, Yang Li, Jussi Jokinen, Viet Ba Hirvola, Antti Oulasvirta, Xiangshi Ren

Keywords: text input, mobile device, eye-hand coordination, eye movement, finger movement

Abstract: Relatively little is known about eye and finger movement in typing with mobile devices. Most prior studies of mobile typing rely on log data, while data on finger and eye movements in typing come from studies with physical keyboards. This paper presents new findings from a transcription task with mobile touchscreen devices. Movement strategies were found to emerge in response to sharing of visual attention: attention is needed for guiding finger movements and detecting typing errors. In contrast to typing on physical keyboards, visual attention is kept mostly on the virtual keyboard, and glances at the text display are associated with performance. When typing with two fingers, although users make more errors, they manage to detect and correct them more quickly. This explains part of the known superiority of two-thumb typing over one-finger typing. We release the extensive dataset on everyday typing on smartphones.

The video of this talk cannot be embedded. You can watch it here:
https://www.youtube.com/watch?v=PTwdFwfVGC8
(Link will open in new window)
 0
 0
 0
 0
This is an embedded video. Talk and the respective paper are published at CHI 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers