Teaching a computer to type like a human
An entirely new predictive typing model can simulate different kinds of users, helping figure out ways to optimize how we use our phones. Developed by researchers at Aalto University, the new model captures the difference between typing with one or two hands or between younger and older users.
‘Typing on a phone requires manual dexterity and visual perception: we press buttons, proofread text, and correct mistakes. We also use our working memory. Automatic text correction functions can help some people, while for others they can make typing harder,’ says Professor Antti Oulasvirta of Aalto University.
The researchers created a machine-learning model that uses its virtual ‘eyes and fingers’ and working memory to type out a sentence, just like humans do. That means it also makes similar mistakes and has to correct them.
‘We created a simulated user with a human-like visual and motor system. Then we trained it millions of times in a keyboard simulator. Eventually, it learned typing skills that can also be used to type in various situations outside the simulator,’ explains Oulasvirta.
The predictive typing model was developed in collaboration with Google. New designs for phone keyboards are normally tested with real users, which is costly and time-consuming. The project’s goal is to complement those tests so keyboards can be evaluated and optimized more quickly and easily.
For Oulasvirta, this is part of a larger effort to improve user interfaces overall and understand how humans behave in task-oriented situations. He leads a research group at Aalto that uses computational models of human behaviour to probe these questions.
‘We can train computer models so that we don’t need observation of lots of people to make predictions. User interfaces are everywhere today – fundamentally, this work aims to create a more functional society and smoother everyday life,’ he says.
The researchers will present their findings at the CHI Conference in May, the most prestigious scientific publication forum in the field of human-computer interaction. The peer-reviewed study is already available online.
This news item was originally published on the Aalto University website on 18.4.2024
Read more news
New research: Reliable electricity can no longer be taken for granted – the green transition may require fossil fuel as backup
Although Finland's electricity system has been exceptionally reliable, this may not necessarily be the case in the future. A recent study by Aalto University warns that without further investment in flexible production and demand management, the security of the electricity supply could deteriorate significantly as early as the 2030s.
New information on the spread of gut bacteria that cause bloodstream infections
Gut bacteria that cause bloodstream infections can spread as quickly as influenza epidemics. The good news is neither the antibiotic-resistant nor the highly virulent strains are the most transmissible.
Three new Academy Professors at Aalto University
Professor Tuomas Hytönen from the Department of Mathematics and Systems Analysis, Professor Mikko Möttönen from the Department of Applied Physics and Professor Aki Vehtari from the Department of Computer Science have been appointed as Academy Professors for the term 1 January 2026–31 December 2031. Congratulations to all!