News

Teaching a computer to type like a human

A new typing model simulates the typing process instead of just predicting words
Kuvakaappaus kahden puhelimen näytöstä, joihin on kirjoitettu tekstiä.
A screenshot of the typing model developed by researchers. Photo: Aalto University

An entirely new predictive typing model can simulate different kinds of users, helping figure out ways to optimize how we use our phones. Developed by researchers at Aalto University, the new model captures the difference between typing with one or two hands or between younger and older users.

‘Typing on a phone requires manual dexterity and visual perception: we press buttons, proofread text, and correct mistakes. We also use our working memory. Automatic text correction functions can help some people, while for others they can make typing harder,’ says Professor Antti Oulasvirta of Aalto University.

The researchers created a machine-learning model that uses its virtual ‘eyes and fingers’ and working memory to type out a sentence, just like humans do. That means it also makes similar mistakes and has to correct them.

‘We created a simulated user with a human-like visual and motor system. Then we trained it millions of times in a keyboard simulator. Eventually, it learned typing skills that can also be used to type in various situations outside the simulator,’ explains Oulasvirta.

The predictive typing model was developed in collaboration with Google. New designs for phone keyboards are normally tested with real users, which is costly and time-consuming. The project’s goal is to complement those tests so keyboards can be evaluated and optimized more quickly and easily.

For Oulasvirta, this is part of a larger effort to improve user interfaces overall and understand how humans behave in task-oriented situations. He leads a research group at Aalto that uses computational models of human behaviour to probe these questions.

‘We can train computer models so that we don’t need observation of lots of people to make predictions. User interfaces are everywhere today – fundamentally, this work aims to create a more functional society and smoother everyday life,’ he says.

The researchers will present their findings at the CHI Conference in May, the most prestigious scientific publication forum in the field of human-computer interaction. The peer-reviewed study is already available online.

Professor Antti Oulasvirta. Photo: Aalto University / Jaakko Kahilaniemi

Researchers investigate how AI could better understand humans

Antti Oulasvirta has received a EUR 2.5 million Advanced Grant by the European Research Council (ERC) for the study of user models.

News
Vertailu ihmisen ja tekoälymallin näppäilystä

AI learns to type on a phone like humans

Computational model precisely replicates eye and finger movements of touchscreen users -- could lead to better auto-correct and keyboard usability for unique needs

News

Aalto computer scientists in CHI 2024

Conference on Human Factors in Computing Systems.

News
  • Published:
  • Updated:

Read more news

Photo: Ville Heirola/Aalto University.
Appointments, Research & Art Published:

Call for two Assistant Professors in Computational Physics

The Department of Applied Physics at Aalto University School of Science invites applications for two Assistant professor positions in Computational Physics.
A lit motorway crossing the sea, with buildings and sky visible
Cooperation, Press releases, Research & Art, University Published:

Finland is strongly investing in AI and establishing an ELLIS Institute to accelerate research and attract talent

Public and private sector investment are coming together to launch ELLIS Institute Finland.
A person holds a phone showing the Twitter profile, with mask emojis in the header. A plant is in the background.
Research & Art Published:

Malicious social media bots increased significantly during the COVID19 pandemic

A groundbreaking joint study by Aalto University and the Finnish Institute for Health and Welfare (THL) has revealed critical insights into the role of bots in shaping public health discourse during the COVID-19 pandemic, particularly on Twitter.
Aalto University Senior Lecturer Sorin Paraoanu stands at the Low Temperature Lab in the Nanotalo building.
Appointments, Research & Art Published:

Prof. Sorin Paraoanu builds quantum devices that probe the foundations of our universe

Recently appointed as Associate Professor at the Department of Applied Physics, Prof. Sorin Paraoanu is building quantum sensors and designing experiments that unveil the secrets of our universe.