Tired of swiping? Now an AI simulation helps us understand why

Screen logging tells us where smart phone users tap and swipe, but now researchers have developed a musculoskeletal model that helps understand the physical effort that goes into these motions
Log2Motion
Log2Motion simulation of a musculoskeletal model using a smartphone.

Prolonged scrolling is bad for your well-being, but is it also physically tiring? Until now, we haven’t really been able to say. This is why researchers from Aalto and Leipzig universities created a new AI model that makes it possible to simulate muscle activations and used energy to work out how physically effortful smartphone interactions are for users. 

'It’s the first time anyone has developed a tool that can help designers and developers quickly assess how physically tiring a real mobile user interface could be,’ says Antti Oulasvirta, Professor at Aalto University and ELLIS Institute Finland. ‘So far, smartphone logs have only told us where a finger has touched the screen – not whether or not it’s felt comfortable.'  

To bridge this gap, Oulasvirta and his colleagues at Leipzig University developed Log2Motion, an AI model that translates smartphone logs into simulated human motion. Movement of this musculoskeletal simulation is based on data from previous motion capture studies. 

In the simulation, a human model consisting of digital bones and muscles moves its index finger to interact with a smartphone laid out on a desk. Through a software emulator, the model can use real mobile apps in real time. It can re-enact logs collected on users to illuminate what happened during interaction. The Log2Motion model then estimates the motion, speed, accuracy and effort of these biomechanical movements. 

The model provides entirely new horizons for smartphone use research – as well as design. 

'We found that some gestures are harder to perform – in this case, up-down and down-up swipes,' explains Oulasvirta. 'Small icons and locations toward the corners of the display also require additional effort.' 

Using such simulation early in the process could help designers create user-friendly interfaces. It can also provide insight into accessibility needs for users with tremors, reduced strength or prosthetics. 

'It is possible to scale the Log2Motion model to simulate other scenarios, such as the more classic: laying on the couch, holding the phone in one hand and scrolling with the thumb,' Oulasvirta says. 

The researchers hope that human simulations would be adopted to help design interactions that are more ergonomic and pleasant for users. In the future, these simulations could be combined with other AI methods to optimise user interfaces to a user’s needs.

Human participant and Log2Motion
Human participant and Log2Motion simulation of using a smartphone laying on a desk.

The paper, 'Log2Motion: Biomechanical Motion Synthesis from Touch Logs', will be presented on 17 April at CHI 2026, the leading conference on human–computer interaction. It is also available online through arxiv.org (DOI: 10.1145/3772318.3790773).

This news item was originally published on the Aalto University website on 13.04.2026

  • Updated:
  • Published:
Share
URL copied!

Read more news

Verena Distler and Raphael Weidhaas
Aalto University, HCI, Highlight, Research Published:

Emotions help explain why people click phishing emails

People are currently taught to recognise phishing attempts in ways that may be counterproductive. Researchers call for information security training to take emotions into account more effectively.
Ja ihminen loi älyn
Aalto University, AI, Highlight Published:

New podcast explores Finnish contributions to artificial intelligence

In Aalto University's podcast “Ja ihminen loi älyn” (And humankind created intelligence), researchers Arno Solin ja Eric Malmi interview pioneers, entrepreneurs and experts about the AI field's history, disruptive consequences and the probability of humanity's destruction.
This AI model follows the logic humans use when choosing where to direct our aattention when reading. Image: Kalle Kataila / Aalto University
AI, Highlight, Research Published:

AI model captures how humans read, paving the way to personalised text and better augmented reality

Researchers now understand not just how our eyes move when we read, but also how we build meaning from text. The new model could hold the key to developing highly customisable applications that adapt to different types of reader.
Kai Puolamäki
AI, Artificial Intelligence, Computer Science Department, Highlight, Interview, University of Helsinki Published:

Professor Kai Puolamäki studies what goes on inside AI

Professor of Computer Science Kai Puolamäki uses AI to investigate new ways of modelling atmospheric particles. In doing so, he wants to open up AI’s black box to enable people to use it with confidence