Virtual reality becomes more engaging when designers use cinematic tools

Cinematographic techniques can significantly improve user experience in virtual reality (VR) environments. A new discovery by computer scientists can be of practical use to VR designers.
game picture
Without teleportation, many users would be unable to use virtual reality due to motion sickness. Unfortunately, teleportation can cause users to miss important aspects of their surroundings. (Image: Alan Medlar)

Cinematography techniques can significantly increase user engagement with virtual environments and, in particular, the aesthetic appeal of what users see in virtual reality.

This was the result of a recent study conducted by computer scientists at the University of Helsinki. The results were published in May at the prestigious ACM Conference on Human Factors in Computing Systems (CHI)

The team aimed to investigate how principles of composition and continuity, commonly used in filmmaking, could be utilized to enhance navigation around virtual environments. 

Composition refers to how the elements in a scene are oriented with respect to the viewer, whereas continuity is about how camera positions between shots can help viewers to understand spatial relationships between elements in the scene. 

“Using these ideas, we developed a new teleportation method for exploring virtual environments that subtly repositions and reorientates the user’s viewpoint after teleportation to better frame the contents of the scene”, says Alan Medlar, University Researcher in computer science at the University of Helsinki.

The images below show how this differs from regular teleportation used in modern VR games: from the same starting point (top images), regular teleportation moves the user forward while retaining the same orientation (middle images), whereas cinematic techniques can increase the visual appeal of the environment (bottom images).

game imagery
Two examples of how cinematographic techniques were used in virtual reality. Each column shows the starting position (top), after teleportation (middle), and after applying cinematographic techniques to reframe the scene (bottom). Image: Alan Medlar

Sense of space preserved without motion sickness

The results also address the issue of motion sickness – a common problem for VR users. Usually, to prevent nausea, designers use teleportation as a method for moving through digital spaces. The researchers’ approach is also based on teleportation, but it aims to fix the problems associated with this technique. 

“In virtual environments, teleportation can lead to reduced spatial awareness, forcing users to reorient themselves after teleporting and can cause them to miss important elements in their surroundings”, says Medlar.

“The cinematography techniques we used give the designers of virtual environments a way to influence users' attention as they move around the space to affect how they perceive their surroundings”, he continues.

Implications for gaming, museums, and movies

The research carries substantial implications for a range of VR applications, especially as the affordability of VR headsets keeps improving. Video games, virtual museums, galleries, and VR movies could all benefit from these findings, utilizing the proposed methods to craft more engaging and coherent experiences for their users.

Medlar believes the results will be of practical use to virtual reality designers.

“The potential impact of improving navigation in VR and giving designers more tools to affect user experience is huge.”

Publication: 

Medlar, A., Lehtikari, M. T. and Glowacka, D. (2024) ‘Behind the Scenes: Adapting Cinematography and Editing Concepts to Navigation in Virtual Reality’, in Proceedings of the CHI Conference on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery (CHI ’24). doi: 10.1145/3613904.3642412.

Exploratory Search and Personalisation (ESP) research group

This news item was originally published on the University of Helsinki website on 14.5.2024

  • Updated:
  • Published:
Share
URL copied!

Read more news

Verena Distler and Raphael Weidhaas
Aalto University, HCI, Highlight, Research Published:

Emotions help explain why people click phishing emails

People are currently taught to recognise phishing attempts in ways that may be counterproductive. Researchers call for information security training to take emotions into account more effectively.
Ja ihminen loi älyn
Aalto University, AI, Highlight Published:

New podcast explores Finnish contributions to artificial intelligence

In Aalto University's podcast “Ja ihminen loi älyn” (And humankind created intelligence), researchers Arno Solin ja Eric Malmi interview pioneers, entrepreneurs and experts about the AI field's history, disruptive consequences and the probability of humanity's destruction.
This AI model follows the logic humans use when choosing where to direct our aattention when reading. Image: Kalle Kataila / Aalto University
AI, Highlight, Research Published:

AI model captures how humans read, paving the way to personalised text and better augmented reality

Researchers now understand not just how our eyes move when we read, but also how we build meaning from text. The new model could hold the key to developing highly customisable applications that adapt to different types of reader.
Kai Puolamäki
AI, Artificial Intelligence, Computer Science Department, Highlight, Interview, University of Helsinki Published:

Professor Kai Puolamäki studies what goes on inside AI

Professor of Computer Science Kai Puolamäki uses AI to investigate new ways of modelling atmospheric particles. In doing so, he wants to open up AI’s black box to enable people to use it with confidence