Revolutionizing hyperspectral imaging

This is the first video of FCAI success stories series for explaining why fundamental research in AI is needed and how research results create solutions to the needs of people, society and companies.

Researchers in Helsinki have developed an artificial intelligence based spectral imaging technology that will make color determination accurate, universally true and accessible to everyone with a smartphone.

Professor Arto Klami, doctoral students of computer science Mikko Toivonen and Chang Rajani have designed computer vision algorithms under the spexel.ai project, which can be used to determine colours to a very high degree of precision.

The new technology is based on the combination of a smartphone, a peripheral device attached to the phone and an application that determines the colour in a cloud-based service with the help of computer vision algorithms. This technology can soon turn your smartphone into an extremely accurate camera.

Accurate colour detection can help, for example, interior designers or those who work with paint. With the spexel.ai technique, they can take a picture of their subject and obtain accurate information on its colour shade from the application. The technique could also be useful for online shoppers looking for a product of a specific hue.

Spexel´s vision is to bring hyperspectral imaging to consumers. In this, colour detection is a natural starting point, as the technical solutions required are easier to implement. Spexel technology allows for the development of other solutions as well.

“It could be used to perform regular self-checks to accurately analyze and track skin changes via your smartphone e.g. detecting and identifying rashes, moles, or just monitoring general skin health. It could also be used to develop a smartphone-based device to provide information on a plant’s physiology or for quality assessment of fruits and vegetables”, says  Ville Kurri, commercial lead for spexel.ai.

The technology involved in hyperspectral imaging is already in use, but most of the devices with hyperspectral imaging capacity currently available are expensive specialist equipment.

 “We have been able to replace a large part of the hyperspectral technology previously done optically or mechanically with artificial intelligence methods. This enables low-cost spectral imaging solutions and for the technology to be included in existing cameras including smartphones”, says Kurri.

Furthermore, the technology can be applied to many computer vision applications making new applications possible and existing applications easier.