HSE Researchers Develop Python Library for Analysing Eye Movements
A research team at HSE University has developed EyeFeatures, a Python library for analysing and modelling eye movement data. This tool is designed to simplify the work of scientists and developers by enabling them to efficiently process complex data and create predictive models.
The project was implemented as part of the Strategic Project 'Human-Centred AI' (Priority 2030).
Modern research increasingly leverages machine learning and artificial intelligence to analyse vast amounts of eye movement data. However, despite significant advancements in this field, certain challenges continue to limit the effectiveness of these methods. One such challenge is the limited flexibility of existing software solutions, which often offer a narrow range of parameter settings, making it difficult to customize them for specific research tasks. Additionally, the integration of these tools with other specialised software remains a significant limitation.
The Python library EyeFeatures, developed by the Laboratory for Social and Cognitive Informatics at HSE Campus in St Petersburg, addresses these challenges by providing a versatile and user-friendly toolkit for working with eye movement data. It includes modules for processing and analysing data collected from eye trackers, devices that monitor eye movement during the performance of various tasks.
Processing eye movement data is a complex task that involves several stages. Since the eyes do not move smoothly but rather in a series of rapid, jerky motions, focusing on specific points, the first stage of data processing is identifying areas of fixation. In the second stage, metrics such as the average gaze fixation duration and the average distance between points are calculated, enabling the creation of initial, simple predictive or diagnostic models.
All stages of data processing can be carried out using the various modules of the EyeFeatures library. The flexible, modular approach makes it easy to integrate eye movement data processing into existing research and commercial projects, from raw data to a fully developed predictive or explanatory model. For example, using the library in marketing research allows for the evaluation of consumer reactions to advertisements. Eye movement analysis will reveal which elements capture the most attention from the audience.
According to Anton Surkov, Project Head, Junior Research Fellow at Laboratory for Social and Cognitive Informatics at HSE Campus in St Petersburg, 'The library can be valuable to researchers, as it enables them not simply to replicate existing functionality from other software but to implement new algorithms and create more advanced models for research in fields such as marketing, cognitive process diagnostics, user interface and neural interface development (where control and interaction with the program occur through eye movement), as well as combine components in innovative ways to achieve new results and enhance methodology.'
This solution streamlines data analysis and accelerates the creation of predictive models, which is particularly beneficial in medical diagnostics, marketing, and the study of cognitive processes. The library has already been applied in research conducted as part of the Strategic Project 'Human-Centred AI' and was presented at the ECEM 2024 international conference in Ireland.
See also:
Centre for Language and Brain Begins Cooperation with Academy of Sciences of Sakha Republic
HSE University's Centre for Language and Brain and the Academy of Sciences of the Republic of Sakha (Yakutia) have signed a partnership agreement, opening up new opportunities for research on the region's understudied languages and bilingualism. Thanks to modern methods, such as eye tracking and neuroimaging, scientists will be able to answer questions about how bilingualism works at the brain level.
How the Brain Responds to Prices: Scientists Discover Neural Marker for Price Perception
Russian scientists have discovered how the brain makes purchasing decisions. Using electroencephalography (EEG) and magnetoencephalography (MEG), researchers found that the brain responds almost instantly when a product's price deviates from expectations. This response engages brain regions involved in evaluating rewards and learning from past decisions. Thus, perceiving a product's value is not merely a conscious choice but also a function of automatic cognitive mechanisms. The results have been published in Frontiers in Human Neuroscience.
AI Predicts Behaviour of Quantum Systems
Scientists from HSE University, in collaboration with researchers from the University of Southern California, have developed an algorithm that rapidly and accurately predicts the behaviour of quantum systems, from quantum computers to solar panels. This methodology enabled the simulation of processes in the MoS₂ semiconductor and revealed that the movement of charged particles is influenced not only by the number of defects but also by their location. These defects can either slow down or accelerate charge transport, leading to effects that were previously difficult to account for with standard methods. The study has been published in Proceedings of the National Academy of Sciences (PNAS).
Electrical Brain Stimulation Helps Memorise New Words
A team of researchers at HSE University, in collaboration with scientists from Russian and foreign universities, has investigated the impact of electrical brain stimulation on learning new words. The experiment shows that direct current stimulation of language centres—Broca's and Wernicke's areas—can improve and speed up the memorisation of new words. The findings have been published in Neurobiology of Learning and Memory.
‘Services Must Be Flexible’: How Governments Can Use Artificial Intelligence
The HSE International Laboratory for Digital Transformation in Public Administration held a roundtable titled ‘Artificial Intelligence in Public Administration: Current Trends.’ Scholars from Israel, China, and Russia discussed which public services AI can enhance and what key factors must be considered when adopting new technologies.
Artificial Intelligence Improves Risk Prediction of Complex Diseases
Neural network models developed at the HSE AI Research Centre have significantly improved the prediction of risks for obesity, type 1 diabetes, psoriasis, and other complex diseases. A joint study with Genotek Ltd showed that deep learning algorithms outperform traditional methods, particularly in cases involving complex gene interactions (epistasis). The findings have been published in Frontiers in Medicine.
Cerium Glows Yellow: Chemists Discover How to Control Luminescence of Rare Earth Elements
Researchers at HSE University and the Institute of Petrochemical Synthesis of the Russian Academy of Sciences have discovered a way to control both the colour and brightness of the glow emitted by rare earth elements. Their luminescence is generally predictable—for example, cerium typically emits light in the ultraviolet range. However, the scientists have demonstrated that this can be altered. They created a chemical environment in which a cerium ion began to emit a yellow glow. The findings could contribute to the development of new light sources, displays, and lasers. The study has been published in Optical Materials.
Genetic Prediction of Cancer Recurrence: Scientists Verify Reliability of Computer Models
In biomedical research, machine learning algorithms are often used to analyse data—for instance, to predict cancer recurrence. However, it is not always clear whether these algorithms are detecting meaningful patterns or merely fitting random noise in the data. Scientists from HSE University, IBCh RAS, and Moscow State University have developed a test that makes it possible to determine this distinction. It could become an important tool for verifying the reliability of algorithms in medicine and biology. The study has been published on arXiv.
Artificial Intelligence as a Catalyst for Sustainable Development
Artificial intelligence is transforming every aspect of life, expanding both our capabilities and our boundaries. At the same time, it presents new challenges for humanity, including concerns about safety, ethics, and environmental sustainability. Today, each neural network leaves a significant carbon footprint. However, with responsible management, AI has the potential to benefit the planet and become a cornerstone of a sustainable future economy. Panos Pardalos, Academic Supervisor of the Laboratory of Algorithms and Technologies for Network Analysis at the HSE Campus in Nizhny Novgorod, emphasised this point as he addressed the XXV Yasin (April) International Academic Conference on Economic and Social Development.
HSE Develops Its Own MLOps Platform
HSE researchers have developed an MLOps platform called SmartMLOps. It has been created for artificial intelligence researchers who wish to transform their invention into a fully-fledged service. In the future, the platform may host AI assistants to simplify educational processes, provide medical support, offer consultations, and solve a wide range of other tasks. Creators of AI technologies will be able to obtain a ready-to-use service within just a few hours. Utilising HSE’s supercomputer, the service can be launched in just a few clicks.