Neuroscientists from HSE University Learn to Predict Human Behaviour by Their Facial Expressions
Willingness to donate to charity is written all over the face.
Researchers at the Institute for Cognitive Neuroscience at HSE University are using automatic emotion recognition technologies to study charitable behaviour. In an experiment, scientists presented 45 participants with photographs of dogs in need and invited them to make donations to support these animals. Emotional reactions to the images were determined through facial activity using the FaceReader program. It turned out that the stronger the participants felt sadness and anger, the more money they were willing to donate to charity funds, regardless of their personal financial well-being. The study was published in the journal Heliyon.
The research was supported by a mega-grant from the Russian government as part of the national project ‘Science and Universities.’
Charitable behaviour is a complex psychological process with motives that are not fully understood. Emotional state is one of the key factors influencing the willingness to give one's resources to another. However, the question of how specific emotions are related to donations remains a subject of debate, as previous studies on this topic have yielded conflicting results.
One of the main reasons is methodological limitations in data collection. Most studies on charitable behaviour use subjective methods: volunteers themselves report their emotions and how they affect donations. However, participants do not always understand their feelings or are not willing to speak about them openly. Moreover, depending on the direction of charitable activity (helping sick people, helping animals, supporting environmental initiatives, and others), the same emotions can differently influence the willingness to donate. Therefore, to develop effective charity advertising, it is important to have objective data on the influence of emotions on the willingness to donate, taking into account the goals of fundraising.
Researchers Anna Shepelenko, Vladimir Kosonogov, and Anna Shestakova from the HSE Institute for Cognitive Neuroscience were the first in the world to use an automatic emotion recognition program to evaluate the effectiveness of charity appeals. In the experiment, scientists used FaceReader to record the facial expressions of volunteers while viewing photos of dogs in various conditions, including homeless, domestic, sick, healthy, adult, and puppies. Participants were given 320 rubles, which they could fully or partially donate to the animal aid fund during the experiment. The remaining amount could be kept for themselves.
Dogs were specifically chosen for the study because society's attitude towards them is ambiguous: they can be perceived as both victims and threats. In these conditions, charity appeals can evoke contradictory or hidden emotions that are difficult to detect through surveys or focus groups but can be recognised by facial expressions.
Co-author of the study, Junior Research Fellow at the Centre for Cognition & Decision Making at the Institute for Cognitive Neuroscience, HSE University
Currently, affective computing is still in the early stages of its development and is not widely used in the industry. However, in the coming years, its widespread implementation in various business and scientific fields can be expected. Technologies like FaceReader are already being used for diagnosing mental disorders, improving the quality of online education, assessing customer satisfaction, and in some other areas. Our study clearly shows the prospects of using affective computing to predict the effectiveness of social advertising, creating a basis for further research and practical application.
The main results of the study showed that people are inclined to donate more when charity appeals provoke unpleasant emotions in them. In particular, participants gave larger amounts to animals whose images evoked sadness and anger. These results are confirmed by both self-reports of emotions and affective computing data.
At the same time, for some other emotions, researchers found differences between survey data and FaceReader data. According to self-reports, surprise, disgust, and fear also contributed to increased donations, but FaceReader data did not confirm this. According to the authors, these differences may have arisen due to the timing of emotion recording: the program analysed reactions during the first presentation of pictures and immediately before the donation decision, whereas self-reports were made after a second viewing of the images. This time gap could have changed participants' perception of their emotions.
Additionally, the formulation of questions about specific emotions could have caused cognitive biases and influenced respondents' answers so that they indicated not only the emotions they experienced but also those they considered appropriate depending on the context of the image. Based on this, researchers conclude that affective computing complements self-report data, allowing for a more accurate identification of emotions at the moment of decision-making and reducing the influence of experimental procedures or cognitive biases on research results.
It is noteworthy that donations were associated with the individual perception of the value of money: the higher the subjective significance of the reward for participating in the experiment (320 rubles), the less willing participants were to donate to charity, while their personal level of financial well-being did not affect the amount of donations. This data clarifies the results of earlier publications, which showed contradictions regarding the relationship between financial well-being and the willingness to make donations.
Co-author of the study, Junior Research Fellow at the Centre for Cognition & Decision Making at the Institute for Cognitive Neuroscience, HSE University
This study contributes to the understanding of charitable behaviour, and we hope that the obtained results will be useful for non-profit organisations. At the same time, it is important to note some limitations: our results do not take into account the long-term impact of charity advertising on the audience.
Indeed, unpleasant emotions can increase the amount of donations during initial contact, but regularly repeated negative charity appeals can provoke empathy fatigue or avoidance—people may simply exclude such messages from their information field. Thus, to further study the impact of emotions on charity, longitudinal studies should be conducted, in which changes in donors' behaviour can be registered over several months or even years.
See also:
Narcissistic and Workaholic Leaders Guide Young Firms to Success
Scientists at HSE University—St. Petersburg studied how the founder's personal characteristics impact a young firm's performance. It turns out that a narcissist and workaholic who also fosters innovation will effectively grow their company. The paper has been published in IEEE Transactions on Engineering Management.
Biologists at HSE University Warn of Potential Errors in MicroRNA Overexpression Method
Researchers at HSE University and the RAS Institute of Bioorganic Chemistry have discovered that a common method of studying genes, which relies on the overexpression of microRNAs, can produce inaccurate results. This method is widely used in the study of various pathologies, in particular cancers. Errors in experiments can lead to incorrect conclusions, affecting the diagnosis and treatment of the disease. The study findings have been published in BBA.
Green Energy Patents Boost Company Profitability
An ESG strategy—Environmental, Social, and Corporate Governance—not only helps preserve the environment but can also generate tangible income. Thus, the use of renewable energy sources (RES) and green technologies in the energy sector enhances return on investment and profitability. In contrast, higher CO2 emissions result in lower financial performance. This has been demonstrated in a collaborative study by the HSE Faculty of Economic Sciences and the European University at St. Petersburg. Their findings have been published in Frontiers in Environmental Science.
Physicists from Russia and Brazil Unveil Mystery behind Complex Superconductor Patterns
Scientists at HSE MIEM and MIPT have demonstrated that highly complex spatial structures, similar to the intricate patterns found in nature, can emerge in superconductors. Mathematically, these patterns are described using the Ginzburg–Landau equation at a specific combination of parameters known as the Bogomolny point. The paper has been published in the Journal of Physics: Condensed Matter.
Adhesive Tape Helps Create Innovative THz Photodetector
An international team of researchers, including scientists at HSE University and Moscow Pedagogical State University (MPGU), has developed a novel photodetector composed of a thin superconducting film, capable of detecting weak terahertz (THz) radiation. This discovery holds promise for studying objects in space, developing wireless broadband communication systems, and making advancements in spectroscopy. The study has been published in Nano Letters.
Operation of Cellular Networks Found Similar to Bacteria Growth in Petri Dish
Scientists at the HSE Laboratory for Computational Physics have developed a new model for analysing communication networks that can significantly enhance the speed of mobile communications. To achieve this, the researchers used computational physics methods and phase transition models. It turns out that the functioning of cellular networks is in many ways similar to the growth of surfaces in physics. The study was performed using the HPC cHARISMa cluster at HSE University. The study findings have been published in Frontiers in Physics.
Spelling Sensitivity in Russian Speakers Develops by Early Adolescence
Scientists at the RAS Institute of Higher Nervous Activity and Neurophysiology and HSE University have uncovered how the foundations of literacy develop in the brain. To achieve this, they compared error recognition processes across three age groups: children aged 8 to 10, early adolescents aged 11 to 14, and adults. The experiment revealed that a child's sensitivity to spelling errors first emerges in primary school and continues to develop well into the teenage years, at least until age 14. Before that age, children are less adept at recognising misspelled words compared to older teenagers and adults. The study findings have beenpublished in Scientific Reports .
HSE Researchers Demonstrate Effectiveness of Machine Learning in Forecasting Inflation
Inflation is a key indicator of economic stability, and being able to accurately forecast its levels across regions is crucial for governments, businesses, and households. Tatiana Bukina and Dmitry Kashin at HSE Campus in Perm have found that machine learning techniques outperform traditional econometric models in long-term inflation forecasting. The results of the study focused on several regions in the Privolzhskiy Federal District have been published in HSE Economic Journal.
Ruthenium Complexes Can Accelerate the Development of New Medicines
A group of scientists at INEOS RAS, HSE University, and MIPT have synthesised catalysts containing a ruthenium atom and an aromatic ring. The scientists have isolated the mirror forms of these catalysts and investigated their effectiveness in producing heterocycles, which are commonly found in the structures of drugs. The research findings have been published in Chemical Communications.
Connecting Space and Time: Bilinguals Associate Time with Space in Both Their First and Second Languages
An international team of researchers including scientists at HSE University investigated how bilingual individuals associate time with space. It turns out that in both their first and second languages, people associate the past with the left side of space and the future with the right. In fact, the higher the proficiency in a second language, the more pronounced this relationship becomes. The study findings have been published in Scientific Reports.