News

Just believing that an AI is helping boosts your performance

People perform better if they think they have an AI assistant – even when they’ve been told it’s unreliable and won’t help them
tekoälyohjelma käynnistyy
Participants were asked to perform a task once on their own and once supposedly aided by an AI system. Image: Otso Haavisto / Aalto University

Sometimes it just seems like an AI is helping, but the benefit is actually a placebo effect – people performing better simply because they expect to be doing so – according to new research from Aalto University. The study also shows how difficult it is to shake people’s trust in the capabilities of AI systems.

In this study, participants were tasked with a simple letter recognition exercise. They performed the task once on their own and once supposedly aided by an AI system. Half of the participants were told the system was reliable and it would enhance their performance, and the other half was told that it was unreliable and would worsen their performance.

‘In fact, neither AI system ever existed. Participants were led to believe an AI system was assisting them, when in reality, what the sham-AI was doing was completely random,’ explains doctoral researcher Agnes Kloft.

The participants had to pair letters that popped up on screen at varying speeds. Surprisingly, both groups performed the exercise more efficiently – more quickly and attentively – when they believed an AI was involved. 

‘What we discovered is that people have extremely high expectations of these systems, and we can’t make them AI doomers simply by telling them a program doesn’t work,’ says Assistant Professor Robin Welsch.

Following the initial experiments, the researchers conducted an online replication study that produced similar results. They also introduced a qualitative component, inviting participants to describe their expectations of performing with an AI. Most had a positive outlook toward AI and, surprisingly even skeptical people still had positive expectations about its performance.

The findings pose a problem for the methods generally used to evaluate emerging AI systems. ‘This is the big realization coming from our study – that it’s hard to evaluate programmes that promise to help you because of this placebo effect’, Welsch says.

While powerful technologies like large language models undoubtedly streamline certain tasks, subtle differences between versions may be amplified or masked by the placebo effect – and this is effectively harnessed through marketing.

The results also pose a significant challenge for research on human-computer interaction, since expectations would influence the outcome unless placebo control studies were used.

‘These results suggest that many studies in the field may have been skewed in favor of AI systems,’ concludes Welsch.

The researchers will present the study at the renowned CHI-conference on May 14. The research paper can be found here.

Aalto computer scientists in CHI 2024

Conference on Human Factors in Computing Systems.

News
Illustration of a white-to-light-blue side profile of a human face with network nodes pointing out against a blue background

Blind trust in enhancement technologies encourages risk-taking even if the tech is a sham

A placebo effect can make users overconfident when they think tech is helping them

News
FCAI

Finnish Center for Artificial Intelligence (external link)

The Finnish Center for Artificial Intelligence FCAI is a research hub initiated by Aalto University, the University of Helsinki, and the Technical Research Centre of Finland VTT. The goal of FCAI is to develop new types of artificial intelligence that can work with humans in complex environments, and help modernize Finnish industry. FCAI is one of the national flagships of the Academy of Finland.

  • Published:
  • Updated:

Read more news

Photo: Ville Heirola/Aalto University.
Appointments, Research & Art Published:

Call for two Assistant Professors in Computational Physics

The Department of Applied Physics at Aalto University School of Science invites applications for two Assistant professor positions in Computational Physics.
A woman wearing a black jacket sits by a table in room, with sunlight beaming down from the windows above. She sits by the table looking at her laptop while holding onto a pen. A tablet and notebook lay open near the laptop. Pic by Kalle Kataila / Aalto University
Research & Art Published:

Auditor's expertise in climate risks affects the quality of the client's climate risk disclosures

The study was carried out in international cooperation with universities from several countries
A lit motorway crossing the sea, with buildings and sky visible
Cooperation, Press releases, Research & Art, University Published:

Finland is strongly investing in AI and establishing an ELLIS Institute to accelerate research and attract talent

Public and private sector investment are coming together to launch ELLIS Institute Finland.
Samuel Girmay in a laboratory, wearing a white lab coat and safety glasses.
Research & Art Published:

Virtual laboratories improve accessibility and language awareness in science education

Doctoral researcher Samuel Girmay has received notable funding from the Jenny and Antti Wihuri Foundation. His project aims to enhance accessibility and language awareness in secondary school science education using virtual laboratories.