Âé¶¹ÒùÔº


Can AI talk us out of conspiracy theory rabbit holes?

conspiracy
Credit: Pixabay/CC0 Public Domain

New research shows that for some people who believe in conspiracy theories, a fact-based conversation with an artificial intelligence (AI) chatbot can "pull them out of the rabbit hole." Better yet, it seems to keep them out for at least two months.

This research, carried out by Thomas Costello at the Massachusetts Institute of Technology and colleagues, shows promise for a challenging social problem: belief in conspiracy theories.

Some conspiracy theories are relatively harmless, such as (which is fine, until you meet a Finn). Other theories, though, reduce trust in and .

This becomes a problem when conspiracy theories persuade people not to or not to . At its most extreme, belief in conspiracy theories has been associated with .

Conspiracy theories are 'sticky'

Despite the negative impacts of conspiracy theories, they have proven very "sticky." Once people believe in a conspiracy theory, changing their mind is hard.

The reasons for this are complex. Conspiracy theorist beliefs are , and conspiracy theorists have done to reach their position.

When a person no longer trusts science or anyone outside their community, it's hard to change their beliefs.

Enter AI

The explosion of generative AI into the public sphere has increased concerns about people believing in things that aren't true. AI makes it to create .

Even if used in , AI systems can get facts wrong. (ChatGPT and other chatbots even warn users that they might be wrong about some topics.)

AI systems also contain widespread biases, meaning they can promote negative beliefs about some groups of people.

Given all this, it's quite surprising that a chat with a system known to produce can convince some people to abandon conspiracy theories, and that the change seems to be long lasting.

However, this new research leaves us with a good-news/bad-news problem.

It's great we've identified something that has some effect on conspiracy theorist beliefs! But if AI chatbots are good at talking people out of sticky, anti-scientific beliefs, what does that mean for true beliefs?

What can the chatbots do?

Let's dig into the new research in more detail. The researchers were interested to know whether factual arguments could be used to persuade people against conspiracy theorist beliefs.

This research used over 2,000 participants across two studies, all chatting with an AI after describing a conspiracy theory they believed. All participants were told they were talking to an AI chatbot.

The people in the "treatment" group (60% of all participants) conversed with a chatbot that was personalized to their particular conspiracy theory, and the reasons why they believed in it. This chatbot tried to convince these participants that their beliefs were wrong using factual arguments over three rounds of conversation (the participant and the chatbot each taking a turn to talk is a round). The other half of participants had a general discussion with a chatbot.

The researchers found that about 20% of participants in the treatment group showed a reduced belief in conspiracy theories after their discussion. When the researchers checked in with participants two months later, most of these people still showed reduced belief in conspiracy theories. The scientists even checked whether the AI chatbots were accurate, and they (mostly) were.

We can see that for some people at least, a three-round conversation with a chatbot can persuade them against a conspiracy theory.

So we can fix things with chatbots?

Chatbots do offer some promise with two of the challenges in addressing false beliefs.

Because they are computers, , making what they say more trustworthy (especially to someone who has lost faith in ).

Chatbots can also put together an argument, which is better than facts alone. A simple recitation of facts against fake beliefs.

Chatbots aren't a cure-all though. This study showed they were more effective for people who didn't have strong personal reasons for believing in a conspiracy theory, meaning they probably won't help people for whom conspiracy is community.

So should I use ChatGPT to check my facts?

This study demonstrates how persuasive chatbots can be. This is great when they are primed to convince people of facts, but what if they aren't?

One major way chatbots can promote misinformation or conspiracies is when their underlying data is wrong or biased: .

Some chatbots are designed or . You can even chat to versions of ChatGPT customized to .

A second, more worrying probability, is that as chatbots respond to biased prompts (that searchers may not realize are biased), they may perpetuate misinformation (including conspiracy beliefs).

We already know that people are bad at fact checking and when they use search engines to do so, those search engines respond to their (unwittingly biased) search terms, . Chatbots are .

Ultimately, chatbots are a tool. They may be helpful in debunking conspiracy theories—but like any tool, the skill and intention of the toolmaker and user matter. Conspiracy theories start with people, and it will be people that end them.

Provided by The Conversation

This article is republished from under a Creative Commons license. Read the .The Conversation

Citation: Can AI talk us out of conspiracy theory rabbit holes? (2024, September 14) retrieved 23 May 2025 from /news/2024-09-ai-conspiracy-theory-rabbit-holes.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Americans are bad at recognizing conspiracy theories when they believe they're true, says study

40 shares

Feedback to editors