Âé¶¹ÒùÔº


Experiments reveal content moderators are influenced by online misinformation, but accuracy mindset may help

Content moderators are influenced by online misinformation
Study design. The first experiment included only the control condition (Top). The next two experiments included both the control and treatment conditions. In all experiments, participants first rated the interestingness or accuracy of 16 headlines (8 true and 8 false), completed a distractor task (e.g. questionnaires), and then rated the accuracy of 48 headlines (the 16 repeated headlines from the interestingness task plus 32 new, nonrepeated, headlines). Credit: PNAS Nexus (2024). DOI: 10.1093/pnasnexus/pgae481

Repeated exposure to lies online may influence the beliefs of professional content moderators, with consequences for online platforms. Hundreds of thousands of content moderators, typically based in non-Western countries, identify and weed out problematic and false content on social platforms. However, constant exposure to misinformation could convince some content moderators that false claims are true, in what is known as the "illusory truth effect."

Hause Lin and colleagues assessed the extent of this effect among professional in India and the Philippines and explored whether encouraging an accuracy mindset reduces the effect. The work is in the journal PNAS Nexus.

The authors asked 199 content moderators to rate 16 COVID-19 news headlines, first on their interestingness and then, after a break, on their accuracy—along with 32 new COVID-19 news headlines. As predicted by the illusory truth effect, headlines seen for the second time were 7.1% more likely to be judged as accurate than non-repeated headlines.

However, in a similar experiment in which content moderators were asked to rate accuracy first—thereby encouraging an mindset—repeated headlines were not rated as more accurate than new headlines. Similar experiments with members of the public in India and the Philippines found similar effects.

According to the authors, the results suggest that the illusory truth effect is not idiosyncratic to Western populations, suggesting that content moderators may become less effective over time due to being chronically exposed to falsehoods, which could compromise the safety and integrity of . Accuracy mindset prompts could help, the authors note.

More information: Hause Lin et al, Accuracy prompts protect professional content moderators from the illusory truth effect, PNAS Nexus (2024).

Journal information: PNAS Nexus

Provided by PNAS Nexus

Citation: Experiments reveal content moderators are influenced by online misinformation, but accuracy mindset may help (2024, November 19) retrieved 20 May 2025 from /news/2024-11-reveal-content-moderators-online-misinformation.html
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

Study finds people are skeptical of headlines labeled as AI-generated

0 shares

Feedback to editors