Zurich Uni’s secret AI experiment manipulated Redditors’ opinions
Researchers at the University of Zurich have been accused of undertaking an unauthorized four-month-long experiment on a Reddit board using artificial intelligence-generated comments to test whether AI could alter people’s opinions. As part of the experiment, AI-powered accounts faked a variety of personas, including a rape victim, a person opposed to specific social movements and a trauma counselor specializing in abuse, moderators of the r/changemyview subreddit said in an April 26 post.“Our sub is a decidedly human space that rejects undisclosed AI as a core value,” the moderators said. “People do not come here to discuss their views with AI or to be experimented upon.” The researchers used AI to generate responses but attempted to personalize the replies based on information from the original posters’ prior Reddit history, such as political orientation, gender, age, and ethnicity, according to a draft of the paper.Moderators of the r/changemyview subreddit say researchers at the University of Zurich conducted an unauthorized experiment within their community. Source: RedditOver the four-month experiment, Zurich University’s fake AI accounts posted 1,783 comments and received 137 deltas — a mark showing when another Reddit user acknowledged the account had persuaded them to change their opinion on an issue. The researchers said in a post to the subreddit that all comments were manually reviewed before posting to ensure they met the community guidelines and to “minimize potential harm.”The university team argued that the potential benefits of this research substantially outweigh its risks. Source: RedditThe university team argued that the “potential benefits of this research substantially outweigh its risks” because they have found that the large language models used in the experiment can be highly persuasive, surpassing all “previously known benchmarks of human persuasiveness.”“Our controlled, low-risk study provided valuable insight into the real-world persuasive capabilities of LLMs — capabilities that are already easily accessible to anyone and that malicious actors could already exploit at scale for far more dangerous reasons,” the researchers said. At the same time, the researchers said the experiment shows that distinguishing humans from AI still faces significant challenges because nobody in the subreddit discovered the AI bots during the entire experiment. The r/changemyview board has 3.8 million members and ranks among the top 1% of subreddits by size.Reddit considers legal options The Reddit board’s moderators said they were unaware of the experiment and have asked the university for an apology and to block the publication of the research. Reddit might also be considering legal action, as the platform’s chief legal officer, Ben Lee, said in a follow-up April 28 post that the experiment broke the site’s user agreement and rules, and all known accounts associated with the University of Zurich research effort were now banned. “We are in the process of reaching out to the University of Zurich and this particular research team with formal legal demands,” Lee said. “We want to do everything we can to support the community and ensure that the researchers are held accountable for their misdeeds here,” he added. Related: White House receives over 10,000 comments on AI development planIn its response to the subreddit, the University of Zurich’s Faculty of Arts and Sciences Ethics Commission said it had investigated the incident and promised to coordinate better with test subjects in the future. The lead investigator for the project was also issued a formal warning.“This project yields important insights, and the risks are minimal. This means that suppressing publication is not proportionate to the importance of the insights the study yields,” the ethics commission said. The University of Zurich did not immediately respond to a request for comment. Cointelegraph did not immediately receive a response to questions sent to an email address associated with the experiment.Magazine: Bitcoin $100K hopes on ice, SBF’s mysterious prison move: Hodler’s Digest
Researchers at the University of Zurich have been accused of undertaking an unauthorized four-month-long experiment on a Reddit board using artificial intelligence-generated comments to test whether AI could alter people’s opinions.
As part of the experiment, AI-powered accounts faked a variety of personas, including a rape victim, a person opposed to specific social movements and a trauma counselor specializing in abuse, moderators of the r/changemyview subreddit said in an April 26 post.
“Our sub is a decidedly human space that rejects undisclosed AI as a core value,” the moderators said. “People do not come here to discuss their views with AI or to be experimented upon.”
The researchers used AI to generate responses but attempted to personalize the replies based on information from the original posters’ prior Reddit history, such as political orientation, gender, age, and ethnicity, according to a draft of the paper.
Over the four-month experiment, Zurich University’s fake AI accounts posted 1,783 comments and received 137 deltas — a mark showing when another Reddit user acknowledged the account had persuaded them to change their opinion on an issue.
The researchers said in a post to the subreddit that all comments were manually reviewed before posting to ensure they met the community guidelines and to “minimize potential harm.”
The university team argued that the “potential benefits of this research substantially outweigh its risks” because they have found that the large language models used in the experiment can be highly persuasive, surpassing all “previously known benchmarks of human persuasiveness.”
“Our controlled, low-risk study provided valuable insight into the real-world persuasive capabilities of LLMs — capabilities that are already easily accessible to anyone and that malicious actors could already exploit at scale for far more dangerous reasons,” the researchers said.
At the same time, the researchers said the experiment shows that distinguishing humans from AI still faces significant challenges because nobody in the subreddit discovered the AI bots during the entire experiment.
The r/changemyview board has 3.8 million members and ranks among the top 1% of subreddits by size.
Reddit considers legal options
The Reddit board’s moderators said they were unaware of the experiment and have asked the university for an apology and to block the publication of the research.
Reddit might also be considering legal action, as the platform’s chief legal officer, Ben Lee, said in a follow-up April 28 post that the experiment broke the site’s user agreement and rules, and all known accounts associated with the University of Zurich research effort were now banned.
“We are in the process of reaching out to the University of Zurich and this particular research team with formal legal demands,” Lee said.
“We want to do everything we can to support the community and ensure that the researchers are held accountable for their misdeeds here,” he added.
Related: White House receives over 10,000 comments on AI development plan
In its response to the subreddit, the University of Zurich’s Faculty of Arts and Sciences Ethics Commission said it had investigated the incident and promised to coordinate better with test subjects in the future. The lead investigator for the project was also issued a formal warning.
“This project yields important insights, and the risks are minimal. This means that suppressing publication is not proportionate to the importance of the insights the study yields,” the ethics commission said.
The University of Zurich did not immediately respond to a request for comment. Cointelegraph did not immediately receive a response to questions sent to an email address associated with the experiment.
Magazine: Bitcoin $100K hopes on ice, SBF’s mysterious prison move: Hodler’s Digest
