BELOW SUPERNAV drop zone ⇩

US receives thousands of reports of AI-generated child abuse content

FILE - Paul Carpenter describes AI software during an interview in New Orleans, Friday, Feb. 23, 2024. Carpenter says he was hired in January to use AI software to imitate President Joe Biden's voice to convince New Hampshire Democrat voters not to vote in the state's presidential primary. (AP Photo/Matthew Hinton)

FILE – Paul Carpenter describes AI software during an interview in New Orleans, Friday, Feb. 23, 2024. Carpenter says he was hired in January to use AI software to imitate President Joe Biden’s voice to convince New Hampshire Democrat voters not to vote in the state’s presidential primary. (AP Photo/Matthew Hinton)

MAIN AREA TOP drop zone ⇩

Jan 31 (Reuters) – The U.S. National Center for Missing and Exploited Children (NCMEC) said it had received 4,700 reports last year about content generated by artificial intelligence that depicted child sexual exploitation.

The NCMEC told Reuters the figure reflected a nascent problem that is expected to grow as AI technology advances.

In recent months, child safety experts and researchers have raised the alarm about the risk that generative AI tech, which can create text and images in response to prompts, could exacerbate online exploitation.

The NCMEC has not yet published the total number of child abuse content reports from all sources that it received in 2023, but in 2022 it received reports of about 88.3 million files.

“We are receiving reports from the generative AI companies themselves, (online) platforms and members of the public. It’s absolutely happening,” said John Shehan, senior vice president at NCMEC, which serves as the national clearinghouse to report child abuse content to law enforcement.

The chief executives of Meta Platforms (META.O), X, TikTok, Snap (SNAP.N) and Discord testified in a Senate hearing on Wednesday about online child safety, where lawmakers questioned the social media and messaging companies about their efforts to protect children from online predators.

Researchers at Stanford Internet Observatory said in a report in June, that generative AI could be used by abusers to repeatedly harm real children by creating new images that match a child’s likeness.

Content flagged as AI-generated is becoming “more and more photo realistic,” making it challenging to determine if the victim is a real person, said Fallon McNulty, director of NCMEC’s CyberTipline, which receives reports of online child exploitation.

OpenAI, creator of the popular ChatGPT, has set up a process to send reports to NCMEC, and the organization is in conversations with other generative AI companies, McNulty said.

Reporting by Sheila Dang in Austin, Editing by Kylie MacLellan.

AI

Copyright 2024 Nexstar Media Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed

MAIN AREA MIDDLE drop zone ⇩

Trending on NewsNation

MAIN AREA BOTTOM drop zone ⇩

tt

KC Chiefs parade shooting: 1 dead, 21 shot including 9 kids | Morning in America

Witness of Chiefs parade shooting describes suspect | Banfield

Kansas City Chiefs parade shooting: Mom of 2 dead, over 20 shot | Banfield

WWE star Ashley Massaro 'threatened' by board to keep quiet about alleged rape: Friend | Banfield

Friend of WWE star: Ashley Massaro 'spent hours' sobbing after alleged rape | Banfield

Partly Cloudy

la

61°F Partly Cloudy Feels like 61°
Wind
5 mph SW
Humidity
56%
Sunrise
Sunset

Tonight

Partly cloudy early followed by cloudy skies overnight. Low 49F. Winds light and variable.
49°F Partly cloudy early followed by cloudy skies overnight. Low 49F. Winds light and variable.
Wind
4 mph N
Precip
1%
Sunset
Moon Phase
Waning Crescent