BELOW SUPERNAV drop zone ⇩

YouTube AI mistakenly inserts foul language into kids’ videos, study finds

Swear word speech bubble set

Swear word speech bubble set (iStock/Getty Images)

MAIN AREA TOP drop zone ⇩

MAIN AREA TOP drop zone ⇩

maylen

https://digital-stage.newsnationnow.com/

AUTO TEST CUSTOM HTML 20241114185800

AUTO TEST CUSTOM HTML 20241115200405

AUTO TEST CUSTOM HTML 20241118165728

AUTO TEST CUSTOM HTML 20241118184948

(NEXSTAR) — Well, f—! Newly released data shows trusted kid-friendly YouTube videos may not be as safe as intended, due to explicit transcribing flubs on videos.

A new study performed at the Indian School of Business in Hyderabad, India, tested over 7,000 videos from some of YouTube’s most popular kids’ channels, with researchers finding the automatic speech transcription (ASR) system incorrectly switched some innocent words with more explicit ones. Researchers call this an “inappropriate content hallucination.”

While YouTube Kids more closely filters content, automated captions are currently only offered on the standard YouTube site.

Researchers observed YouTube Kids’ ASR transcribe “crab” to “crap,” “corn” to “porn,” “that is” to “panties,” and “brave” to “rape.” Several other four-letter words were also inadvertently transcribed on children’s videos.

A list of 1,300 “taboo” terms was created by the researchers, with their findings discovering at least 40% of captions automatically pulled from the sample videos contained words on the list. Some of the most frequent mistakenly auto-generated explicit words include, “b—-” and “penis.”

“Inappropriate content hallucinations” happen across other ASR technologies, however. Wired reports a transcript of a phone call changed a Persian woman’s name, Negar, to a racist slur. Meanwhile, researchers also tested ASR by Amazon, which also made similar mistakes. Amazon spokesperson Nina Lindsey declined comment to Wired but forwarded resources for developers to correct such mistakes.

“We are continually working to improve automatic captions and reduce errors,” YouTube spokesperson Jessica Gibby told Wired. She added that children under 13 are recommended to use YouTube Kids.

Researchers stressed the point of the study – which is still a preprint pending peer review – hopes to highlight ways to improve ASR for children’s videos. Some solutions offered include more closely programming the AI to avoid transcribing certain words and phrases, in addition to keeping children in mind when developing ASR systems to begin with. It’s also suggested that having a “human in the loop” to field discrepancies would help mitigate such issues.

U.S.

Copyright 2024 Nexstar Media Inc. All rights reserved. This material may not be published, broadcast, rewritten, or redistributed

Site Settings Survey

 

MAIN AREA MIDDLE drop zone ⇩

AUTO TEST CUSTOM HTML 20241119133138

MAIN AREA BOTTOM drop zone ⇩

tt

KC Chiefs parade shooting: 1 dead, 21 shot including 9 kids | Morning in America

Witness of Chiefs parade shooting describes suspect | Banfield

Kansas City Chiefs parade shooting: Mom of 2 dead, over 20 shot | Banfield

WWE star Ashley Massaro 'threatened' by board to keep quiet about alleged rape: Friend | Banfield

Friend of WWE star: Ashley Massaro 'spent hours' sobbing after alleged rape | Banfield

Clear

la

59°F Clear Feels like 59°
Wind
3 mph SW
Humidity
65%
Sunrise
Sunset

Tonight

A few passing clouds. Low around 45F. Winds light and variable.
45°F A few passing clouds. Low around 45F. Winds light and variable.
Wind
3 mph N
Precip
9%
Sunset
Moon Phase
Waning Gibbous