YouTube’s AI can now describe sound effects

http://www.theverge.com/2017/3/24/15053328/youtube-ai-caption-sound-effects

YouTube’s AI can now describe sound effects

by Micah Singleton . @MicahSingleton  Mar 24, 2017, 3:17pm EDT

YouTube has had automated captions for its videos since 2009, and now it’s expanding the feature to include captions for sound effects. The video service uses machine learning to detect sound effects in videos and add the captions [APPLAUSE], [MUSIC], and [LAUGHTER] to millions of videos.

While those three were some of the most frequent manually captioned sounds, YouTube says it’s only in the early stages of making improvements for its deaf and hard of hearing users. The company says captions like ringing, barking, and knocking are next in line, but those require more deciphering than simple laughter or music.

The improved captions are now available on YouTube.