YouTube Is Looking Into AI-powered Dub Tool To Translate Creators’ Videos
Last Updated on August 29, 2023 by
YouTube has made significant announcements for creators at this year’s VidCon, and they continue to introduce new features to enhance the creator experience. YouTube Is Looking Into AI-powered Dub Tool One of the recent announcements is the long-awaited thumbnail A/B split testing feature called Test & Compare, aimed at helping YouTubers optimize their video views. Additionally, YouTube is exploring another potential avenue to assist creators in reaching a wider audience: AI-powered multi-language voiceover dubbing for video content.
The AI dubbing tool is being developed in collaboration with Aloud, an AI dubbing company incubated within Google’s Area 120 startup program. The process begins with Aloud providing a transcription of the creator’s video, which can then be edited according to the creator’s preferences. YouTube Is Looking Into AI-powered Dub Tool Once the transcription is finalized, Aloud generates an AI-powered voiceover dub for the video. While Aloud currently offers this service for free on its separate website, YouTube is integrating the tool into its platform, although it is currently in the waitlist phase.
This enables viewers to easily switch to an alternative audio track in their preferred language by accessing the Settings button on the video. However, this feature requires creators to provide their own audio, which means they have to independently translate and dub their videos.
By leveraging AI technology, creators can save valuable time and resources while expanding their audience reach. This partnership could streamline the process of adding dubbed audio to videos, providing creators with a more convenient and cost-effective solution.
According to a YouTube spokesperson, the AI dubbing tool has already undergone testing with hundreds of creators. However, YouTube Is Looking Into AI-powered Dub Tool Aloud does have some limitations as outlined in its website’s FAQ section. Currently, the AI-powered tool is compatible only with English-language videos and supports dubbing into Spanish and Portuguese. Nevertheless, given Google’s support and the partnership with YouTube, it is likely that Aloud will expand its language options in the future. It is worth noting that this tool represents the second major feature related to multi-language dubbing that YouTube has introduced this year.
Back in February, YouTube introduced a feature that allows creators to upload multiple audio tracks for their videos, categorized by language. This enables viewers to easily switch to an alternative audio track in their preferred language by accessing the Settings button on the video. However, this feature requires creators to provide their own audio, which means they have to independently translate and dub their videos.
The collaboration between YouTube Is Looking Into AI-powered Dub Tool Tube and Aloud for AI-powered dubs has the potential to offer significant benefits to YouTubers. By leveraging AI technology, creators can save valuable time and resources while expanding their audience reach. This partnership could streamline the process of adding dubbed audio to videos, providing creators with a more convenient and cost-effective solution.
