Katarzyna Petru
YouTube is expanding its automatic dubbing feature to make it easier for viewers who don't understand the original language to watch films. The tool uses artificial intelligence to translate speech and replace the original soundtrack with a narrated version in another language. Currently, automatic dubbing supports 27 languages, and users can specify their preferred language in their account settings. If a language version is available, YouTube will automatically play it, so that content from around the world is understandable as soon as you click "play".
Less “robotic.” YouTube enhances auto-dubbing
YouTube acknowledges that automatic dubbing can be annoying if it sounds too artificial or doesn't match the visuals. That’s why the platform has introduced a new feature called Expressive Speech, which aims to better convey the tone of voice, emotions, and pace of speech in the translated audio track. The goal is to make the dubbing sound as natural as possible and resemble the original. The feature is already available for channels in several languages, including Polish, English, French, German, Spanish, and Portuguese, with YouTube announcing plans to gradually expand the list. A pilot Lip Sync system is also being tested, which gently adjusts the lip movements of the speaking person to the translated audio, aiming to reduce the effect of “out of sync” visuals and audio. Although the dubbing is created automatically, creators maintain full control—they can completely disable this feature or replace it with their own language version. YouTube also uses intelligent filters that prevent dubbing content where the translation doesn't make sense, such as films without dialogues or materials based solely on music.
YouTube admits that automatic dubbing is still not without its faults. Problems often arise from inaccurate speech recognition or poor sound quality in the original material. However, the platform emphasizes that the system will be gradually improved as more data and user feedback comes in. At the same time, YouTube is increasingly focusing on AI-based personalisation. An example is the Recap feature, which assigns users a specific "profile" based on their viewing history, helping to better tailor the recommended content and how it is presented. This is another step towards a more intelligent and personalised viewing experience.
Source: digitaltrends.com
