Automatic dubbing demo

The automatic dubbing of films is a difficult challenge for the moment (different voices, colloquial language, different speeds...), but for some types of documentaries (single speaker, voice-over, coordination of the lips not necessary or unimportant ...) we've done a demo that performs satisfactorily. Given a documentary in Spanish and its transcription (the transcription can be obtained automatically by means of any of the dictation programs for Spanish in the market), Vicomtech-IK4's temporal alignment technology creates a subtitles file (the transcription with time marks for the beginning and end of each sentence). Then, IXa group's Matxin MT system automatically translates the subtitles into Basque, and Aholab's text-to-speech technology obtains the synchronized voice. We have successfully applied this demo to the single-speaker sections of the television program Teknopolis produced by Elhuyar.

The demo can be seen at work in the following direction: http://bikoizketaautomatikoa.berbatek.com