Skip to content

A simple Google Colab notebook which can translate an original video into multiple languages along with lip sync.

Notifications You must be signed in to change notification settings

pranauv1/AI-Video-Translation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 

Repository files navigation

AI-Video-Translation

A simple Google Colab notebook which can translate an original video into multiple languages along with lip sync.

How it works?

1: Upload video
2: Extract audio and get text from the audio (OpenAI Whisper)
3: Translate the text (Google Translate)
4: Synthesize the translated text with the original voice. a.k.a Voice Cloning (coqui-ai TTS)
5: Lip sync the synthesized audio with the original video clip (OpenTalker video-retalking || Wav2Lip)

The links for the repos mentioned above are given in the notebook itself.

About

A simple Google Colab notebook which can translate an original video into multiple languages along with lip sync.

Topics

Resources

Stars

Watchers

Forks