Skip to content

camenduru/text-to-video-synthesis-colab

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

🐣 Please follow me for new updates https://twitter.com/camenduru
🔥 Please join our discord server https://discord.gg/k5BwmmvJJU
🥳 Please join my patreon community https://patreon.com/camenduru

🦒 Colab

Colab Type
Open In Colab longscope_text_to_video_colab polyware-ai/longscope
(Thanks to @polyware_ai ❤ for the model)
Open In Colab zeroscope_v2_xl_text_to_video_colab cerspense/zeroscope_v2_XL
(Thanks to @cerspense ❤ for the model)
Open In Colab zeroscope_v2_576w_text_to_video_colab cerspense/zeroscope_v2_576w
(Thanks to @cerspense ❤ for the model)
Open In Colab potat1_exp1_text_to_video_colab (Thanks to lambda labs ❤ for the gpu)
Open In Colab zeroscope_v2_dark_text_to_video_colab cerspense/zeroscope_v2_dark_30x448x256
(Thanks to @cerspense ❤ for the model)
Open In Colab zeroscope_v2_30x448x256_text_to_video_colab cerspense/zeroscope_v2_30x448x256
(Thanks to @cerspense ❤ for the model)
Open In Colab zeroscope_v1_1_320s_text_to_video_colab cerspense/zeroscope_v1-1_320s
(Thanks to @cerspense ❤ for the model)
Open In Colab potat1_text_to_video_colab camenduru/potat1 (Thanks to lambda labs ❤ for the gpu)
Open In Colab zeroscope_v1_320s_text_to_video_colab cerspense/zeroscope_v1_320s
(Thanks to @cerspense ❤ for the model)
Open In Colab ms_1_7b_text_to_video_colab damo-vilab/text-to-video-ms-1.7b
(Thanks to damodamo-vilab ❤ for the model)
Open In Colab animov_512x_text_to_video_colab strangeman3107/animov-512x
(Thanks to @bRuefiRe ❤ for the model)
Open In Colab animov_0_1_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model)
Open In Colab animov_0_1_text_to_video_colab strangeman3107/animov-0.1.1
(Thanks to @bRuefiRe ❤ for the model)
Open In Colab Watermark Remover
Open In Colab text_to_video_synthesis
(Thanks to damodamo-vilab ❤ for the model)
Open In Colab text_to_video_synthesis_diffusers
(Thanks to damodamo-vilab ❤ for the model)

🦒 Community Colab

Colab Function Author Readme
Open In Colab potat1_text_to_video_colab_ALM (Thanks to snydjos ❤) snydjos AILostMedia Readme

Tutorials

https://www.youtube.com/watch?v=WHcjD-uraUs (for zeroscope_video_webui_colab and zeroscope_upscale_video_webui_colab)
https://www.youtube.com/watch?v=E45AO1w9gRU (for Potat 1️⃣ and Zeroscope)
https://www.youtube.com/watch?v=b8D4am73e6I

Main Repo

https://www.modelscope.cn/models/damo/text-to-video-synthesis/summary
https://github.com/modelscope/modelscope
https://github.com/huggingface/diffusers

Paper

https://arxiv.org/abs/2308.06571

Models License

Apache License 2.0

Examples

Potat 1️⃣

out.mp4
out2.mp4
out3.mp4
out4.mp4
out27.mp4
waterfall.eb62844e.mp4

Base Model

A giraffe underneath a microwave.
A giraffe underneath a microwave.
A goldendoodle playing in a park by a lake.
A goldendoodle playing in a park by a lake.
A panda bear driving a car.
A panda bear driving a car.
A teddy bear running in New York City.
A teddy bear running in New York City.
Drone flythrough of a fast food restaurant
on a dystopian alien planet.
Drone flythrough of a fast food restaurant on a dystopian alien planet.
A dog wearing a Superhero outfit with red cape
flying through the sky.
A dog wearing a Superhero outfit with red cape flying through the sky.
Monkey learning to play the piano.
Monkey learning to play the piano.
A litter of puppies running through the yard.
A litter of puppies running through the yard.
Robot dancing in times square.
Robot dancing in times square.

Related Colab

https://github.com/camenduru/text2video-zero-colab