Skip to content

Wunjo CE: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, TTS. Open Source, Local & Free.

License

Notifications You must be signed in to change notification settings

wladradchenko/wunjo.wladradchenko.ru

Repository files navigation

Price Python 3.10 GitHub package version License: MIT v1.0 Dev.to Articles YouTube Chanel Hugging Face Models

[RU]


Logo

Wunjo Community Edition (CE)

Documentation
Issue · Discussions · Tutorial

Big update Wunjo v2

Hey there! Your support means the world to me and is crucial in accelerating the release of new updates for the Community Edition (CE). Your encouragement drives me to enhance features, release new versions, for example integrate improved voice cloning, among other exciting advancements.

Available now

Professional (Pro) version available on wunjo.online to download. Community Edition (CE) will be available soon.

And if you wanna help to project, you can do:

  • Spread the Word: Share the project with your friends and invite them to join our community.
  • Stay Connected: Subscribe to the Wunjo project on GitHub and follow me on social media. You can find me by wladradchenko in social media and wladblog in Telegram.
  • Support on Boosty: Your support on Boosty will help determine which features from the Professional version will migrate to the CE.
What is update? Open this list to see full review on YouTube.
Review
video

About

Wunjo harnesses the power of neural networks to provide cutting-edge solutions in speech synthesis, voice cloning, content restyling, and deepfake animations. Official website wunjo.online.

Try it now
video
Open list to see more details.

In version 1.6, Wunjo supports multiple languages for voice cloning and speech synthesis, TTS model training, real-time speech recognition, audio enhancement, a multi-language interface, and the use of the "pass" keyword in the video-to-video feature.

The new version 2.0 introduces a completely redesigned interface, enhanced performance, improved face swap functionality, a generator for non-existent people’s faces, and a deepfake analyzer. It also includes improvements in lip sync, content enhancement, object, text, and background removal, as well as content and component restyling using text prompts. Additionally, public links enable community creation and collaboration.

Future updates will reintroduce and enhance the missing audio functionalities from version 1.6, making them even better.

Available as both a free Community Edition and a subscription-based Professional Edition on wunjo.online, Wunjo caters to a wide range of users, from beginners to professionals, ensuring privacy by operating locally on your device.

Why Choose Wunjo Community Edition?

  • All-in-One: A comprehensive tool catering to both your voice and visual AI needs.
  • User-friendly: Designed for all, from beginners to professionals.
  • Privacy First: Functions locally on your desktop, ensuring your data remains private.
  • Open-source & Free: Benefit from community-driven enhancements and enjoy the app without any cost.

Why Choose Wunjo Professional?

  • More features: First access to updates, additional and more advanced features.
  • Public links: Host your own server (PC) application accessible from anywhere in the world.
  • Unlimited performance: Process multiple tasks simultaneously to increase overall productivity.

Step into the future of AI-powered creativity with Wunjo.

Setup

Requirements Python version 3.10 and ffmpeg.

For detailed instructions about setup Wunjo CE from GitHub, refer to the Launch Project from GitHub section in our wiki.

How build from code on Windows?
video

You will find on wunjo.onnline official installers on Wundows/Ubuntu or portable versions 1.6 and 2.0.

Examples

Open list to see details about requirements and examples.

1. Speech synthesis and voice cloning

Available on CE 1.6.

2. Face animation from image src
Original Fix face + Enhancer
original static_enhancer
3. Mouth animation from video src
Original Mouth animation Mouth animation + Enhancer
original move_enhancer static_enhancer
4. Face swap by one photo
Original photo Original video Face swap + Background enhancer
original original static_enhancer
5. Remove object
Original video Remove object
original original
6. Get segmentation mask by one click
Original Mask
original original
7. Video-to-Video by Text Prompt (Only for GPU)

The higher the video resolution, the better the quality of the drawn frames.

Video resolution 512x512 default model for deepfake

Original Blonde hair + Brown jacket
original pass

Video resolution 512x512 custom model for anime

Additionally, you can use your custom stable diffusion model to redraw video or objects in video with difference timeline.

Original Object pass + Background change
original pass
Object change + Enhancement move Object change + Enhancement anime
full_change full_change

Limit resolution video by GPU VRAM

32 GB 23 GB 18 GB 14 GB 10 GB 8 GB 7 GB
1280x1280 1080x1080 1024x1024 768x768 640x640 576x576 512x512
8. Emotion deepfake [Experimental]

This is an experimental feature that is under development, but you can take a look at some of the work right now in Wunjo CE 1.6.

Original Happy Angry
original original original
Fear Sad Disgust
original original original

Updates

Update 2.0.0
  • Completely redesigned interface for desktop and mobile devices, from ground zero.
  • Enhanced performance with simultaneous task handling, stability, and faster processing.
  • Improved face swap functionality now supports multiple face swap at different timings via API.
  • Introducing generator of non-existent people face.
  • Deepfake analyzer added to discern authentic content from manipulated media.
  • Enhanced lip sync for smoother animations and elimination of chin defects.
  • Real-time mask selection for seamless editing experience.
  • Added select area to remove text.
  • Separated tasks for object removal and background elimination for greater precision. Now you can create chroma key video.
  • Custom file manager introduced for efficient file management within the application.
  • Improved interaction with neural network models, including seamless downloading from the internet.
  • Easy switch from client to server application and back.
  • Multi-user support with customizable limits on simultaneous tasks and memory usage (RAM, VRAM, duration, size, number at the same time task).
  • Internal tips provided for optimizing content quality.
  • Smart generator of prompts for video and object restyling.
List features updates
  • Public link exchange for online users.
  • Control restyling video and its components.
  • Multi language clone voice.
  • Improve audio separator.
  • Multi language interface.
  • Improve user profile.
  • Improve processing content status.

Support the Project

You can support the author of the project in the development of his creative ideas on Boosty or CloudTips. Thanks to Boosty, you will have the opportunity to use your voice to choose which functions from the Professional version will appear in the Community Edition in new updates. There are other ways to support the development of the project, more details on page.

Boosty CloudTips
pizza coffee

Supporters and Donors

I extend heartfelt gratitude to the following individuals who have generously supported this project through donations:

  • Monogo - 110$.
  • S. - 50$.
  • Konstantin Kravtsov - 35$.
  • LEO - 5$.
  • Several contributors who have chosen to remain anonymous or opted not to be listed publicly. Your support is immensely appreciated.

I sincerely appreciate the generosity of all project supporters. Your contributions enable me to continue improving and maintaining this project.

Contact

Owner: Wladislav Radchenko

Email: i@wladradchenko.ru

Project: https://github.com/wladradchenko/wunjo.wladradchenko.ru

Web site: wunjo.online

Premise

Wunjo comes from the ancient runic alphabet and represents joy and contentment, which could tie into the idea of using the application to create engaging and expressive speech. Vunyo (ᚹ) is the eighth rune of the Elder and Anglo-Saxon Futhark. Prior to the introduction of the letter W into the Latin alphabet, the letter Ƿynn (Ƿƿ) was used instead in English, derived from this rune.

Credits

Wunjo is built upon the remarkable work of various open-source projects. Each integrated component reflects a commitment to improving and adapting existing technologies within the collaborative landscape of open-source development. The list below highlights the projects that have been adapted and enhanced for inclusion in Wunjo:

I extend my deepest gratitude to the original contributors of these technologies. Their groundbreaking work has been instrumental in advancing the capabilities of Wunjo CE. For the persistent storage and versioning of the models I have personally trained, I utilize the Hugging Face Model Storage. If you're interested in contributing to Wunjo CE, especially in the area of voice cloning for new languages, please feel free to propose your models or reach out for collaboration via GitHub Discussions or the Hugging Face.

[to top]