Amphion (/æmˈfaɪən/) is a toolkit for Audio, Music, and Speech Generation. Its purpose is to support reproducible research and help junior researchers and engineers get started in the field of audio, music, and speech generation research and development.

A family of diffusion models for text-to-audio generation.

A webui for different audio related Neural Networks

PyTorch Implementation of Make-An-Audio (ICML'23) with a Text-to-Audio Generative Model

Implementation of NÜWA, state of the art attention network for text to video synthesis, in Pytorch

Mustango: Toward Controllable Text-to-Music Generation

Official codes and models of the paper "Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation"

Word2Wave: a framework for generating short audio samples from a text prompt using WaveGAN and COALA.

Subtitle to audio, generate audio from any subtitle file using Coqui-ai TTS and synchronize the audio timing according to subtitle time.

PyTorch Implementation of Google Brain's WaveGrad 2: Iterative Refinement for Text-to-Speech Synthesis

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

text-to-audio-latent-diffusion

Soundstorm is a cutting-edge AI-powered audio manipulation application designed to provide a rich yet simplified experience for sound designers, algorithmic composers, and experimental audio enthusiasts. From sample pack creation and algorithmic composition to AI text-to-audio and onscreen ChatGPT, Soundstorm is a sonic powerhouse.

AudioLDM text to audio colab

Exploring Bark, the Open-Source Text-to-Audio Generative Model

Creative Text-to-Audio Generation via Synthesizer Programming @ NeurIPS'23 ML4Audio Workshop

core shell functions building blocks for advanced AI pipelines

A text to audio pipeline using Riffusion (a finetuned stablediffusion model) and using RAVE a audio to audio AutoEncoder.

Accelerating Diffusion-Based Text-to-Audio Generation with Consistency Distillation

TalkItOut is a Python and Flask-based web application that can convert text to speech, choose your preferred language for audio output, access a built-in dictionary for word meanings, and even extract text from images, complete with audio generation.