unet_source_separation

source_separation

input

• Noisy speech (audio file)

Audio from creative commons youtube videos
https://drive.google.com/drive/folders/19Sn6pe5-BtWXYa6OiLbYGH7iCU-mzB8j
doublenoble_k7rain_part.wav
(Original video : https://www.youtube.com/watch?v=vsjB1xTwZ20&t=536s)

• Music (audio file)

DSD100 dataset
https://sigsep.github.io/datasets/dsd100.html
049 - Young Griffo - Facade.wav

output

Separated voice (audio file)

separated_voice.wav

Usage

Automatically downloads the onnx and prototxt files on the first run. It is necessary to be connected to the Internet while downloading.

For the sample audio file,

$ python3 unet_source_separation.py

If you want to specify the input audio file, put the input path after the --input option. You can use --savepath option to change the name of the output file to save.

$ python3 unet_source_separation.py --input WAV_PATH --savepath SAVE_WAV_PATH

You can select a pretrained model by specifying --arch base (default) or --arch large. base is a model for general voice separation task, and large is a model for singing voice separation task.

$ python3 unet_source_separation.py --input WAV_PATH --savepath SAVE_WAV_PATH --arch base

Reference

source_separation

Singing Voice Separation Samples

Framework

PyTorch 1.6.0

Model Format

ONNX opset = 11

Netron

• General voice separation

second_voice_bank.best.opt.onnx.prototxt

• Singing voice separation

RefineSpectrogramUnet.best.opt.onnx.prototxt