Support for Whisper JAX

[nicholaskoerfer]

Hi, thanks for this Software. It works perfect with Bazarr, for subtitle Translation.

However, it is, even with Faster-Whisper and a Tesla T4 GPU a bit slow.
There is a new Whisper implementation, that can Transcribe 1 Hour of Audio in approx. 15 seconds.

The new Whisper implementation is called "Whisper JAX" (https://github.com/sanchit-gandhi/whisper-jax). It has support for CPU, GPU and even TPU, though there is already a big speed gain just by using a GPU.

Is it possible for one to add this whisper implementation to this ASR Webservice, that you can select between OpenAI Whisper, Faster Whisper and Whisper JAX?

Thanks!

[Jessomadic]

This seems very interesting if it's easy to implement

[Jessomadic]

@nicholaskoerfer How is the accuracy of it? It's not worth gaining speed if the subtitles are worse

[Jessomadic]

HuggingFace has a webversion up and holy crap it's fast. 21 min youtube video in about 8 seconds

[nicholaskoerfer]

Yes, it's incredibly fast. In my opinion, the subtitles are accurate.

[Jessomadic]

Is this going to be worked on? @ahmetoner

[blundercode]

Hmm, this is pretty interesting great find! Would be cool to have a near-instant service even if the quality is slightly worse.