Intel ARC / XPU Support for Whisper ASR – An Open Invitation

[Sikerdebaard]

Hello Whisper ASR Team,

I've been having a blast using your web service. Inspired by your work, I decided to roll up my sleeves and add Intel ARC / XPU support. It's been quite the adventure, especially with the twists and turns of the Intel ARC ecosystem for deep learning.

Here's the catch though – the Docker image turned out to be a bit on the larger side, hitting the scales at about 25 GiB. So, I've held off on a pull request for now because that's quite a load to consider!

I'm reaching out to see if you're interested in this Intel ARC / XPU compatibility. If you are, my repo is ready and waiting to help as a starting point for weaving in support on your end. No pressure, though. Just thought I'd share what I've been up to and see if it could contribute to your toolkit.

If this sounds like something you'd want to explore, or if you have any insights, I'm here and happy to chat more.

My repo: https://github.com/Sikerdebaard/whisper-asr-webservice-xpu

[ayancey]

Please give us some time to review this. I don't have an ARC card, so testing could be difficult. Do you, @ahmetoner ?

[Oyo95]

Hi !

any news about the compatibility with Intel gpu arc ? :)

[ChezRD]

As far as I know, ctranslate2 has no support for XPU, so no faster-whisper too.
I used leuc/whisper on my ARC 750 with 8GB VRAM. This amount of VRAM can handle only medium model.