Distil-Whisper in Rust 🦀

[sanchit-gandhi]

Rust Support

Through an integration with Hugging Face Candle 🕯️, Distil-Whisper is now available in the Rust library 🦀

Benefit from:

• Optimised CPU backend with optional MKL support for x86 and Accelerate for Macs.
• CUDA backend for efficiently running on GPUs, multiple GPU distribution via NCCL.
• WASM support, run Distil-Whisper in a browser!

Example

Here's an example running distil-medium.en on Mac M1:

jfk.mov

Usage

Steps for getting started:

1. Install candle-core as explained here
2. Clone the candle repository locally:

git clone https://github.com/huggingface/candle.git

3. Enter the example directory for Whisper:

cd candle/candle-examples/examples/whisper

4. Run an example:

cargo run --example whisper --release -- --model distil-medium.en

5. To specify your own audio file, add the --input flag:

cargo run --example whisper --release -- --model distil-medium.en --input audio.wav