Int4/8 Quantized Whisper Models by using the quanto package and the CTranslate2 package. Requires (much) less GPU resources while keeping performance.
-
jvh/whisper-base-quant-ct2
Automatic Speech Recognition • Updated • 5 • 2 -
jvh/whisper-large-v2-quant-ct2
Automatic Speech Recognition • Updated • 2 • 3 -
jvh/whisper-medium-quant-ct2
Automatic Speech Recognition • Updated • 1 • 2 -
jvh/whisper-large-v3-quant-ct2
Automatic Speech Recognition • Updated • 7 • 1