Hugging Face's logo

mjwong
/
whisper-large-v3-singlish-DRAFT

Automatic Speech Recognition
Transformers
Safetensors
English
whisper
Eval Results
Model card Files Community
mjwong commited on
Commit
1174dbe
·
verified ·
1 Parent(s): 696cc8c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -8
README.md CHANGED
@@ -19,6 +19,19 @@ model-index:
19
  - name: WER
20
  type: WER
21
  value: 14.84
 
 
 
 
 
 
 
 
 
 
 
 
 
22
  tags:
23
  - whisper
24
  ---
@@ -83,15 +96,15 @@ We evaluated the speculative decoding setup for Whisper-large-v3-singlish on the
83
 
84
  ### Model Performance
85
 
86
- | **Dataset** | **Model Variant** | **Link** | **Rel. RTFx** | **WER** |
87
- |-----------------|---------------------------|--------------------------------------------------------------------------------------------------|---------------|------------|
88
- | SASRBench-v1 | Large | [Whisper-large-v3-singlish](https://huggingface.co/mjwong/whisper-large-v3-singlish) | 1.00 | 16.41% |
89
- | SASRBench-v1 | Large-Turbo | [Whisper-large-v3-turbo-singlish](https://huggingface.co/mjwong/whisper-large-v3-turbo-singlish) | **2.36** | **13.35%** |
90
- | SASRBench-v1 | Draft-enhanced Large | Whisper-large-v3-singlish + [DRAFT](https://huggingface.co/mjwong/whisper-large-v3-singlish-DRAFT) | 2.20 | 14.84% |
91
  ||||||
92
- | AMI | Large | [Whisper-large-v3-singlish](https://huggingface.co/mjwong/whisper-large-v3-singlish) | 1.00 | 23.72% |
93
- | AMI | Large-Turbo | [Whisper-large-v3-turbo-singlish](https://huggingface.co/mjwong/whisper-large-v3-turbo-singlish) | 1.53 | **16.99%** |
94
- | AMI | Draft-enhanced Large | Whisper-large-v3-singlish + [DRAFT](https://huggingface.co/mjwong/whisper-large-v3-singlish-DRAFT) | **2.27** | 22.06% |
95
 
96
  ### Speculative Acceptance Rates (DRAFT-enhanced Large Model)
97
 
 
19
  - name: WER
20
  type: WER
21
  value: 14.84
22
+ - name: whisper-large-v3-singlish-DRAFT
23
+ results:
24
+ - task:
25
+ type: automatic-speech-recognition
26
+ dataset:
27
+ name: AMI
28
+ type: edinburghcstr/ami
29
+ subset: ihm
30
+ split: test
31
+ metrics:
32
+ - name: WER
33
+ type: WER
34
+ value: 22.06
35
  tags:
36
  - whisper
37
  ---
 
96
 
97
  ### Model Performance
98
 
99
+ | **Dataset** | **Model Variant** | **Link** | **Rel. RTFx** | **WER** |
100
+ |-----------------|---------------------------|----------------------------------------------------------------------------------------------------|---------------|------------|
101
+ | SASRBench-v1 | Large | [Whisper-large-v3-singlish](https://huggingface.co/mjwong/whisper-large-v3-singlish) | 1.00 | 16.41% |
102
+ | SASRBench-v1 | Large-Turbo | [Whisper-large-v3-turbo-singlish](https://huggingface.co/mjwong/whisper-large-v3-turbo-singlish) | **2.36** | **13.35%** |
103
+ | SASRBench-v1 | Draft-enhanced Large | Whisper-large-v3-singlish + [DRAFT](https://huggingface.co/mjwong/whisper-large-v3-singlish-DRAFT) | 2.20 | 14.84% |
104
  ||||||
105
+ | AMI | Large | [Whisper-large-v3-singlish](https://huggingface.co/mjwong/whisper-large-v3-singlish) | 1.00 | 23.72% |
106
+ | AMI | Large-Turbo | [Whisper-large-v3-turbo-singlish](https://huggingface.co/mjwong/whisper-large-v3-turbo-singlish) | 1.53 | **16.99%** |
107
+ | AMI | Draft-enhanced Large | Whisper-large-v3-singlish + [DRAFT](https://huggingface.co/mjwong/whisper-large-v3-singlish-DRAFT) | **2.27** | 22.06% |
108
 
109
  ### Speculative Acceptance Rates (DRAFT-enhanced Large Model)
110