Update README.md
Browse files
README.md
CHANGED
@@ -90,9 +90,10 @@ The current version of Ultravox, when invoked with audio content, has a time-to-
|
|
90 |
Check out the audio tab on [TheFastest.ai](https://thefastest.ai/?m=audio) for daily benchmarks and a comparison with other existing models.
|
91 |
|
92 |
## Evaluation
|
|
|
|
|
|
|
|
|
|
|
|
|
93 |
|
94 |
-
| | Ultravox v0.2 | Ultravox v0.3 | Whisper-Llama3.1 | Llama3.1 (text-only) |
|
95 |
-
|-------------------|---------------|---------------|------------------|----------------------|
|
96 |
-
| en_de (BLEU) | 12.07 | 22.68 | 24.89 | 31.95 |
|
97 |
-
| es_en (BLEU) | 15.17 | 24.10 | 28.67 | 38.28 |
|
98 |
-
| LibriSpeech clean.test (WER) | 6.07 | 6.67 | 3.4 | - |
|
|
|
90 |
Check out the audio tab on [TheFastest.ai](https://thefastest.ai/?m=audio) for daily benchmarks and a comparison with other existing models.
|
91 |
|
92 |
## Evaluation
|
93 |
+
| | en_de (BLEU) | es_en (BLEU) | LibriSpeech clean.test (WER) |
|
94 |
+
|:------------------|:-------------|:-------------|:----------------------------|
|
95 |
+
| Ultravox v0.2 | 12.07 | 15.17 | 6.07 |
|
96 |
+
| **Ultravox v0.3** | 22.68 | 24.10 | 6.67 |
|
97 |
+
| Whisper-Llama3.1 | 24.89 | 28.67 | 3.4 |
|
98 |
+
| Llama3.1 (text-only) | 31.95 | 38.28 | - |
|
99 |
|
|
|
|
|
|
|
|
|
|