Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: transformers
|
| 3 |
+
tags: []
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
### Model Description
|
| 7 |
+
|
| 8 |
+
OpenAIμ whisper-base λͺ¨λΈμ μλ λ°μ΄ν°μ
μΌλ‘ νμ΅ν λͺ¨λΈμ
λλ€. phonetic formμ μ¬μ©νμ¬ νμ΅λμμ΅λλ€.
|
| 9 |
+
- νκ΅μ΄ μμ± (https://www.aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=realm&dataSetSn=123)
|
| 10 |
+
- μ£Όμ μμ± λ°μ΄ν° (https://www.aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=data&dataSetSn=71556)
|
| 11 |
+
- μ£Όμ μμλ³ νμ μμ±μΈμ λ°μ΄ν° (https://www.aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=data&dataSetSn=464)
|
| 12 |
+
- μ μμ§ μ νλ§ μμ±μΈμ λ°μ΄ν° (https://www.aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&dataSetSn=571)
|
| 13 |
+
- λ°©μ‘ μ½ν
μΈ λν체 μμ±μΈμ λ°μ΄ν° (https://www.aihub.or.kr/aihubdata/data/view.do?dataSetSn=463)
|
| 14 |
+
|
| 15 |
+
```
|
| 16 |
+
train_steps: 20000
|
| 17 |
+
warmup_steps: 2000
|
| 18 |
+
lr scheduler: linear warmup cosine decay
|
| 19 |
+
max learning rate: 1e-4
|
| 20 |
+
batch size: 256
|
| 21 |
+
max_grad_norm: 1.0
|
| 22 |
+
adamw_beta1: 0.9
|
| 23 |
+
adamw_beta2: 0.98
|
| 24 |
+
```
|
| 25 |
+
|
| 26 |
+
### Evaluation
|
| 27 |
+
|
| 28 |
+
https://github.com/rtzr/Awesome-Korean-Speech-Recognition
|
| 29 |
+
|
| 30 |
+
μ λ ν¬μ§ν 리μμ μ£Όμ μμλ³ νμ μμ±μ μ μΈν ν
μ€νΈμ
κ²°κ³Όμ
λλ€. μλ ν
μ΄λΈμμ whisper_base_komixv2_phnκ° λ³Έ λͺ¨λΈ μ±λ₯μ
λλ€.
|
| 31 |
+
|
| 32 |
+
|
| 33 |
+
| Model | cv_15_ko | fleurs_ko | kcall_testset | kconf_test | kcounsel_test | klec_testset | kspon_clean | kspon_other |
|
| 34 |
+
|-----------------------|----------|-----------|---------------|------------|---------------|--------------|-------------|-------------|
|
| 35 |
+
| whisper_base | 21.16 | 11.89 | 42.56 | 27.62 | 22.24 | 28.65 | 30.41 | 27.02 |
|
| 36 |
+
| whisper_base_komix | 15.42 | 7.16 | 20.86 | 14.24 | 12.64 | 13.44 | 12.26 | 12.12 |
|
| 37 |
+
| whisper_base_komixv2 | 13.97 | 9.29 | 10.58 | 14.85 | 12.52 | 16.01 | 14.23 | 14.93 |
|
| 38 |
+
| whisper_base_komixv2_phn | 12.81 | 8.27 | 9.5 | 13.26 | 11.33 | 14.24 | 13.11 | 13.3 |
|
| 39 |
+
| whisper_large_v3 | 5.11 | 3.72 | 5.45 | 9.35 | 3.83 | 8.46 | 15.08 | 12.89 |
|
| 40 |
+
| whisper_turbo | 5.38 | 3.95 | 5.89 | 9.77 | 4.21 | 9.27 | 16.49 | 13.54 |
|
| 41 |
+
| whisper_turbo_lora | 6.25 | 4.0 | 6.51 | 9.94 | 5.05 | 8.84 | 9.35 | 9.29 |
|
| 42 |
+
|
| 43 |
+
### Acknowledgement
|
| 44 |
+
- λ³Έ λͺ¨λΈμ ꡬκΈμ TRC νλ‘κ·Έλ¨μ μ§μμΌλ‘ νμ΅νμ΅λλ€.
|
| 45 |
+
- Research supported with Cloud TPUs from Google's TPU Research Cloud (TRC)
|