snumin44 commited on
Commit
73164d2
ยท
verified ยท
1 Parent(s): fcf0388

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - ko
5
+ base_model:
6
+ - klue/bert-base
7
+ ---
8
+ # ๐ŸŠ SapBERT-Ko-EN
9
+
10
+ - ํ•œ๊ตญ์–ด ๋ชจ๋ธ์„ ์ด์šฉํ•œ **SapBERT**(Self-alignment pretraining for BERT)์ž…๋‹ˆ๋‹ค.
11
+ - ํ•œยท์˜ ์˜๋ฃŒ ์šฉ์–ด ์‚ฌ์ „์ธ KOSTOM์„ ์‚ฌ์šฉํ•ด ํ•œ๊ตญ์–ด ์šฉ์–ด์™€ ์˜์–ด ์šฉ์–ด๋ฅผ ์ •๋ ฌํ–ˆ์Šต๋‹ˆ๋‹ค.
12
+ - ์ฐธ๊ณ : [SapBERT](https://aclanthology.org/2021.naacl-main.334.pdf), [Original Code](https://github.com/cambridgeltl/sapbert)
13
+
14
+ ## 1. SapBERT-KO-EN
15
+ - **SapBERT**๋Š” ์ˆ˜๋งŽ์€ ์˜๋ฃŒ ๋™์˜์–ด๋ฅผ ๋™์ผํ•œ ์˜๋ฏธ๋กœ ์ฒ˜๋ฆฌํ•˜๊ธฐ ์œ„ํ•œ ์‚ฌ์ „ ํ•™์Šต ๋ฐฉ๋ฒ•๋ก ์ž…๋‹ˆ๋‹ค.
16
+ - Multi-Similarity Loss๋ฅผ ์ด์šฉํ•ด ๋™์ผํ•œ ์˜๋ฃŒ ์ฝ”๋“œ๋ฅผ ์ง€๋‹Œ ์šฉ์–ด ๊ฐ„์˜ ์œ ์‚ฌ๋„๋ฅผ ํ‚ค์šฐ๋Š” ๋ฐฉ์‹์œผ๋กœ ํ•™์Šตํ•ฉ๋‹ˆ๋‹ค.
17
+ - **SapBERT-KO-EN**๋Š” ํ•œยท์˜ ํ˜ผ์šฉ์ฒด๋กœ ์ด๋ฃจ์–ด์ง„ ํ•œ๊ตญ ์˜๋ฃŒ ๊ธฐ๋ก์„ ์ฒ˜๋ฆฌํ•˜๊ธฐ ์œ„ํ•ด ํ•œยท์˜ ์˜๋ฃŒ ์šฉ์–ด๋ฅผ ์ •๋ ฌํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.
18
+
19
+
20
+ [Github](https://github.com/snumin44/SapBERT-KO-EN)