sap-bert-ko-en / README.md
snumin44's picture
Update README.md
10ee0d4 verified
|
raw
history blame
892 Bytes
metadata
license: mit
language:
  - ko
base_model:
  - klue/bert-base

๐ŸŠ SapBERT-Ko-EN

ํ•œ๊ตญ์–ด ๋ชจ๋ธ์„ ์ด์šฉํ•œ SapBERT(Self-alignment pretraining for BERT)์ž…๋‹ˆ๋‹ค.
ํ•œยท์˜ ์˜๋ฃŒ ์šฉ์–ด ์‚ฌ์ „์ธ KOSTOM์„ ์‚ฌ์šฉํ•ด ํ•œ๊ตญ์–ด ์šฉ์–ด์™€ ์˜์–ด ์šฉ์–ด๋ฅผ ์ •๋ ฌํ–ˆ์Šต๋‹ˆ๋‹ค.
์ฐธ๊ณ : SapBERT, Original Code

1. SapBERT-KO-EN

SapBERT๋Š” ์ˆ˜๋งŽ์€ ์˜๋ฃŒ ๋™์˜์–ด๋ฅผ ๋™์ผํ•œ ์˜๋ฏธ๋กœ ์ฒ˜๋ฆฌํ•˜๊ธฐ ์œ„ํ•œ ์‚ฌ์ „ ํ•™์Šต ๋ฐฉ๋ฒ•๋ก ์ž…๋‹ˆ๋‹ค.
Multi-Similarity Loss๋ฅผ ์ด์šฉํ•ด ๋™์ผํ•œ ์˜๋ฃŒ ์ฝ”๋“œ๋ฅผ ์ง€๋‹Œ ์šฉ์–ด ๊ฐ„์˜ ์œ ์‚ฌ๋„๋ฅผ ํ‚ค์šฐ๋Š” ๋ฐฉ์‹์œผ๋กœ ํ•™์Šตํ•ฉ๋‹ˆ๋‹ค.
SapBERT-KO-EN๋Š” ํ•œยท์˜ ํ˜ผ์šฉ์ฒด์˜ ์˜๋ฃŒ ๊ธฐ๋ก์„ ์ฒ˜๋ฆฌํ•˜๊ธฐ ์œ„ํ•ด ํ•œยท์˜ ์˜๋ฃŒ ์šฉ์–ด๋ฅผ ์ •๋ ฌํ•œ ๋ชจ๋ธ์ž…๋‹ˆ๋‹ค.

Github