RefalMachine commited on
Commit
c3287d0
1 Parent(s): 9ba05c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -2
README.md CHANGED
@@ -7,6 +7,12 @@ language:
7
  - en
8
  ---
9
 
10
- ## Model description
11
 
12
- LoRa tuned version of RefalMachine/llama3_extended_darulm_20_05_24_part1-2_64000_bpe_full_lr2e4_bs256 after LEP (Learned Embedding Propagation, paper will be soon) procedure on saiga_scored d7 dataset.
 
 
 
 
 
 
 
7
  - en
8
  ---
9
 
10
+ # Model description
11
 
12
+ LoRa tuned version of RefalMachine/llama3_extended_darulm_20_05_24_part1-2_64000_bpe_full_lr2e4_bs256 after LEP (Learned Embedding Propagation, paper will be soon) procedure on saiga_scored d7 dataset.
13
+
14
+ # How to cite:
15
+
16
+ Tikhomirov M., Chernyshev D. Facilitating large language model Russian adaptation with Learned Embedding Propagation // 2024 (will be soon)
17
+
18
+ Tikhomirov M., Chernyshev D. Impact of Tokenization on LLaMa Russian Adaptation //2023 Ivannikov Ispras Open Conference (ISPRAS). – IEEE, 2023. – С. 163-168.