huseinzol05 commited on
Commit
cd49ec2
·
verified ·
1 Parent(s): a1d80da

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -17,6 +17,6 @@ Full README at [mesolitica/Llama-3.2-3B-Malaysian-Reasoning](https://huggingface
17
 
18
  ## Merging
19
 
20
- Because Llama 3.2 3B is using tied weight embedding, so merging required to clone embedding into lm head, script at https://github.com/mesolitica/malaya/blob/master/session/small-malaysian-reasoning/merge-3b.ipynb
21
 
22
  If the model is not a tied weight, you can use default `merge_and_unload` function from PEFT or unsloth.
 
17
 
18
  ## Merging
19
 
20
+ Because Llama 3.2 3B is using tied weight embedding, so merging required to clone embedding into lm head after that `addmm` as usual, script at https://github.com/mesolitica/malaya/blob/master/session/small-malaysian-reasoning/merge-3b.ipynb
21
 
22
  If the model is not a tied weight, you can use default `merge_and_unload` function from PEFT or unsloth.