Update README.md
Browse files
README.md
CHANGED
@@ -28,4 +28,8 @@ Finetune on [mesolitica/Malaysian-SFT](https://huggingface.co/datasets/mesolitic
|
|
28 |
4. Chunk CCE loss for LoRA.
|
29 |
5. WanDB at https://wandb.ai/huseinzol05/lora-embedding-128-llama3.1-70b-malaysian-8k?nw=nwuserhuseinzol05
|
30 |
|
31 |
-
Source code at https://github.com/mesolitica/malaya/tree/master/session/llama3
|
|
|
|
|
|
|
|
|
|
28 |
4. Chunk CCE loss for LoRA.
|
29 |
5. WanDB at https://wandb.ai/huseinzol05/lora-embedding-128-llama3.1-70b-malaysian-8k?nw=nwuserhuseinzol05
|
30 |
|
31 |
+
Source code at https://github.com/mesolitica/malaya/tree/master/session/llama3
|
32 |
+
|
33 |
+
## Acknowledgement
|
34 |
+
|
35 |
+
Special thanks to https://www.sns.com.my for 8x H100 node!
|