4yo1/llama3-pre1-pre2-ds-lora3-mergkit-base

Model Card for Model ID

Model Details

Model Card: sapie with Fine-Tuning Model Overview Model Name: 4yo1/llama3-pre1-pre2-ds-lora3-mergkit-base

Model Type: Transformer-based Language Model

Model Size: 8 billion parameters

by: 4yo1

Languages: English and Korean

how to use - sample code

from transformers import AutoConfig, AutoModel, AutoTokenizer

config = AutoConfig.from_pretrained("4yo1/llama3-pre1-pre2-ds-lora3-mergkit-base")
model = AutoModel.from_pretrained("4yo1/llama3-pre1-pre2-ds-lora3-mergkit-base")
tokenizer = AutoTokenizer.from_pretrained("4yo1/llama3-pre1-pre2-ds-lora3-mergkit-base")

datasets:

• 140kgpt

license: mit