Model Card for Model ID

This model is fine-tuned on the Qwen1.5-4B-Chat model and COIG-CQIA/ruozhiba dataset by QLoRA.

Be noted that the model file contains the adapter LoRA weights only, so you are suggested to merge adapters with the base model for inference usage. Check the official reference here

This whole training process is running on Google Colab with free computing resources, detail can be accessed via link

This project is for the demonstration only of course DSAA5009, HKUST Guangzhou

Downloads last month
19
Safetensors
Model size
2.54B params
Tensor type
F32
·
U8
·
Inference Examples
Inference API (serverless) has been turned off for this model.

Dataset used to train Ti-ger/Qwen1.5-4B-CQIA