Hugging Face's logo

NumbersStation
/
nsql-llama-2-7B

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
20

training script

#5
by gchoueiter - opened
Discussion
gchoueiter

Hi. Thank you for sharing this.

  1. Is it possible for you to share how you trained the model with the data prepared here
    https://github.com/NumbersStationAI/NSQL/tree/main/data_prep
  2. Is it the same as this? https://github.com/NumbersStationAI/NSQL/blob/main/examples/finetune.ipynb
  3. What resources did you use and how much time did it take?

thanks again.
G

senwu
 NumbersStation org

Hi @gchoueiter ,

Thanks for your interest in our work!

You can find our training receipt here. The notebook is a simple example of how to further fine-tune the model based on your use case and for our model training we use 8*A100 80G machines for about 2 weeks.

Perseus14

Hi Senwu

Would you be willing to share the training code (the training & fine-tuning)?

Thank you

samvedya

Hi Senwu

Would you be willing to share the training code (the training & fine-tuning)?

Thank you

Have you found any code for this?

Sign up or log in to comment