finetuning dataset format

#230
by MadJay - opened

what are the formats for the dat0a if I want to finetune a model?
different format for different task? different format for base and instruct models?

my task is to make the model refer a context, cross check with user info and give a response based on system prompt

what should the data format be for finetuning the model for my data and my intended use?
should it look like the input I will give the model and response I expect from it?

or is there a predefined format with tags no matter how you want to use the model in the future?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment