Minumum gpu ram to fine tune phi-2 on custom data and what should be the datarows to fine tune phi-2 model.

#126
by Ayushmzn - opened

if i wanted to fine tune phi-2 model with 8 bit quantization. How much gpu ram will be needed and how much data should i prepare for fine tuning for questio n answering task ex-50000 datarows.

Sign up or log in to comment