What are the system requirements to train this
#1
by
Blazgo
- opened
1x H100? 8x H100? I don't mind if it takes around 2-4days.
1x H100? 8x H100? I don't mind if it takes around 2-4days.
Wait for our official announcement tomorrow. It will be 1xH100 for QLoRA and 4xH100 for LoRA
1x H100? 8x H100? I don't mind if it takes around 2-4days.
Oh wait I just realised you meant MAverick. Maverick will take 4xH100 minimum for QLoRA
Also, I want to know how many rows per minute will this take (on QLora). Also what are the requirements to train DS-V3 (I'm assuming the same), and how many rows per minute is that?
An estimate is fine, but I don't want to suddenly realize my job will cost $5000, also sorry I'm asking you so many questions. Google isn't much of a help.