“Lack of fine-tuning for your specific length” could you specify what you mean? more on the data cleaning / structuring side, or on the training side, training differently or for more checkpoints? FWIW i have a beefy 3090 and see the same thing on medium and large 
Also, are you available for consultation? would be great to discuss this in detail for 3-4 hours.
Cheers!