I have a Titan RTX card with some spare runtime.  I’d be interested in running some SQuAD 2.0 fine-tuning comparisons to your RTX 3090.
My modelcard for  'ahotrod/electra_large_discriminator_squad2_512`  5 includes the fine-tuning script file, Tensorboard loss rate image, nvidia-smi image for memory usage, and other specs for the 4-1/2 hr fine-tuning.  See complete details in “List all files in model”  of the modelcard.
deepset-ai/haystack ( https://github.com/deepset-ai/haystack 13 ) has convenient reader speed and accuracy benchmarks for benchmarking RTX3090 vs Titan RTX, https://github.com/deepset-ai/haystack/issues/441#issuecomment-701748635 10 using reader.eval_on_file("dev-v2.0.json")