Simple question:-
Has anyone tried to fine-tune gpt2-xl on CPU? if so, how much RAM and time does it take? What instance did you use?
Also, does anybody know the answers to the same question for Megatron-11b in accordance with this 7??