I never said we had a solution to load the model with less than 12GB of GPU RAM. That is just not possible at the moment. We have merged the PR that adds a low_memory argument to from_pretrained to be able to load the model with 12GB of CPU RAM.
Obviously such a big model requires specialized hardware.