If the model parameters already take more memory than your GPU has I don’t think there is a way to make it work besides using only a subset of the model on the GPU and the rest on the CPU.
I don’t know if you would expect any speedup due to the transfer of tensors between the GPU and the host, so you would have to profile it against a CPU-only run.