I am wondering what is the best way to accelerate Pytorch or what implementation is most commonly used?
write C/C++? pytorch lightning? or others?
what is the ecosystem in this field? people often choose what method to accelerate their pytorch training?