Thanks @kimishpatel . Unfortunately the matrix is not small and option 1 does not fit.
Is there any documentation on option 2? I can try but I guess we need to prepare a LAPACK library before build the PyTorch?