Update:
torch.triangular_solve has a better execution time than torch.inverse in this case (triangular matrix)
import torch
import time
start_time=time.time()
matrix=torch.eye(8192)
cholesky_decomp=torch.cholesky(matrix)
matrix_inverted,_=torch.triangular_solve(torch.eye(cholesky_decomp.shape[0]), cholesky_decomp)
print(time.time()-start_time)