There is torch.potrs if you have a system with the symmetric matrix and the general solver torch.gesv if you want to solve something with the factor as matrix (a triangular solve would be nixe, of course). In my candlegp Gaussian Process lubrary 20 I caught myself forgetting to specify upper=False to get the lower factor - that was a greater nuisance  than the solver…
Best regards
Thomas