The wonderful setting alone is worth the an old abbey incorporating the massive remains of the city 's third-century Roman baths , the Thermes de Cluny .
Inside the old abbey , you 'll find the large remains of some Roman baths .