I don’t use conda either usually.
But it has this nice feature of being able to create a contained environment where you can install libraries without conflicting with the main system. So I use it to test a specific cuda or cudnn version temporarily.