Well water is always a finite source in that sense, but fresh water is infinite in that its part of a cycle from oceans to clouds to rain to ground water runnoff back to oceans.

What you're talking about is more to do with our usage of this source. It might not be finite in the cyclical sense, but it sure can be  finite based on how you manage the water. Which is a different thing.