If you want a cheaper experience in Iceland that's similar, go to the public pools. They are nicely heated all year round, cheap to enter, large, and social. It's a part of Icelandic culture that's very accessible.