It depends on the plant. If it was clean water that was boiled as part of the power generation process from a plant that didn't contaminate it then sure. I probably woldn't bathe in coolant/neutron moderating water from an LWR though.