ToTensor might not normalize your image, if it detects an image in mode I;16 as seen in this line of code 29 and this 17.
Are you using the whole range of uint16? If so you could normalize your image manually using the max value (65535).