I checked the GPU implementation via:
>>> import torch
>>> x = torch.ones(40000)
>>> torch.norm(x)
tensor(266.0605)
>>> torch.norm(x.to(dtype=torch.float32, device='cuda'))
tensor(200., device='cuda:0')

Seems to work fine.
Are you seeing incorrect result on GPU as well?