You can limit your parameter by feed it as input to a function, e.g., sigmoid.
my_param= nn.Parameter(torch.empty(1).cuda(), requires_grad=True)
my_param_limited = torch.sigmoid(my_param)

Note the difference in the names of the parameters, since using a single name, changes the computation graph, and make backpropagation impossible.