The values of the logits might be harder to interpret, so you might want to apply a sigmoid to get the probabilities.
Note that a logit of 0 will map to p=0.5, so you could still easily get the prediction for this simple threshold with logits.