The social contract that most reasonable people have is that my rights cannot be taken away if I am not harming others. You can't take MY right away because you fear that someone will use said right to harm you. You are starting to sound like RR when he talks about cannabis.