I don't see a solid logical connection in your comparison. The act of rape/murder violates another's civil rights as part of the act. Owning a gun doesn't violate anyone's civil rights until it is used against them. A better comparison would be to compare gun ownership to drug possession.
With that perspective, his argument isn't as stupid as you suggest.