Other than a signed envelope, how do we know that person assigned a ballot is the one using that ballot?  How do we know that the person is not being coerced into voting a certain?  How do you avoid disenfranchising somebody when their signature changes?