Well, you figure how you'd like it if you were just a simple man and some priest magicked her away from you--and then sent her back with enough magic of her own to be a witch and make life hell for you because she'd been kicked out by the priest, but he hadn't pulled the wanting spell off her.
Would you ever steal a woman from someone using magic?