he had even wished he could have stayed away from weekly church services , but that was against the law and paying the fines each week of fifty pounds of tobacco would have taken everything he had planted .