Page is rather uncomfortable with how much information that Willow has on him, as well as the ability to manipulate fate, and intentions to manipulate the solars. It's nice that he's a moral guy, but he's willing to put aside his morals for the sake of his cause. That is why Dutiful Page doesn't trust him.