He determined to go and see them , and to find out the truth for himself ; so one night , without saying anything to the Queen or his ministers , he set out for the palace where the two ladies lived , attended only by a small band of followers .