Valoren is relating to his true form being 50 feet tall and incredibly powerful.  It may seem slightly unbalanced, but you have no Idea how strong his Vanity is.  Anyways, he is saying that his inner demon is frightening and that he feels safe because he doesn't sacrifice clear thinking for greater power.