If he is actually able to do this, he doesn’t have to stop at recess appointments. Many dictatorships start with the dissolving of parliament/congress. He could have a permanent recess and rule as an unchecked dictator.