People who cheat often keep their 'partner' still around as they offer stability. I would imagine he's just so used to you being around that it came to him as a shock how big of a void it caused in his everyday life.

Don't take him back. He doesn't miss you, he misses that stability. He will just continue cheating on you.