That's correct!  You don't even get a penalty, though obviously he'll be hit if you use an area attack.  If the monster didn't have the Improved Grab advantage, he'd actually only have half active defenses against the attack.