Exhaustion goes to one.  Madness does not.  You only acquire Permanent Madness when you Snap.  Snapping requires Madness to Dominate at least four times in a row (assuming you don't have me force you to check off responses for plain ol' ordinary failures as well).