Have you tried standing up for yourself and not being such a people pleaser? (Not trying to be mean, just honest.) Often people like him will lose respect for you if you don't respect yourself. Take some of the power back in your relationship; you should be 50/50 partners. If you're already contemplating divorce, you really have nothing to lose. 

Sit him down, tell him he has to respect you and treat you as an equal partner. He can't bring up issues from 7 years ago if they've been resolved. If he's unhappy with you or the relationship for any reason he needs to TALK WITH YOU about it and not lash out. Ask him what else is going on and then really listen. Tell him what you're feeling and see if you can both try harder to be equal partners and restore affection in your relationship. 

If that conversation goes horribly sideways, then it might not be easy or possible to save your relationship. Also look up Codependency. People pleasing to this level is often a symptom and could help get you tools to improve your own self worth. You deserve better.