Honestly, you should never accept being unhappy as long as he is being happy. That’s not a relationship.  Not a good one anyway. 

If you truly want to be with him, talk with him about it. If he doesn’t respond favorably, then you need to move on and find someone that is as into you as you are to them. 

There needs to be compromise in a relationship...but it sounds like you’re sacrificing your own emotional well-being trying to get any kind of affection out of him.