What you fear is something every couple struggles with as they get older together.  Don't pursue selfish things that would hurt your husband and children but you still have time to do most of those things you fantasize about - only now you can pick what you want to do with an adult's mind, knowledge and view of the world.  

BTW the father of your first child is liable for child support.