I had the opposite problem - I was one of the youngest kids in my grade (turned 18 a few months after graduation), and while I never had any trouble relating on an emotional level, I was always much smaller than everyone else until my sophomore or junior year of HS.