Puberty is a relatively short period - around 3 years. Ephebophile means an attraction to someone who has finished puberty. You're referring to physical maturity, which for many people doesn't end until they're over 30.