Mill's point is that the higher pleasures do require cultivation and appreciation and education he doesn't dispute that but once having been cultivated and educated people will see not only see the difference between higher lower pleasures but will it actually prefer the higher to the lower. you find this famous passage from John Stuart Mill- it is better to be a human being dissatisfied then a pig satisfied.