For Hikari, my reasoning is that she spent a good deal of time learning how to focus inward despite really wanting to be a great duelist. She struggles to reconcile the expectations of her family, mentor, and lord with her own goals. So she's not as skilled with the blade to start as she could probably be, because she's spent so much time focusing inward and also just being physically buff.