I'm probably going to change Yoshino a bit anyway, so yes, you can be the unarmed specialist. Keep in mind, Persona 3's male protagonist (you can be female in the portable version) could wield multiple types, but only one at a time.