Empowering Character-level Text Infilling by Eliminating Sub-Tokens