the same way you make mashed potatoes for anyone (minus the big lumps of course). instant mashed potatoes are just fine. and easier. don't over salt. over season. if you want to use real potatoes cook them well and mash or food-process them to get out any lumps that may be problematic (i don't know your baby's age).
how to make mashed potatoes for baby