Kim was born in Dongnae, now part of modern-day Busan. Orphaned at an early age, Kim studied with American missionary H.G. Underwood starting from the age of 6, taking the Christian name "Johann." He later traveled to the United States, receiving a bachelor's degree from Roanoke College in 1903 and a master's degree in English literature from Princeton University the following year.