 Ten years later on 1923, the college was closed for the new Sultan Idris Training College in Tanjung Malim.Subsequently, the residence was turned into a primary school, Sekolah Rendah Kebangsaan Matang.During the Japanese occupation in 1941, the Japanese Imperial Army made the fort its headquarters and war strategic operations centre.