However, due to his penchant for marrying commoners, including several popular actresses and singers, he was less popular with other Malay rulers and they declined five times to choose him as Yang di-Pertuan Agong of Malaysia.