After completing high school in Bingöl in 1983, Yılmaz graduated from the Middle East Technical University's Faculty of Economics and Administrative Sciences, Department of Public Administration with honors in 1988. In 1989, he started working at the State Planning Organization (Turkish: Devlet Planlama Teşkilatı).