Robert James Fischer was born in Chicago, Illinois. His mother, Regina Wender, was a naturalized American citizen of Jewish Polish ancestry who was born in Switzerland, raised in St. Louis, Missouri, and later became a teacher, registered nurse, and physician.
Son père, Gerhardt Fischer, biophysicien allemand, divorça de sa mère Regina, américaine, en 1945.