Schwarz was born in Günzburg, the seventh of eight children born to a master baker and his wife. He was educated up to a high school level at the Günzburger vocational training school. Schwarz married Berta Breher on 26 August 1899.