Barsky married three times. First, as Albrecht Dittrich, he married Gerlinde, with whom he had a son, Matthias Dittrich, born in 1981. While living as Jack Barsky, he married Penelope, an immigrant from Guyana, when she became pregnant in 1986. They had a daughter, Chelsea, born 1987, followed by a son, Jessie. Matthias, a pharmacist, came to the United States to visit in 2005. When his daughter (who now goes by Chelsea Dittrich) was 27, she traveled to Germany to meet her half-brother. He became a Christian after meeting his third wife, Shawna, a devout Christian from Jamaica. For many years, she thought the story he had confided in her about once being a spy was a fantasy. He now has a good relationship with his eldest son, Matthias, and through him has a granddaughter, Marlena. Barsky lived in Schaghticoke, New York until 2016. He now resides near Atlanta, Georgia, with Shawna, and their daughter, Trinity, born in 2010. The FBI agent who lived next door and interrogated him after his detainment became a close friend and godfather to Trinity.