After his death in 1999, for Rose's support of good design and the spirit of public service, the Rose Architectural Fellowship was created in his honor. In the 1940s, he married Sandra Priest whom he met when she was 19 and a student at Vassar College. She returned in mid-life to school and graduated with a B.A. from Manhattanville College and a M.A. in learning disabilities from The College of New Rochelle; she later taught junior high school students in the South Bronx. They had four children: Deborah Rose; Jonathan F. P. Rose, one of the largest developers of affordable and green housing in New York City; Samuel Priest Rose, a professor at the University of Colorado at Denver prior to his death in 1994; and Adam Raphael Rose, the current co-president (with cousin Amy Rose) of Rose Associates. His nephews and nieces include Gideon Rose (son of his brother Daniel), the editor of "Foreign Affairs" and a member of the Council on Foreign Relations; David S. Rose (also son of Daniel), author of the New York Times best selling books "Angel Investing" and "The Startup Checklist"; and Isabel Rose (daughter of his brother Elihu), author of the 2005 novel The "J.A.P. Chronicles" which she also adapted into an Off Broadway musical. His granddaughter is artist Rachel Rose. His funeral was held at the Westchester Reform Temple in Scarsdale, New York.