He later was replaced as a nominee by Michael B. Wallace, but Wallace's nomination was also eventually withdrawn because of Democratic opposition. Only in 2007 was the seat allowed to be filled with Leslie H. Southwick, who was confirmed. Pickering is married to Margaret Ann Pickering, with whom he has three daughters and one son, former U.S. Representative Charles "Chip" Pickering Jr. They have twenty-one grandchildren and two great-grandchildren.