Both Larry Page and Sergey Brin went to public high school and then to public universities for undergrad (University of Michigan and University of Maryland). They went to Stanford for grad, but they still fit your query of not going to private prep schools.