 Following his service in the military, Silva attended San Jose State University, graduating with a bachelor's degree in education in March 1950.At San Jose State, Silva played football and was a running back and linebacker.Silva became first athletic director at San Jose City College and he coached football, basketball, baseball, and track teams during his tenure at the school.