RETREATMENT PHASE: Patients with disease response or stability after the initial treatment phase will receive pembrolizumab IV over 30 minutes on day 1. Treatment repeats every 3 weeks for an additional 4 courses in the absence of disease progression or unacceptable toxicity. Patients continue to receive standard of care enzalutamide PO daily for the duration of the trial.