The goal of this clinical research study is to find the highest tolerable dose of ipilimumab and stereotactic body radiation therapy (SBRT). The safety and effectiveness of these treatments given consecutively will also be studied.