The primary objective of the Phase I portion of this study is to evaluate the safety of a combination of capecitabine and proton therapy for patients with locally advanced or recurrent rectal cancer. The maximum tolerated dose (MTD) will be determined in the Phase I portion of this trial.