PURPOSE: This phase I trial is studying the side effects and best dose of irinotecan when given together with cetuximab and radiation therapy in treating patients who are undergoing surgery for stage III or stage IV rectal cancer.