This phase II trial is studying how well AZD0530 works in treating patients with previously treated metastatic colon cancer or rectal cancer. AZD0530 may stop the growth of tumor cells by blocking blood flow to the tumor and by blocking some of the enzymes needed for cell growth.