This phase I trial studies the side effects and best dose of sorafenib tosylate when given together with bevacizumab, irinotecan hydrochloride, leucovorin calcium, and fluorouracil in treating patients with colorectal cancer that has spread to other parts of the body. Drugs used in chemotherapy, such as irinotecan hydrochloride, leucovorin calcium, and fluorouracil, work in different ways to stop the growth of tumor cells, either by killing the cells, by stopping them from dividing, or by stopping them from spreading. Sorafenib tosylate may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth. Monoclonal antibodies, such as bevacizumab, may interfere with the ability of tumor cells to grow and spread. Sorafenib tosylate and bevacizumab may also block tumor growth in different ways by targeting certain cells. Giving sorafenib tosylate and bevacizumab together with combination chemotherapy may be a better treatment for colorectal cancer.