This phase II trial studies how long it takes colorectal cancer resistant to standard treatment to grow while receiving treatment with ziv-aflibercept, and how well adding fluorouracil and leucovorin calcium to ziv-aflibercept works in treating patients with stage IV colorectal cancer after they progress on ziv-aflibercept alone. Ziv-aflibercept may stop the growth of colorectal cancer by blocking the formation of tumor blood vessels. Fluorouracil and leucovorin calcium are drugs used in chemotherapy. Fluorouracil works to stop the growth of tumors cells by preventing the cells from growing and dividing. Leucovorin calcium helps fluorouracil work better. Adding fluorouracil and leucovorin calcium to ziv-aflibercept may be an effective treatment for patients who progress on ziv-aflibercept alone.