This pilot clinical trial studies cabozantinib in treating men with castration-resistant prostate cancer. Cabozantinib may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth.