Randomized phase III trial to compare the effectiveness of tamoxifen with that of thalidomide in treating women who have recurrent ovarian epithelial cancer, fallopian tube cancer, or primary peritoneal cancer. Estrogen can stimulate the growth of some types of cancer cells. Hormone therapy using tamoxifen may fight cancer by blocking the uptake of estrogen. Thalidomide may stop the growth of cancer by stopping blood flow to the tumor. It is not yet known whether thalidomide is more effective than tamoxifen in treating ovarian epithelial cancer, fallopian tube cancer, or primary peritoneal cancer.