Some people are allergic to the spermicide used in the sponge. Women who use contraceptive sponges have an increased risk of yeast infection and urinary tract infection. Improper use, such as leaving the sponge in too long, can result in toxic shock syndrome.