i would see an ent (an ear nose and throat) specialist for consultation on possible tonsil removal. oral rinses may help but it sounds like an ent issue.
i have tonsil stones. i've dislodged them but they come back after a week or so. any tips on how to prevent them?