Tax Formula. Here's a quick way to find out if you must pay taxes on your Social Security benefits: Add one-half of your Social Security to all your other income, including tax-exempt interest. Then compare the total to the base amount for your filing status. If your total is more than the base amount, some of your benefits may be taxable.