If you don't qualify for the State or IRS Offer In Compromise program, a Payment Plan may be the way to resolve your problem. Setting up a payment plan with the IRS or your State gives you a little more time to pay off your tax debts.
Unfortunately, penalties and interest will continue to be charged on your outstanding balance as you pay the debt off. You are required by law to pay the interest on your tax debt.