The late payment penalty is usually 0.5% (per month) of the unpaid tax, up to a maximum of 25%. For example, if you have $2,000 of unpaid taxes, the IRS will likely charge you $10 per month as a late payment penalty. Read more about penalties and interest.