The portion of your settlement paid for pain and suffering and emotional distress is usually not taxable. The IRS considers such payments reimbursement for your actual injuries. A physical injury can be diagnosed in medical terms, but the pain and suffering associated with that same injury cannot.