What do these lyrics meannnnn?

That even though the person regretted saying something because another person was hurt/offended by it, it was the right thing to do for him/herself.