Sometimes. I think it shows the person has enough empathy to realize what they're saying could be hurtful. I see it as making a point which isn't meant to be taken personally (and a signal the person is willing to engage in a discussion, not an argument).

That said, it doesn't really apply for statements like "I don't mean to be rude, but you're an <ethnic slur>".