rankle

(of a comment, event, or fact) cause annoyance or resentment that persists.