Happens on reddit anyway. Even though people can’t see who downvoted them, they guess. Or someone (or a brigade) mass downvotes not because you downvoted their comment but just because they disagree with or resent your comments. Reddit avoided this by ignoring repeated downvotes from one person and on profile pages.
Personally, if there’s someone who is really abrasive or I just really disagree with and find their posts agitating or distracting, I just block them and that avoids the problem for both of us.