@billothekid2 honestly, it's not an uncommon phenomenon, it has nothing to do with seeing your downvotes.
Over the years on reddit, where votes are anonymous, I would sometimes notice all my comments being downvoted (usually after some kind of altercation, my favourite was the guy who singled me out for criticizing Margaret Thatcher... hardly a hot take).
In fact iirc reddit had to change its interface so that voting on comments from a person's profile page doesn't change their comment count.
Some people are just petty. I think it's better to at least know when it's happening so I can avoid that person.