What happens if someone says you lack empathy or compassion? Does it change the fact that you have empathy and compassion for others?
What happens if people tell you that you're being antisocial by not allowing someone you don't know to call you a friend? Does it mean that you've become antisocial?
What happens when a bully calls you mean? Does that mean you've become one of them?
It changes nothing about you when someone says something about you. The only thing that can change anything about you...
.. IS you.
Don't buy into what other people say. Know who you are and stick to that knowledge. Knowing who you are when others don't, not letting them change you to suit their own needs; that is true power in this world.