After thinking about this, and after some deep thought and stressful thinking, I have come a conclusion! Additionally, sorry if the way I formatted my answer is incorrect; this is my first time on this site.
All that aside, I would have to say the answer to this is
The word "Hate"
"Some call me royalty, but I say they're wrong."
Some monarchs and leaders have been criticized for complaining and hating those who don't help them
"Some call me crazy, but I say they're wrong."
People who hate very aggressively are looked as crazy by society
"Some call me a ghost, but I say they're wrong."
Some people believe that hatred does not exist because they have not encountered it (e.g. little children)
"Some call me racist, but I say they're wrong."
Racism is often the product of hatred
"Some call me a hat, but I say they're wrong."
Perhaps some people might mispronounce the word as hate
Hint:
"Hate" is indeed, a word.