Sorry buddy, you don’t get to choose what labels get put on you. If you act in a way that is bigoted, you ARE a bigot. It doesn’t matter if you don’t self identify that way.
As a middle-aged white male, I can tell you that if someone labelled me with one of those terms, my first thought would be “what did I do to make them think that, and what can I do to fix the issue”. Maybe it was a misunderstanding that I need to clear up, or maybe I actually did something without thinking about it, and I need to pay more attention to my actions.