Am I concidered a racist?

I am a hispanic, black, white, and indian 15 year old female. And ppl call me racist cause my greatest grandfather was John C. Breckenridge. (A racist general during civil war and confederate war) I have rebel flags, shirts, my grand dad now is a redneck. And I'm country as hell. But y am I called racist? I can't be. I have black friends.