Dear "not this... " dickhead:
Let knowing you're "not one" be enough. You wouldn't immediately feel compelled to make dramatic proclamations that you're not like the white women/men/whatever being referred to if you weren't one.
If you really weren't one, knowing you're not would be enough.