I love the tat, though I must agree the x-wing is a little off. Im a space craft nut so I will admit that Im more picky than most and doubt most people would notice.
As for getting an imperial logo I can't see how anyone could have a problem with it.
It's FICTION
Fiction is a form of art. The meaning of art is to evoke emotion. The actions of The Empire evoke emotions and reactions such as being repulsed, abhorred. What they'd done in their history resonates with us and recalls WWII imagery as George Lucas intended.
Some of us are more sensitive to this concept to others. These people, such as myself, are hit harder by fiction, as they make us feel something.
So for people like us, to wear The Imperial Insignia is to say, "I am not only a xenophobe, but will absolutely willingly serve a power greater than I with no question, no matter what they ask me to do, even if that is burning a village."
Some of us do not want to be associated with the visage of totalitarianism and genocide.
That is why some of us, opt to not wear the insignia.
Try getting acquainted with American history, you might be surprised to find it's not such a glorious tale.