So, if I am reading this right, people don't like S&V because it feels like those types of characters would band together to fight. Seriously? Never mind that Jabba had a private army or that Cloud City was an independent operation. Planetary governments handle their own security for the most part. Remember that the only reason there were StormTroopers on Tatooine was because there was a Star Destroyer in orbit, they weren't stationed there.
The entire notion of Star Wars is that the only thing black and white is the Force. Instead of thinking of these guys as Pirates why not think of them as criminal gangs that want to take over a star system for their very own, carve out their own empire. Or the forces of a local Star System that see the Rebels as a threat or are mounting their own private rebellion against the Empire and they hired a bunch of mercenaries and thugs to protect themselves. Or a group of bounty hunters that are closing in on a huge score and the "benevolent" alliance is getting in their way.
Basically, HAVE FUN and let your imagination run wild. If you are looking for logic may I remind you that you're playing a game based on a sci-fi movie that came out almost 40 years ago, literally a long long time ago.