Then there won't be much room for dice mitigation outside of TLs and Focus. There are a handful of cards that will allow re-rolls or changing/adding a die like M9-G8, Accuracy Corrector, TIE /x1 title, that sort of thing.
There's a lot of flavor that comes from crew cards, and not even half the ships can take a crew member, so I wouldn't want to shut them out, personally--but it would be worth trying your way out for the experience.