I'm certainly not disagreeing with you, I have limited WFB and no Xwing experience besides watching a few games on youtube, all I know is that I've started to get that feeling lately. Just the same feeling I'd get in a Risk game where you have a pile of 25 soldiers and dice fail you and you can't manage to conquer those 5 territories you need with one defending soldier each and subsequently lose the game. You do have more control than in WFB on your actions without all these morale and charge and whatnot tests, but on the other hand it seems the maneuvers are quite as simple in both games, be it getting in range with arcs, redirecting a deathstar pack to charge its side, etc.
Guaranteed damage is what you want. Of course, you can also get that with maneuvering, rams using engine techs are quite effective too, enough to have entire lists built around it and threatening to quite a few fleets, and they rely on skills more than luck.
And you're right, it's all about prior games experience. Incidentally, the last two I played made me change my mind and question my wave 2 preorder, because they were heavily tipped on either side of the luck scale. So my take on the topic is that poor deployment can certainly lose you a game, proper orders, activating and maneuvering correctly will certainly work towards achieving victory, but dice are still the biggest deciding factor.