You might want to phrase the request in a way that explains why you want to share. Without explanation, the request may imply that you want to use their dice because you somehow believe that they have manipulated their dice to gain an unfair advantage. In other words, they may interpret it as you calling them a cheater, whether you intended it or not.
Personally I would rather not share a single set of anything just because the X-wing play space is pretty big (and the tables at game stores are often even bigger) which makes passing things across the table kind of a pain