This is the exact same thing as the Extra Munition card. If you loose the card, then all the OrdnanceToken mean nothing anymore because they don't have a rule related to them in the game.
And this is why you are actually supposed to put a munition token on the extra munition card as well so that Boba can't make you loose the rest of your tokens in one swipe.