If you think about it, there are a number of characters in the game that can become rather powerful, or even unstoppable, given a specific set of circumstances with cards and spaces.
Though your suggestion seems reasonable, it could also cause another loop if the deck was down to 2 cards or so and you understood what they were.
Either way, Talisman is always open to interpretation and thrives on the various house rules used by groups, so if it works for you then great!