I have been enjoying this game a lot but have encountered this bug a few times now. Fortunately it is an easy one to avoid.
If you 'lock' a die onto one of your adventurers after failing the first rolls and then do so again with a different character at the same location (such that you now have two locked dice on two different adventurers), you lose the ability to "toss a die to the void" to allow for another set of rolls. Since you cannot re-roll and there is no option to fail the adventure, there is no way to proceed and you must restart the game.