In the modules such as the Beginner box or Long Arm of the Hutt, I see a lot of mentions of what happens on a Despair, but it seems to me that challenge dice are pretty rare to begin with.
Two examples: The first is an old bridge that is difficult to walk on and a Despair on any check means someone falls. The second is a Despair on an astrogation or piloting check causing the ship to hit something big. In both cases, the default pool for characters would not have any challenge dice in them at all, this no chance for despair.
As far as I can tell, the most frequent way to get challenge dice are on opposed checks, or when the GM uses a dark side destiny point to upgrade a difficulty die. In the cases above, none of them seem to warrant a challenge die. We had a big shootout on the bridges and there still weren't any opposed rolls. I also didn't use dark side destiny points to upgrade player difficulty. (perhaps I was being too nice?)
Am I missing a crucial piece of the puzzle here? It looks like something super difficult either has an increased number of difficulty dice or setback dice, but no challenge dice. How do you introduce challenge die outside of opposed rolls or destiny points?
How often do you encounter Despair?