theclash24,
I usually try to think of the environment for setback dice. It's often fun to mix up the environment so you have variety. This way you can get some extreme conditions.
If your last scene was a mild, sunny day, perhaps your next scene is in a rainstorm. Maybe the next scene's at night. The next scene could be in a sandstorm. The next could be windy. Some or all of these could mean one or two setbacks to most combat or action checks.
For social checks, it can be fun to put your characters in places they're not comfortable. If you have grungy, lowlife PCs, a fancy dinner party, society reception, governmental event, etc, might mean a setback. If your PCs are noble or high society, then dive bars, dangerous cantinas, thieves dens, or wilderness might give them setbacks.
You don't have to always amp it up to 11 but if you can get some variety in, your PCs might remember the epic fight they had on top of that skyscraper when it was raining hard and windy and they had 2 or 3 setback to every check.