When a ability says you can change the die result on a die, does it have to be a die that's been activated and in the die pool?

Yes, dice not in the pool aren't in play.