So I'm including the plot card "Retribution" in my deck with elite Bo Katan (20 points), and was wondering if the ability is a one time use or if you get to deal damage every time your dice are removed

It continues to work, given that you don’t set it aside or remove it, or even exhaust it.

But it’s a villain plot, so you can’t use it with Bo Katan.