So what happens to the tokens surrounding a city that I conquer? Do I remove them, do the remain or do I replace them with my own?

Thanks

They stay there.

The only thing that the rule book says when you conquer a rival city (non-capital) is that you replace that city with one of your own.