What's your opinion on when to perform a Special Assault?

Would you do it early while the fleets are relatively simple and balanced (2nd or 3rd Campaign round) to bank the points for later use or only when you really start losing ships?

Since it doesn't give any campaign points, I'd do it if I was ahead on points but too many of the victories were costly in materiel.