I was thinking of trying to play by not using any starting units. Would this seem fair straight of the bat? Mostly it's not that big of a deal what starting units you start with. The only thing I really think matters are the number of workers you start with.

Concidering each factions victory conditions what do you think would be fair if you played w/o starting units?