There are mentions in Rebels of "the Empire came/will come", which suggests that there are many ex republic systems that were not directly under the Empire's control.
What happened? These were neutral systems the Empire tries to pillage, or perhaps ex Separatist systems? Or perhaps non-Republic systems that the Empire has decided to conquer all the way?
Is the Rebellion the only military opposition the Empire is facing? Are there external threats the Empire has to dedicate their forces toward? Or perhaps just weak, unaligned systems ripe for easy conquest?