I agree fully that astropaths, and maybe other non-sacrifices are brought in close proximity to the Emperor. It's more a question of what constitutes close proximity to an entity whose soul is visible to something like 7/8ths of the galaxy.
In my own personal version of the Imperium things like the Black Ships taking a century to complete their routes is mitigated by having numerous Black Ships having over lapping routes. A Hive world is probably visited every year or so, where as a backwater colony with barely ten thousand people may only see them once a century. Same with things like having only a handful of Forge Worlds provide most of the high tech things, any world with a reasonable AdMech presence will be producing high tech gear, just nowhere near the same output or some of the more esoteric things like Titans, or land raiders or the like.