Still not seeing any reasons why you should set aside 6 and not 5 or 4. 6 were all the cultists available at the moment; possibly cultists can be added in further expansions simply because there was space on the punchboard. My suggestion is to ask directly FFG via the Rules Questions option on the site.
The reason to set aside 6 cultists is because the card says "set aside 6 cultists".