I have never had a problem when the Mi-Go spawn, if you keep an investigator in London you can fill the board with clues and not be as hard pressed.
With 2 investigators it's hard to keep anyone in one place.
I guess I could try with 4, we're getting more comfortable with the rules and gameplay so each of us running 2 investigators could work.