Do I need to buy two cores to have enough neutrals to build 4 decks that can be played at the same time?

Thanks!

Correct. One core comes with enough neutrals for two starter decks which is all of one faction and one set of neutrals.