I plan on buying the core set for my girlfriend and I to play casually. My question is this: Can we play just using one core set?

Playing casually, it's perfectly possible. That's how I and my wife usually play.

quick question quick answer "yes"

really of course you can no probs, but you will benefit later on with some ap paks