When your being attacked by another character, are you limited to casting just one spell because its not your turn?

Yes that is correct. This includes casting Spells from other sources as well, such as the Genie or Spellstone. Only 1 Spell during another characters turn!

Ell.