If you play with the Tides Of Battle cards, do you have to draw a card when attacking a neutral garrison and also draw one for the garrison against you? The rules only say you have to draw these cards after you draw your house card in a battle against someone else… How is it correct?

Following the rules you do not use Tides of Battle cards when attacking neutral forces.