This type of blockade allows you to steal resources while protecting the blockade. Now if the city were to produce an Army and attack the blockade immediately, when does the supply piece be removed? After the battle is lost to the defender of the blockade or before the battle takes place?

The scout is removed only if the army loses the battle. Otherwise, it stays with whatever remains of the army.