Does the President have to hand over the Quorum cards they picked up to the new President?

Yes. The Quorum cards go with the President title card. If another player gains the President title through a Crisis, Saul Tigh, or Administration then they get the Quorum hand held by the previous President.

SJE