Ok, I think I've read enough... and the question I haven't seen asked yet is where in the Rules As Written does it say that you do not get back the extra XP? and no, a fan podcast is not RAW.
The rules as written state that 'These skills now count as career skills for the character (although he does not gain any free advances in them, as he did with his first specialization) Page 93, 2nd paragraph under Acquiring New Specializations... and that's all I've found in the rules as written.
I happen to agree with Emperor Norton in all aspects expect one... it is not a discount... it is xp earned with blood sweat and tears and should be spendable by the player as they see fit...
If they have earned a total of 193xp over time then they should be able to spend 193xp... it's not game breaking in the slightest and there is ZERO tracking... Oh wait... here is the tracking... I buy a new spec, I look to see if any of the 4 skills are a) already not class skills, and b) have I bought any ranks in them... give 5 xp for every rank in them... problem solved.
It's how I will be running my game... and any of you are welcome to join it.
And once the XP is spent it is spent. That is why the rules don't say that you DO get the XP back for buying into a specialization.