When it says "the only action you can perform", it just means "while you have stun, your list of available actions is one thing: remove this card".
Standing up when knocked out ends your turn, but Stun doesn't.
If you are Stunned before you start your turn, you'll have 2 actions available. However, your only available action is to remove the stun. So your first action will be to remove it. However, you still have your second action (removing the card doesn't end your turn), and since Stun is no longer on you, your available actions become back to the standard list.
IE, the "only" is referring to your options, its not referring to the number of actions you get on a turn. That's the problem with English sometimes, though But this has been officially clarified in the past.
Edited by sigmazero13