Can he still use elusiveness even if he has a stress token.

Nope. His ability allows you to ignore the general rule that you cannot take Actions while stressed, but doesn't cancel out the requirement on Elusiveness itself that you cannot use it while stressed.