Think of how it was pulled off in Jedi Outcast.
Force Speed isn't just running super fast. It's an incredible time dilation for the user as well. Yes, they are moving faster, but everything else around them is much slower and that means that they have to alter their perception of time's flow by messing with their mental state. In addition to moving very fast.
That's exhausting.

