Just an idea.
Unless you're lucky enough to get some object / follower that adds to the number of items you carry, the 4-item limit is very restrictive.
And let's face it - other than needing a Talisman to win the game (usually), the Talisman itself is rather useless.
What's the thought of reclassing the Talisman as a trinket, and allowing characters to keep 4 other objects?