Spamming X on strongbox opens it instead of upgrading

When I upgrade strongboxes with orbs, I can use X, after holding it (without going into the inventory).
But if I do it too quickly, strongbox opens right after the first upgrade.
Please make it so we can spam X quickly — so that the strongbox doesn’t open until we get out of this menu.