PoE2 Temporal mobs kill my Voltaic Grenade cooldown

EVERY. SINGLE. TIME. I run into one of these temporal bubble enemies, my voltaic grenade either completely stops (stuck at 0) or the cooldown slows down to a snails pace. Recovering one grenade can take as long as a full minute. This effect persists after the enemy has been defeated.

In the case of a fully stopped cooldown, removing the skill gem and resocketing seems to solve it. In the case of a slowed recovery there doesn't seem to be any solution aside from waiting for agonizingly slowed down cooldown to give my one grenade back, after which the second grenade recovers with the normal cooldown time.