Brine King Pantheon

This is not really a bug, more of an obscure design flaw. I happen to be playing a "cast on stun" Character. I beat the Brine King and Accidently activated the Pantheon associated to him. It seems that it cant be turned off until another Major God is beaten. This has rendered the "cast on Stun" gem practically useless. It would be nice to be able to deactivate the Pantheon.

Thank you,