Slotting/unslotting support gems into wand procs my silver charm

I don't know why this happens...but everytime i swap a gem from my wand skill my silver charm procs ..wasting its charges. ...idk why this happens


edit: clarification- unslotting zenith 1 or rapid casting 2 from chaos bolt will proc my silver charm . i assume this is not supposed to happen.