Swapping Skill Gems Out

I think its a good idea that you can swap a skill gem and it brings all the support gems out, but it would be nice if you can ctrl click a new skill gem into the same slot and the supports dont move with it, that way you can quickly see in game the dps difference between the two spells/attacks.