Skills assigned to different weapons on mercenary don't function properly

Having a skill assigned to weapon 1, but reloading it on weapon 2, bricks the skill. It doesn't fully "reload", as the crossbow shot doesnt switch to the reloaded ammo. But the skill ammo count has been reloaded and it doesnt let me interact with it.

If i switch the skill back to work with both weapons it lets me use it again, but i can't properly setup a 2 weapon loadout.