Spectre not summoning Bug

So me and 4 friends are all playing spectre an noticed some outcomes of the amount of spectres we have are not summoning anymore.

Scenario 1: You die in a map. All skeletons etc respawn. Spectres for example vall guard are on 5 - but 0 spawn, even after minutes. If you set count to zero, then back to 5 they spawn. Sometimes this does not work and you have to unequip gem and re-equip it to make it work again. A Third outcome is you can click above 5 (but you dont have enough spirit) and can add the value u had and they will summon, for example u have 5, can click "+" until 10, and 5 spawn.
If you then get to another area, you spawn (depends on your spirit) for example 10 vaal guards, but the skeletons doesn't spawn, because you dont have enough spirit. That really sucks because it happens quite often.

Scenario 2: If you weapon swap the same happens with all three outcomes.

This sometimes really kills you playstyle with minions, cause you cant reequip everything infight.