Admiral's Arrogance '+X to all level of melee skill gems' not adding gem levels

Currently wearing the gloves. Both gem level on skill gem and dps tooltip aren't updating. I need to re-slot the skill gem to update it or change zone. This does not happen with something like replica dragonfang +3 shield crush. This also applies vice versa where +3 to gem level stays if you remove the gloves without re-slotting the gem. I'm not sure if this is just a UI bug or if the gem really isn't getting updated.