Red jewels not working on weapon swap without shield on off-hand

I have a two-handed mace and shield on my main hand and dual wielding two-handed maces on my weapon swap. I Currently have jewel slots allocated with the global allocation. From the global allocation I have my weapon swap skills allocated. Currently no matter whether its weapon swap 1 or 2, if I don't have a shield in my offhand, my maximum fire resistance from my globally allocated red jewel slots are not applying.

This happened while receiving maximum fire resistance from a nearby infernalist while respecing.

Just to clarify, my maximum resistances for ice and lighting work just fine on my other jewels. So unfortunately i must use a shield or lose all my max fire resistance. Wondering if anyone else has had this issue.