Path of Exile 2 Xbox Series X Graphical Glitch

Am playing Path of Exile 2 on Xbox Series X and am playing with a friend who is on PlayStation 5. As we're playing sometimes I'll get some small graphical glitches like some holes in the ground or gray spots. However, sometimes when I open my inventory and close it either later or quickly, it get worse and the graphical glitches spread, causing the gray areas to appear on character, ground, and structures. Repeating the process of opening and closing either slow or quickly, will make it worse to the point of you not seeing the enemies, aside from health bars, your friends, or anything around you. I was able to see where I was going with the map covering my screen, but other than that, was unable to see enemies or spell effects, or my surroundings without the map covering the screen. It didn't seem to cause the game to crash, but did make it hard to tell where I was without the map. Without the map all I see is a grey screen, with the mission display, friend health bar on the left side of the screen, health and mana pools, tool bar, and the overlay of the map. Everything else where the character, back grouond, enemies, and structures are practically invisible.

Here is an image to show what I see, just in case.