Frame Spikes when opening ui element/npc chat

I've been getting very spiky fps when opening ui elements, talking to npcs. It seems like the shader bar of the diagnostic also goes full as this happens. I've tried dx12, and vulcan and it occurs for both. I've also tried allocating more shader cache memory in nvidia control panel

https://imgur.com/a/o3wQuSs
Every spike is from opening an NPC dialogue.


Has anyone else experienced similar or has a possible solution?

System Specs Ryzen 7 5800x, 3070 RTX, 32G Ram