CPU Latency randomly spiking to 30+ms makes the game stutter

I'm not really sure what's causing this or how to fix it so here I am. Every now and then while I'm playing my CPU Latency will just spike to 30ms and sit there for a while going 30-35, frame times stay good, gpu latency is fine, normal latency is fine, my FPS drops by about 50% though. Changing zone fixes it, and restarting the client.



PC Stats



If you need any more info let me know.