POE 2 lagging and drops in performance

While I play the game in and out of combat in the camps and even when I stand still I consistently experience drops in performance causing the game to stutter or stop for 10 seconds or so, then proceed to catch up and random times but its happened every play session I have without fail making it very difficult to stay alive against bosses and mobs that swarm you. I've also reduced the graphics to the lowest settings and tried various other methods to no effect. There are also times where I input a command through my controller which is connected to the pc via usb cable and my character would act out the command a couple seconds later.

CPU: intel (20) core i7 processor
GPU: NVidia GeForce rtx 4080 super
RAM: 32gb corsair vengeance


https://drive.google.com/file/d/1wPSKoAxnMMZLsEZDHtm3jxNpjCGr1hyJ/view?usp=sharing

https://drive.google.com/file/d/1wdIiqdAS8G13h03l8mS4p0Ol9vG5lPRe/view?usp=sharing

This is happening to myself and my friend to on the AUS server.

Its definitely game related as both he and myself experience the same slowing down and speed up at the same time.

That's definitely annoying that it's happening to others as well. I understand that it's an early access game but me personally this hasn't happened before on other early access games I've played, but hopefully this sort of thing catches the eye of a developer and they fix similar issues like this.

This is happening to a lot of people I play with, along with intermittent freezing of the whole system which locks the PC up, though this last one is only ever on scene load. Usually requires a hard reboot.

Ive tried so many things to fix this now ive lost track. But at lvl 92 ive pretty much given up on mapping cause I cant get ahead without dieing to these random stutters

At the beginning of early access I didn't have this problem when I played the campaign. Now when I play on the maps it started. It lags the entire PC, including the browser and Windows. You need to exit the game and wait a few minutes or restart the PC. I've tried everything, returning to the old Nvidia driver or increasing the GPU shadow cache to 100GB (some forums recommended this). Nothing works. Sometimes the game runs for more than 1 hour before the problem occurs, and sometimes less than 10 minutes, so I believe it's something random related to the connection to their server. It became impossible to continue playing, especially if it occurs during a boss that took weeks to have the opportunity to face.