GPU underclocking itself only in Path of Exile 1 and Path of Exile 2

First off I guarantee it's not a temp issue because I just replaced thermal paste and cleaned the fans, on benchmarks and other video games the GPU operates at full power with no issues. The problem specifically with PoE arose when I mistakenly overclocked the GPU's core clock by +500 instead of the memory clock while PoE was open.

When I did that, the system crashed and I instantly reverted the OC to factory clock speeds. However, it seems like something happened specifically with PoE, when I run the game the GPU behaves as very underclocked, the FPS is much lower than before and the GPU clock speeds on GPU-Z are very low.

Again, I tested it in other games and did a benchmark and everything is fine (https://ibb.co/23ps5x97), this happens only in PoE. I tried uninstalling the drivers in safe mode with DDU and reinstalling them, set PoE to "prefer maximum performance" in control panel, even reset my PC and did a full wipe of the drive and nothing helped. So what could be causing the issue?

My game goes to 30 fps or less since today I turned on the PC, yesterday I was playing normally 80-120 fps, while my gpu is on 100% :/