Latency fluctuation in Path of exile 2.

So my google ping is constantly 70 ms, i play POE 2 at 50 ms constantly from the release day till a couple of days ago. So now every once a while especially at night it's literally unplayable, latency would spike from 10 ms to 2000+ ms in seconds nonstop. I don't have problem with my internet connection and im using Ethernet for my internet and i never have any latency issue playing other online games. How to fix this issue?