Long Loading Times - Related to Packet Loss?

So I've been playing this game for several years now, and my setup has been the same throughout the years, including my ISP and my deal with them. This league in particular, like many other people, I'm having extremely long loading times. High latency in the EU servers was also a big problem, but nowadays I only randomly get an unstable instance. Annoying, but worst case scenario a map is lost.

I have the info graphs up the entire time I play to see if anything is wrong. One thing I noticed is that in the majority of the time I'm waiting to load in to an instance, the ping is 0, then the connection is done(and my character loads into the instance), then it only takes up to 5-10 seconds to actually load into the instance based on how many MTX that needs to be loaded.

So that led me to look into connection issues. I used WinMTR to check for packet losses, and found some interesting results:

Host as "au.login.pathofexile.com": https://pastebin.com/26AdMKNQ
Host as "138.201.24.37", the last instance I connected to in Frankfurt servers: https://pastebin.com/jYDsdpRP
Bonus: the client notepad https://imgur.com/a/PqpJgUM , it says connect time was 32ms but it really did take more than a minute to load into Oriath Docks. Vast majority of it was also 0 ping.

Bonus 2: Host as "google.com": https://pastebin.com/eeVQimaB

My current specs are Intel i5-6600K, Nvidia 1050TI, 16 GB ram, and the game is installed in my SSD.

So all in all, I really am at a loss. I really want to keep playing this league but this is getting very annoying to deal with in every zone. I could really use some assistance on how to proceed to solve this problem.

Edit1: https://imgur.com/a/lamdFaS here is my in-game settings, if it's relevant.

Edit2: After posting this, ran 2 maps and a syndicate hideout with 0 issues. Got into a voidborn reliquary, and my latency went up to 120k. Didn't crash, internet elsewhere works perfectly fine. Ran WinMTR on the instance IP, here's the result: https://pastebin.com/b6XHBQGh