PoE slowing down my computers internet

Every time I play Path of exile my download speed goes from 100->8 and my ping from 6->100+. I have found that releasing/renewing my ipconfig fixes the issue until I start poe again.
I have had isseues with this since I started playing but just recently found out that it was poe and that renewing my ipconfig fixes it temporarily.
Has anyone else had this issue before?

PoE itself doesn't do anything at the network level that could cause the situation you are describing. Heck, without admin permissions, it literally can't do that; Windows will stop it.

So, the most likely candidates for how this comes about are:

PoE uses enough bandwidth that your connection is very busy, and that leads to higher latency as packets wait in buffers for their turn to get to, or from, the ISP. This ... is unlikely, since the connection is fairly low bandwidth.

The second possibility is that your router, or firewall software, or something like that is getting all confused when this happens.

That said, the easy way to work out where it is coming from is to follow this guide: https://pingplotter.com/fix-your-network