Severe Latency Issues

Been playing PoE again since season 1. When I started to play again a few weeks ago, I had no latency issues.

Now this is what my latency looks like:
http://i62.tinypic.com/316rjat.png

What gives? It isn't always like that. I usually have a nice consistent 130ms latency to your server(America). But then this garbage happens.

There is NOTHING else using the internet. I run Performance Monitor and literally PoE and Steam are all that is using the internet. PoE clocks in at like Total 400/B sec and Steam is half that. There should be no reason for my latency to keep surging as if I am getting power fluctuations in my flux capacitor.

Again, when everything works as it should, I get 130ms for a few hours straight then this garbage happens.

Ideas? The latency wouldn't really bother me if it was consistent, say like 300ms consistent for an hour. But it just jumps all over and makes the game unplayable.

It just happened again. 10 minutes of 130ms then suddenly, my latency is making a silhouette of mountains and canyons in the F1 stats viewer.

This is ridiculous.