Is anyone else with Comcast in SE Michigan lagging only in poe, or is it just me?

I have comcast (25 down, 3 up) and I live outside of Detroit (Ann Arbor), and I lag only in Path of Exile. I can play LoL and CSGO perfectly fine, but in poe my ping is constantly spiking. I logged out just now because my 58 marauder nearly died, too afraid to log back in. It's not my computer, i've run malwarebytes and ccleaner multiple times, and I have a i5 2500k, 560ti and 8 gigs of ram, the game runs smooth enough; just drops connection for about 2 seconds every minute. I also have no router, its just one computer hooked up to the modem, so no other devices could be eating bandwidth. Any suggestions or input is greatly appreciated.