Can't Enter Karui Fortress

Killed the entire map got the eye of conquest and when I go to Karui Fortress it just keeps loading till it crashes and says "Failed to load instance". I'm using Infernal Skeletons and other minions. During the load screen I can hear all my Zombies groaning. This is my second character never had a problem with any instances on my first character.