Minimap progress disappearing after vagan's mission

Here is a picture of what I mean "https://imgur.com/a/TCEnU"

So, I cleared most of the map (shown with the 48 creature remaining), and after going through vagan's mission inside the "Slaver's pit", the minimap's progress vanished from my Relic Chambers map.