The quest map UI in act 2/3 is cool in concept but needlessly confusing

I've been through act 2 about 7 times now on different characters, and I'm still confused by the UI of the map with the caravan moving all over. It's not helped by the fact that sometimes the locations are inverted left/right.

Same goes for the past/present versions of act 3. It reminds me of the last epoch time travel system which was weird and unintuitive.

Also, why a separate UI for underground areas when there are so few? Just add these to the world map!

I found the caravan travel system confusing at first but started to get comfortable with it in Cruel. I do think a better visual of where the caravan is on the map screen would be helpful, like an icon that looks like the caravan. Right now it takes me a bit to find it when I come back to Act 2 and just need to get to a town.