Multiplayer Delving bugged?

my friend and I noticed that we get separated very frequently when continuing to the next location.
basically the owner of the dung chooses the next location and gets teleportet away leaving the other behind without a portal or anythign to follow up.

is this normal behavior? Are we missing something?