I'm unable to press loot button on controller after clearing monsters in a map (ABYSS)

I can't pickup item with the controller after I clear monsters in waystones map.
The collect button prompt disappears after I've moved toward the waystone. I have to go back to character selection screen and reload the map to fix it.