Character does not move to loot item with controller on PC when many items are on screen

When doing breaches, for example, and having a ton of items stack up on screen - you will have items that are far away from you, and if you attempt to loot them with controller, nothing happens.

I have found myself having to go to main menu, switch to KBM, then go back into the map. Clicking the items will then actually move my character over to them and loot the item.