Can't interact with ground objects or portal halfway through maps

I've had this happen several times in the last few days.

Behavior
-Mid way through the map I stop being able to pick up items. normally when hovering an item it will display (A) and if I press A it picks it up.

I stop being shown the (A) and can't portal out.

Workaround
-If I make a portal then go back to character selection screen then return to the map I can again pick up items/interact with objects ie: portal

Since it's works on a reconnect I don't think it's an issue with my controller at all. I also can select things in the game menu when it happens, I just can't interact with objects.

In 3 days this has probably occurred 6-7 times.