High input lag on PC with Controller in all menus / inventory

There is a significant delay/lag when using controller in all game menus (options), character inventory, trading with NPCs, and even on the game login screen. However, during combat and exploration, the controls are perfectly fine and smooth, with no issues. The problem in the menus/inventory manifests as the game not responding to button presses on the controller, executing commands with a delay, or repeating the command multiple times even though the button was pressed only once, and the issue occurs constantly.


I tried 3 different controllers: xbox one, steam controller and flydigi apex 3, wireless and cable - no difference. Game itself runs smooth on multiple different graphic settings, ping is around 40 ms.