PC Xbox controller "The bloated miller" Lag

I am playing on pc:

Windows 11 24H2
i9 13900k
4070
64gb ram

While using an xbox controller, the game lags bad, like a frame update every 5 seconds while near the bloated miller boss. I changed my input to wasd and m&k and it works fine. It only lags near the boss, it played fine before I reached him. I tried switching from dx12 to vulkan and lowering my resolution, still lags bad.