FPS drop in affliction especially with DX12/Vulkan

Does anyone have similar problems to me?

So it used to be that dx11/dx12/vulkan had similar performance in earlier leagues, this league i cant get above 40fps in dx12/vulkan and my fps in general (dx11) has tanked. I can play campaign and light mapping at "playable" fps 50ish, but any juicing brings it down to <20 and its so chunky i can barely move.

I've since uninstalled steam version and installed stand alone, cleaned all my drivers and removed geforce experience and tried installing older drivers (31.0.15.3623) and MSi afterburner. I dont overclock usually but ive tried now to get some better juice and it does literally nothing fps wise.
I have tried changing cpu affinity to avoid cpu-0, Tried unparking cores, tried changing priority for poe, nothing i do has any impact.
Only thing thats happened is that now i got problems watching youtube at the same time even :D

MSi 2080TI 12gb, i9-9900, DDR4 32gb dc @1600mhz, game is installed on on-board SSD.

Got no problems in any other game it runs smooth as butter.

im running on dx11 no problems 170fps. if i change to dx12 or vulcan it runs at 50fps. nothing helps but recently i deleted all shader cache folders and files and cleaned with pc cleaner and it can run on dx12 and vulcan at 170fps too. the only problem is when i switch my pc off and later on i have same problem and need to delete shader cache and restart pc again then i can play with dx12/vulcan at 170fps again 😀