Ping frequently jumping to several thousands on some map instances

Hello,

I've experiencing extreme delay issues in the game on specific map instances jumping up to several thousands milliseconds every other second.
I recreate instances on the same map and sometimes the ping is fine at ~20ms permanently. Both on steam and standalone version of the game.
First assumption was the league mechanic but it happens on map instances without the mechanic too. All renderers show this behaviour.
Sometimes when i teleport back to city from a lagging map instance, the game crashes with
"vk::Queue::submit: ErrorDeviceLost"
and
"Microsoft Visual C++ Runtime Library: Runtime Error!"
Game is unplayable in this state.

CPU: AMD Ryzen 5600
GPU: Nvidia GTX 1060
RAM: 16 GB
Bug report reference: 406967440

Settings:
Windowed Fullscreen
1920x1080
Vulkan/dx11/dx12
VSync Off
Triple-Buffering Disabled
FPS Cap 120/30
Antialiasing Quality Off
Lighting Shadows
Shadow Qualiy Low
Sun shadow Low
Number of Lights Low
Bloom 25%
Depth Of Field Disabled
Water Detail Low
Texture Quality Medium
Texture Filtering Trilinear
Dynamic Culling Disabled
Dynamic Resolution Disabled
Engine Multithreading Enabled