Problem using Elgato 4k60 Pro in a two PC stream set up

So a little background, I have an Asus 1440p 144hz Gsync monitor, that only had display port out. I want to use the capture card Elgato 4k60 pro to stream PoE. In order to make this work, you have to duplicate your main monitor to the capture card, and one display is 1440p and the other is 1080p.

Now the problem is when I have everything set up and working, and I open PoE (it always opens windowed for w/e reason I can't figure out either) and Alt+Enter to fullscreen. It visually changed my desktop to a weird resolution that makes taskbar+icons four times larger and then takes extra long to open the game. Once in the game, it seems to run fine and the graphics look good, but the mouse is larger then normal, and it moves way faster then if I was just in windowed fullscreen. When I unduplicated my monitor, it goes back to working like normal while in fullscreen.

It seems like something is going on with the main monitor taking the resolution from my second pc or something along those lines. Hoping there is something I can change in the config file that might help this.

TLDR: Duplicating my main display in order to use a capture card with a 2 pc streaming set up, changes the resolution of my desktop when I open the game in fullscreen, resulting in weird mouse interactions.

Thanks in advance for any advice, I am down to try anything at this point.

Here is a highlight from my stream showing what I am seeing. You will notice how the taskbar and icons get real big when I enter and have to take time to go back to native resolution when I come out of the game. Resulting in way longer than normal load times

https://www.twitch.tv/videos/519488618

Bump.