Random players joining party unprompted

Hey! just wanted to report something weird that just happened;

I was playing in a 2 person party with my wife; the game suddenly said that multiple people were invited to the party and two players joined. One immediately left, then multiple others were invited and one more player joined.

I did not see any of these players in the overworld, just shown on party frames. I tried to uninvite the players but the game told me that I was not in the party.

We decided to return to town and log out.

Me and my friend had this happen several times. It seems to be that we are actually forced into their party for whatever reason. Could it be some kind of abuse to be able to access zones others are in?
Once the party is made we cant kick, leave or do anything about the party but to quit and invite each other again. However unless you remake the zone they a may still appear part of your party depending on who invites who or if they add more people to the party.

I was just playing with my wife both on the Amsterdam server. When we teleported to town i ended up in an infinite loading screen and my wife ended up in town with two extra party members. Next to that it was on the Frankfurt server. :D