Question about Forsaken Lords Exp

I know if I dismiss a Forsaken lord from my hideout, I lose all the experience I have for the current level with him.

Question is, If I get a new type of hideout, bigger and better, and the current one is dismantled, ¿What happens to the acumulated experience with the Forsaken Lords I had in the previous hideout? ¿It's lost as well, same as If I dismissed these Forsaken Lords I had?

if you change your hideout, all masters are kept with their xp, also by upgrading it, only way to lose xp is dismissing