Vaal Temple League Mechanic - Stuck

I put an armory room in front of Atziri and cannot get rid of it. I did the architect three times but he does not remove that room. Room sacrifice doesn't work on it either. I think Im just stuck not being able to progress at all. HELP