Trial of Chaos: after leaving town, you cant enter back

In Trial of Chaos, you can open portal to enter town. But leaving town won't let you go back: waypoint exist only on town future, but ur potral in town present. And because Gateway is closed, you cant enter back.
Solution: add a waypoint to the town past or turn on the gateway