2012-03-30 19:56 NZDT Unexpected downtime Incident Report

This error was caused by a simple syntax mistake in the realm configuration file. In order to rectify the mistake we had to fix the configuration file and manually transfer it to all of the machines in our realm.

All binaries and assets of a Path of Exile release are tested by our automated test system. This normally prevents this kind of basic error from occurring. However, the primary difference between the online realm and our test harness is this very configuration file. Thus we did not have a test to cover this.

We are sorry for the incident and will be taking steps to make sure it doesn't happen in the future.

In order to stop this kind of mistake we will be adding an automated test to verify that the realm configuration file is able to load correctly and has some basic correctness properties during the build process.