We have modified the webserver configurations to: 1. prevent situations which lead to creating dysfunctional processes, 2. if it does not work, each such emergency situation is now detected automatically and fixed so that no escalation takes place, thus the server is auto-healing.

With Wikidot growing, we often meet new frontiers and new problems. Most of them we fix or adjust to without any service interruption, but some (as this one that results from a bug in software we are using) manifests in a very nasty way. Fortunately we have a really bright team here that can quickly diagnose, react to problems and most importantly prevent problems from occurring in the first place.

So I hope we have this one closed. Thanks for all the friendly support emails from you, Twitter posts and comments we have received! We are really happy to provide Wikidot services and we are devoted to it, and also are glad that our efforts are recognized!

EDIT: we are looking at some future-proof improvements to our infrastructure, I put more notes on my blog.

first of all, we do have "dynamic IP addresses" which we can assign to different servers when needed. In case one front-end server dies, we can easily assign the IP to another server and either serve a read-only content from Wikidot, or make a backup server display a message.

This time however we had a problem with it — I am not sure how this works (Piotr is much better at this) but the router in the datacenter did not want to route traffic properly. Perhaps we were doing something wrong, but it did work several times before that. This is why we got the message a bit later, and for a while no servers could be reached at all.

There was also a suggestion to set up an external site that would report status of Wikidot.com, which is also a good idea.

Question: would it help to set up a "short notice" on one of the "reachable" google.groups ( our "temporary wikidot dev-list" ?)

This link is readable for non-signed in visitors too: http://groups.google.com/group/wikidot?hl=en

at this link I asked why (and if !) wikidot is not reachable - could be my provider has lost some DNS . . , my router is damaged …, my browser has problems.. ,

(I for my own tried first www.openDNS,com to check if my provider has problems)

I got the info from piotr ( by mail) - the team is working on a strange failure.. that helped realy!

I finished my experiments to reach wikidot - and made a pause…

We were positing status updates in real-time.

Sorry about any inconvenience. We know people rely on Wikidot for many of their activities (we got a lot of phone-calls too), this is why we always try to prevent such incidents and fix them as soon as possible. Thanks for your understanding!

Best regards,
The Wikidot Team