Member • Sep 22, 2006
CE Disaster :: We are back !
[FONT="]Murphy said – “If anything can go wrong, it will”[/FONT]
[FONT="]CE was down for almost 45 hours*. But we are back! Let me tell you the story of the CE Disaster –
[/FONT] [FONT="]Date: September 20th, 2006.[/FONT]
[FONT="]Place: CE Forums, Backend.[/FONT]
[FONT="]Person Responsible for the disaster: The Administrator, a.k.a “The_Big_K”[/FONT]
[FONT="]How Things Went Wrong –[/FONT]
[FONT="]Time: 11:15 pm (September 20th) : The Administrator tries to perform test upgrade on the forum system. Having skipped sleep for almost 30 hours, he is trying his best to keep his eyes open. The upgrade is critical and therefore cannot be procrastinated.[/FONT]
[FONT="]Time: 11:30 pm : The Administrator enters incorrect database information & continues with the test upgrade.[/FONT]
[FONT="]Time: 11:40 pm : The CE Database crashes. CE portal goes down. Administrator is still logged in. He is no more sleepy.[/FONT]
[FONT="]Time: 11:45 pm : Administrator understands the problem. Shuts down the forums and the portal. Enters a witty message on the main page to cover up the mess. Takes four important decisions. Goes to sleep.[/FONT]
[FONT="]Withing next 30 hours, the forums are reworked on. Backups are restored. Look of the forum is changed. New features are introduced.[/FONT]
[FONT="]Losses:[/FONT]
[FONT="]The database crash led to –[/FONT]
- [FONT="]Loss of latest 20 registrations.[/FONT]
- [FONT="]Deletion of around 7 posts. [/FONT]
- [FONT="]The CE portal downtime of 45 hours*[/FONT]
[FONT="]Hope you continue to enjoy CrazyEngineers![/FONT]
[FONT="]-The Big K-
[/FONT] [FONT="]p.s: [/FONT][FONT="]“45 hours” looks far less than “Almost 2 days” 😁 [/FONT]