Jun 29, 2010
By some accounts, the Amazon crash that began somewhen around 1600 EST5EDT today is the first downtime they've evidenced in years. On one hand I can't help but chuckle a little bit when I see this because, for once this isn't my fault. I can just sit back and fiddle while somebody else's network burns. On the other hand I've been on the other side of the screen when stuff like this happens and the thought of getting trapped in the data center trying to resuscitate the service of one of my old employers jolts me awake dripping with sweat in the middle of the night. I've kept Lyssa awake all night because "shit done blown up real good" at work and I was on the front lines of the restoration effort (and receiving new orifices in tender parts of my body from my boss the next morning, let me tell you). You can never really run a perfect service; things will always fail and backhoes unerringly find fibre optic trunks.
Keep an eye on #amazonfail for up-to-the-second updates.
As of 1912 EST5EDT I think Amazon's back on its feet. Good work, fellow BOFHes. May your dressing down be mercifully short, may you keep your jobs, and may it be beer o'clock soon.
Actually, even better. May it not have been anything within your collective sphere of influence.