Thursday, April 1, 2010

Google data center outage - ;-)

Thursday, April 01, 2010 6:49 AM



If you logged into Gmail over the last hour (or visited the Gmail homepage), you probably noticed that something looked a bit off: all the vowels are missing. We realize this makes things difficult for all of you who rely on Gmail — whether at home or at work — and we’re incredibly sorry. We take morphological issues like this extremely seriously, so we want to let you all know what happened and what we're doing about it.

At 6:01 am Pacific Time, during routine maintenance at one of our datacenters, the frontend web servers in that particular datacenter started failing to render the letter 'a' for a subset of users. As error rates escalated, the strain spread to other datacenters. We worked quickly to avoid a cascading failure of the entire alphabet by implementing a stopgap solution that limited the damage to the letters 'a,' 'e,' 'i,' 'o,' and 'u.' As a result, we're experiencing Gmail’s first temporary vowel outage. (We’re still investigating whether the letter 'y' is impacted and will post an update here shortly.)

Over the last hour we've received numerous reports of this issue via our help forums, from colleagues at Google, and via email you’ve sent us. Some of you have already found creative workarounds for communicating without vowels, like Aaron, who sent us this:


Having 80.8% of the alphabet available is significantly below the 99.9% full letter uptime reliability we strive for. Since identifying the root case of this issue, we’ve started bringing vowels back to Gmail, so you should see them back in your account within the next few hours if you don’t already. In the meantime, while you may still see this issue in Gmail's web interface, both IMAP and POP access are functioning normally. We'll post an update as soon as things are fully resolved and, again, we're v3ry s0rry.

Update (7:30 am): We’ve determined that the letter 'y' is not impacted.

1 comment:

Unknown said...

LOL!! Google staffers better tweet this "outtage" to its fanbase and do some damage control quick, Twitter and some news outlets are abuzz that it's somehow related to Google's banishment from China in favor of its own state-run search engine, the uber-censored Baidu.com crawler (in other words, people think Google & YouTube has been hacked for real!)

04-01-2010 Tech News: "China hacks Google in show of China's dominance over the ousted American search engine and the vulnerable United States economy, resulting in garbled login screen. The long-term effects of Baidu's hostile-takeover of the Chinese search engine market remains to be seen, but this alleged attack on Google's Gmail by China clearly shows the war in Cyberspace is heating up."

April 1st, 2010 Newslines Report: China Successfully Hacks Gmail, shuts down vowel library on login screen resulting in frustration and confusion for millions of [irate] users worldwide: "Gml s blt n th d tht ml cn b mr nttv, ffcnt, nd sfl. nd myb vn fn. ftr ll, Gml hs."

PR Pipeline: Sometimes clichés like "April Fools" are really useful for explaining yourself out of self-inflicted jams, such as Google's Gmail & YouTube practical jokes that the search engine played on (or preyed upon) its loyal users, "All in good jest." On YouTube's main page, 'Featured Videos' are displaying a new binary text-hash viewing option that reads: "By using text-only mode, you are saving YouTube $1 a second in bandwidth costs," funny (or not so funny, for the uninitiated) left many YouTubers scratching their hea...