search technology reviews, news, features, group tests
Popular Searches:   video , dell , dvd
 |  Register
 |  Newsletters  | 
Sitemap  |  RSS
RSS
Tuesday November 24, 2009 1:10 AM AEST
Skip Navigation LinksPC Authority > News > Facebook: hard drive failure is no cause for alarm
Facebook: hard drive failure is no cause for alarm
NEWS

Facebook: hard drive failure is no cause for alarm

by William Maher  on Mar 10, 2009
Tags: Facebook
"Yes, I have worked in a data center (government) and yes, I have seen them fail. As far as Facebook is concerned, I personally think it needs to fail completly and take MySpace with it."
 
A "rare" simultaneous hard drive failure meant a chunk of Facebook's online photo storage temporarily went down this week. Time to backup, we think.

In case you didn't hear, some of Facebook's hard drives went kaput, potentially taking down at least some of some users' photo collections temporarily.

According to an update on Facebook's official blog, the site suffered a "rare" simultaneous hard drive failure, affecting 10-15% of uploaded photos.

Here's how they explained it:

"During an otherwise routine software upgrade on Friday night, we ran into some problems with our photo storage and a few of the hard drives where we store photos apparently failed all at once. We're trying to fully understand what happened, since simultaneous hardware failures like this are rare."

As you'd hope, everything is backed up.

But it appears getting things back online wasn't a simple process.

"We still have all your photos because we store them in a way that maintains multiple copies of the data in case of hardware failures like this. However, even though your photos are safe, we can't serve photos off the affected storage volumes until they're repaired. We're working on them right now, but it will take some time because there's so much data on them and the repair process largely involves copying huge amounts of data to new drives. This is why some photos aren't showing up right now".

We're not going to criticise Facebook for something like this - hard drive failures happen to the best of us. Still, it makes us wonder whether we're trusting too much important, or in the case of party photos (not so important) information to the Internet "cloud".

As was proven recently when Gmail went down, free Web services can and do crash. Lets hope you have contingencies for when they do.

 

Email a Friend Email this
Print Page Print this
Tweet This Tweet this
Feedback Send us your tips


Ads by Google

Comments: 4
Thoughts on this article? Add a comment below.
Noops
Mar 10, 2009 2:32 PM
The chances of multiple HDD failures at the same time on an array are so small as to be negligible. Sounds to me that the description is misleading. Since it happened during a software upgrade, it sounds more like disk or array corruption, not hardware failure as the article suggests. Someone made a mistake during the upgrade, or the upgrade had unintended results.


Comment made about the PC Authority article:
Facebook: hard drive failure is no cause for alarm?
A "rare" simultaneous hard drive failure meant a chunk of Facebook's online photo storage temporarily went down this week. Time to backup, we think.

What do you think? Join the discussion.
Lost-Benji
Mar 10, 2009 3:43 PM
Noops wrote:
The chances of multiple HDD failures at the same time on an array are so small as to be negligible. Sounds to me that the description is misleading. Since it happened during a software upgrade, it sounds more like disk or array corruption, not hardware failure as the article suggests. Someone made a mistake during the upgrade, or the upgrade had unintended results.


For the record, the do happen and are not that rare. A simple case of bad batches and firmwares (can you spell S.E.A.G.A.T.E ?)will do it. The use of non-RAID designed dives can add to this. Yes arrays can fail due to software (Apple shit on PC's known to kill nForce RAID) or configuration changes. Lets not forget a power surge that no amount of redundancy will protect against if the drives are local. Oh and there is always a good chance of a crappy controller killing the drives or array.
Noops
Mar 11, 2009 3:24 PM
Of course they happen, but they ARE rare. We're talking about a professional datacentre here (or at least it should be) using server-quality hardware, not PCs using associated hardware. In my 20 years working in datacentres, I have NEVER experienced multiple simultaneous HDD failures. Sure, RAID controllers fail, but replace and reconfigure them (you do have a spare of EACH piece of critical hardware, don't you?) and the array and data is accessible again. So, unless Facebook is using 2nd rate hardware (if it is it deserves this failure, and I wouldn't recommend anyone store critical data there) the chances are that someone made a mistake.
But if you've never worked in a real datacentre, you wouldn't know this.
Lost-Benji
Mar 11, 2009 7:05 PM
Yes, I have worked in a data center (government) and yes, I have seen them fail.


As far as Facebook is concerned, I personally think it needs to fail completly and take MySpace with it.
Login or register to submit a comment.
 

Top Stories

Telstra confirm 30Mbit national network plan - but don't mention the NBN
Telstra has completed the 100Mbit upgrade to their Melbourne cable network and are next planning to get 30Mbit speeds into the rest of the country; but first they'll need to dispel those endless NBN comparisons
 
Red Hat updates with Fedora 12
Red Hat has released the latest version of its Fedora open source operating system and has added new video, virtualisation and networking support..
 
Picking the perfect home entertainment box: Movie downloads come to the Xbox 360
Unmetered download agreements are next the battleground as games consoles follow the Apple TV's lead to support movie download services.
 


 
Intel
 
 
LogMeIn
 
 
Amazing Dell Coupons now available
 
Discover Apple