How to survive a catastrophic outage

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

CASE STUDY

At the height of the massive blackout that rolled across the northeast last August, CBS News reported that 80 per cent of New York State lost power. Yet, incredibly, at the onset, not a single customer of Con Edison Communication, the subsidiary of Consolidated Edison Company that provides data and voice transport products and services to metro New York City, lost service. Joe Laezza, Vice President of Network Operation for the New York City-based company, credits his firm's successful business continuity to its rigorous disaster recovery preparations. "The time we spent establishing our disaster recovery plan and running drills to test its viability really paid off when it came time to respond to a live widescale incident like we had during the summer of 2003," he said.

The real dividend stemmed from the section of the document that outlined the responsibilities of every participant in the emergency management team. "Within the plan," explained Laezza, "we defined who the emergency management resources are within Con Ed Communication and what each of their roles and responsibilities are for responding to a crisis like the power outage." Despite the monumental difficulty in travelling around Manhattan at the time, within the first hour and a half, the entire emergency management team was assembled, the crisis bridge activated, all the assignments divided out, and the response underway.

Taking a page from the Boy Scouts of America handbook, Con Ed Communications' strategy can be summed up in two words: be prepared. Laezza offers TechRepublic readers some tactical advice on just how to do that:

    Divide and conquer. Whether you're a network service provider like Con Ed Communications or a user of network services, you need to do a risk assessment on two levels: 1) the impact of possible disasters on your internal operations, and 2) their impact on your ability to provide service to your customers.
    Respond and restore. Your first task should be to outline interim solutions to get yourself back in business. Your second task should be to outline strategies for restoring operations back to normal business practices. Separate your emergency management resources into two parts as well -- a response team to handle the immediate crisis and a restoration team to get you back to business as usual. Make sure that you establish specific methods and procedures for each team to use in the event of a disaster.
    Review and challenge. It's not enough to review the vulnerabilities of your own operation. You need to make sure that your carrier and your business partners have viable recovery plans in place, too. Your telecommunications and power providers are essential elements of your operation. Without their services, you'd be hard-pressed to maintain continuity. What about your property manager? Does the company have a clear set of procedures to get the physical plant back in usable condition quickly? What about your software support provider? The operator of your data warehouse facility?
    Revisit and revise. Make sure that your disaster recovery plan stays a living document. Revisit the content on a regular basis so that, as your business evolves, your plan can be updated accordingly. Something as simple as a change in the management echelon can undermine a plan's viability if the emergency management team list isn't updated to reflect new players.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Roberto_Store

Now On Sale, Unlocked iPhone 4S / Galaxy Note In Factory Box. Roberto-Techie(UK) ”Now on Sales” Smartphone, Android,Tablets,Gadget &...

9 minutes ago by Roberto_Store on Samsung Galaxy S III lined up for sale
Paul Smyth

Is this classic FUD? One thing I would definitely have notice is a Mozilla threat to stop supporting GNU/Linux.

2 hours ago by Paul Smyth via Facebook on Firefox rapid release improves Fedora Linux
UnderINK

I agree with the previous commenter wholeheartedly. I couldn't say it better myself. This is very 'Big Brother'. And while I agree with protecting...

6 hours ago by UnderINK on European e-identity plan to be unveiled this month
Simon Bisson and Mary Branscombe

Nice to see that Turing's idea of a general purpose computer doing once-hardware-powered tasks in software is now universal ;-) Mary

11 hours ago by Simon Bisson and Mary Branscombe on Software with everything
Jason Burchell

seriously now. I've only bothered to read a small bit of the comments. do me and the rest of the world a favour. stop saying it does not work or...

15 hours ago by Jason Burchell via Facebook on Music industry negotiating over 24-bit downloads
Philip Charles Cohen

Read about it and weep, John Donahoe ... In addition to Visa’s V.me, there is now MasterCard’s PayPass digital wallet soon to arrive; another...

20 hours ago by Philip Charles Cohen via Facebook on PayPal takes phone-based payments to the high street
apexwm

Leslie Satenstein : Where have you ever seen Mozilla even mention this? Firefox is the most popular browser in the GNU/Linux OS, so I don't see...

20 hours ago by apexwm on Firefox rapid release improves Fedora Linux
songmaster

SHleG: Do you remember building a clockwork scorpion kit (I'm pretty sure I have a photo of it somewhere) — I think it was called something like...

22 hours ago by songmaster on Software with everything
Chris Wortman

Good I love Yahoo! Their search engine is getting better than Google as of late. I find more of what I want on the first page, and usually within...

22 hours ago by Chris Wortman via Facebook on Linux Mint 13 ramps up for KDE release
PatrickG

openhgs has made the point for Windows 8 multiple monitors without realising it! With Windows 7 you have to switch the mouse and so your focus...

1 day ago by PatrickG on Windows 8 could speed multi-monitor uptake
Leslie Satenstein

Mozilla has threatened to stop supporting Linux. I guess that UBUNTU is going with another browser. I indicated that if Mozilla stops supporting...

1 day ago by Leslie Satenstein via Facebook on Firefox rapid release improves Fedora Linux
Andy Bolstridge

Much as I abhor Microsoft's licensing practices, this is almost certainly down to purchasing IT equipment via 3rd party consultants - you get the...

1 day ago by Andy Bolstridge via Facebook on 6 million wasted licences and £1,200 PCs: welcome to government IT
Jack Schofield

@openhgs Windows users have had multiple desktops since Linus started writing Linux. They just haven't shipped as standard because not enough...

2 days ago by Jack Schofield on Windows 8 could speed multi-monitor uptake
Jack Schofield

@Phil at Cloud4 What, Microsoft gets £1,200 per PC and £1,622 per server? Gosh, I'm amazed....

2 days ago by Jack Schofield on 6 million wasted licences and £1,200 PCs: welcome to government IT
craigsc

You guys have no idea what is going on at Autonomy. Autonomy could have been a much more profitable organization. The sales operations at Autonomy...

2 days ago by craigsc on HP cuts 27,000 staff as Autonomy chief Lynch leaves
Moley

How does this impact on dual or multi booting? Seems to me to more or less prohibit this, from Windows 8 anyway. Will Grub 2 recognise Windows 8,...

2 days ago by Moley on Windows 8 start-up speed forces USB boot workaround
apexwm

I don't understand why there cannot be a slight pause during the boot process so the user can press a key. Many operating systems do this, even if...

2 days ago by apexwm on Windows 8 start-up speed forces USB boot workaround
Gavin Goodman

You can now buy the Xi3 modular computer in the UK at http://www.ocdistribution.com . This can be bought with the Tand3m software, pricing and...

2 days ago by Gavin Goodman on CES 2012: Xi3 microSERV3R
Phil at Cloud4

I agree: Mike Lynch can clearly build a business and manage strategy. I suspect the exit of Mike is more likely the end of a planned handover...

2 days ago by Phil at Cloud4 on HP cuts 27,000 staff as Autonomy chief Lynch leaves
Phil at Cloud4

This is unbeleivable government wastage with only one winner... Microsoft 1 - Tax payer Nil!

2 days ago by Phil at Cloud4 on 6 million wasted licences and £1,200 PCs: welcome to government IT