How to survive a catastrophic outage

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

CASE STUDY

At the height of the massive blackout that rolled across the northeast last August, CBS News reported that 80 per cent of New York State lost power. Yet, incredibly, at the onset, not a single customer of Con Edison Communication, the subsidiary of Consolidated Edison Company that provides data and voice transport products and services to metro New York City, lost service. Joe Laezza, Vice President of Network Operation for the New York City-based company, credits his firm's successful business continuity to its rigorous disaster recovery preparations. "The time we spent establishing our disaster recovery plan and running drills to test its viability really paid off when it came time to respond to a live widescale incident like we had during the summer of 2003," he said.

The real dividend stemmed from the section of the document that outlined the responsibilities of every participant in the emergency management team. "Within the plan," explained Laezza, "we defined who the emergency management resources are within Con Ed Communication and what each of their roles and responsibilities are for responding to a crisis like the power outage." Despite the monumental difficulty in travelling around Manhattan at the time, within the first hour and a half, the entire emergency management team was assembled, the crisis bridge activated, all the assignments divided out, and the response underway.

Taking a page from the Boy Scouts of America handbook, Con Ed Communications' strategy can be summed up in two words: be prepared. Laezza offers TechRepublic readers some tactical advice on just how to do that:

    Divide and conquer. Whether you're a network service provider like Con Ed Communications or a user of network services, you need to do a risk assessment on two levels: 1) the impact of possible disasters on your internal operations, and 2) their impact on your ability to provide service to your customers.
    Respond and restore. Your first task should be to outline interim solutions to get yourself back in business. Your second task should be to outline strategies for restoring operations back to normal business practices. Separate your emergency management resources into two parts as well -- a response team to handle the immediate crisis and a restoration team to get you back to business as usual. Make sure that you establish specific methods and procedures for each team to use in the event of a disaster.
    Review and challenge. It's not enough to review the vulnerabilities of your own operation. You need to make sure that your carrier and your business partners have viable recovery plans in place, too. Your telecommunications and power providers are essential elements of your operation. Without their services, you'd be hard-pressed to maintain continuity. What about your property manager? Does the company have a clear set of procedures to get the physical plant back in usable condition quickly? What about your software support provider? The operator of your data warehouse facility?
    Revisit and revise. Make sure that your disaster recovery plan stays a living document. Revisit the content on a regular basis so that, as your business evolves, your plan can be updated accordingly. Something as simple as a change in the management echelon can undermine a plan's viability if the emergency management team list isn't updated to reflect new players.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Jack Schofield

@openhgs Windows users have had multiple desktops since Linus started writing Linux. They just haven't shipped as standard because not enough...

3 hours ago by Jack Schofield on Windows 8 could speed multi-monitor uptake
Jack Schofield

@Phil at Cloud4 What, Microsoft gets £1,200 per PC and £1,622 per server? Gosh, I'm amazed....

3 hours ago by Jack Schofield on 6 million wasted licences and £1,200 PCs: welcome to government IT
craigsc

You guys have no idea what is going on at Autonomy. Autonomy could have been a much more profitable organization. The sales operations at Autonomy...

5 hours ago by craigsc on HP cuts 27,000 staff as Autonomy chief Lynch leaves
Moley

How does this impact on dual or multi booting? Seems to me to more or less prohibit this, from Windows 8 anyway. Will Grub 2 recognise Windows 8,...

5 hours ago by Moley on Windows 8 start-up speed forces USB boot workaround
apexwm

I don't understand why there cannot be a slight pause during the boot process so the user can press a key. Many operating systems do this, even if...

6 hours ago by apexwm on Windows 8 start-up speed forces USB boot workaround
Gavin Goodman

You can now buy the Xi3 modular computer in the UK at http://www.ocdistribution.com . This can be bought with the Tand3m software, pricing and...

7 hours ago by Gavin Goodman on CES 2012: Xi3 microSERV3R
Phil at Cloud4

I agree: Mike Lynch can clearly build a business and manage strategy. I suspect the exit of Mike is more likely the end of a planned handover...

10 hours ago by Phil at Cloud4 on HP cuts 27,000 staff as Autonomy chief Lynch leaves
Phil at Cloud4

This is unbeleivable government wastage with only one winner... Microsoft 1 - Tax payer Nil!

10 hours ago by Phil at Cloud4 on 6 million wasted licences and £1,200 PCs: welcome to government IT
Mispam

So what do you do when you can't boot into windows? Why can't I just hold Shift while I power up instead of having to boot into windows and click a...

11 hours ago by Mispam on Windows 8 start-up speed forces USB boot workaround
apexwm

I've also seen that Mac OS X for Intel machines is supposed to run in VirtualBox, which would also be a nice solution. I've never tried it though.

13 hours ago by apexwm on xTreme Triple Booting: Linux, Mac & Windows
dave heasman

What I wonder is why when companies are caught bang to rights in not providing contracted services, people bend over to smear the customers? Surely...

13 hours ago by dave heasman on Virgin throttles broadband for high-speed customers
pjc158

Strange statement from HP regarding Mike Lynch and not capable of scaling a company. Autonomy was a $7bn purchase which started as a small company...

14 hours ago by pjc158 on HP cuts 27,000 staff as Autonomy chief Lynch leaves
lojolondon

Or - possibly, they will destroy business by ensuring people do not invest where there is no return. Another socialist idea, well beyond it's...

17 hours ago by lojolondon on Open Data Institute will act as biz incubator
J.A. Watson

Good stuff Jake, very interesting. Thanks. jw

17 hours ago by J.A. Watson on xTreme Triple Booting: Linux, Mac & Windows
openhgs

"the cost of a second LCD screen is about the same as one day of an office worker's time, so this should soon be recouped in extra productivity."...

18 hours ago by openhgs on Windows 8 could speed multi-monitor uptake
Thomas Gellhaus

I also installed the KDE version; I also will probably try out razorqt since I really haven't had a chance to before. I'm looking forward to the...

1 day ago by Thomas Gellhaus via Facebook on Mageia 2 Released
francisabigail

Acquiring when reinvention/cannibalization is too challenging for a large organization can be an excellent strategy- still, so many mergers stumble...

1 day ago by francisabigail on Ariba buy parks SAP on Oracle's cloud turf
apexwm

All of the feedback regarding using a touch monitor for a desktop PC is right on. Several months ago, we installed a "demo" multitouch all-in-one...

2 days ago by apexwm on Windows 8 could speed multi-monitor uptake
191706

anyone wanting to triple boot *their* own Mac

2 days ago by 191706 on xTreme Triple Booting: Linux, Mac & Windows
SoapyTablet

Cont.. Biggest Bugbear: Win7's stop-animate-go approach to work, you develop a staggered (not in the above alchohol sense of the word) approach to...

2 days ago by SoapyTablet on Windows 8 could speed multi-monitor uptake