Is beta the best route?

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

ANALYSIS
Many CIOs have sworn off software testing programs, opting instead for the 'Service Pack 1 release cycle', which means no software goes on their production systems until the first set of patches is released But this hard line stance on the use and deployment of prerelease software may cost your company more than you realise. Given the soft economy and most software companies' desire to continue producing and selling software, corporate technology buyers are in a great position to negotiate with vendors for favorable treatment during a prerelease testing phase. First, let's be clear on my definition of beta software. I'm not talking about access to code you can download from a vendor's support site. Of course, you should recognise that most companies have employees who are already doing this kind of beta testing--sometimes it's on their own time and own machines, but many times it involves using company time and assets. Rather than relying on this limited software testing, the beta process to which I'm referring involves real partnerships between companies and their software manufacturers. As beta testing is happening at some level anyway, you must determine the best way to harness the knowledge generated from these activities and leverage that activity to produce better products and services while building the relationship with your software vendors. Why beta?
Of course, you may ask, "Why should I risk my job on the company's adoption of prerelease software?" First, beta testing allows your company to get early access to new technology. But you should only consider this strategy if it allows you to optimise existing processes or enables the implementation of new processes that you couldn't use before because of immature technology or the price tag associated with the implementation. Even if you choose not to widely deploy the technology, access to the beta process provides a better understanding of industry trends and technologies by giving you an in-depth understanding of new technology and the ability to talk to the developers and designers who implemented it. You get a deeper understanding by getting a chance to learn the "why" and "how" rather than just getting the "what" information after the software is released. Another important benefit is the direct technical support from manufacturer during a prerelease cycle. Software companies recognise the investment enterprises make in testing the software and are generally willing to reward them with technical support commensurate with the amount of feedback you give them. Many times this includes direct access to vendor software developers and architects. Once the product is released, the software company has neither the incentive nor the time to give their customers access to this level of support. The best you can hope for is a strong support relationship. If you're using their product in a unique or marketworthy way, you may even be allowed to participate in press releases, case studies, or other marketing activities. And if your company would benefit from the attention given to those early technology adopters, this type of free publicity would be worth pursuing. Why not beta?
Of course, some companies might choose not to participate in beta testing because no matter how you slice it, a decision to be a beta tester involves investing company R&D dollars to test someone else's product. And given that most companies barely scratch the surface of the software investment they've already made, it's likely the current investment in technology may be sufficient and more cost effective to implement. Companies that choose to beta test must realise that dealing with sparse documentation and spotty support after major release milestones could double or triple the cost of developing or deploying internal systems or software based on the beta technology. Just remember that a decision to include prerelease software in internal systems or software initiatives should have a clear benefit to your company's bottom line. Using beta software effectively
Once you've made the decision to implement a system on prerelease technology, you'll still want to minimise your risk. Here are some basic do's and don'ts to consider:
  • Don't roll out any unreleased products--or any internal products based on unreleased technology--unless the manufacturer has a vested interest in your success. This means that they're either providing you with advanced technical support or, even better, they're committing to a major advertising campaign based on your solution. Once you're linked with the company in the public eye, the software company can't afford to let you fail.
  • Do isolate new technology into its own physical or virtual systems during early testing. I worked with one customer whose beta product generated so much unexpected network traffic that it crippled production systems. To minimise potential exposure, consider using either dedicated physical machines or products like VMware that allow you to create virtual test environments without exposing them to production environments.
  • Do expect and require a substantial benefit from the manufacturer for investment in their testing cycle. Unless you can quantify the benefit, you should make it clear to the manufacturer--and to your own technical employees--that you're better off waiting until the manufacturer releases the product to the public.

Have your say instantly in the Tech Update forum. Find out what's where in the new Tech Update with our Guided Tour. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Moley

@ewallace. Not so clear. Anyone can obtain the text, for example from here http://www.ustr.gov/webfm_send/2379. I support ACTA so long as it and...

12 minutes ago by Moley on ACTA: Facts, misconceptions and questions
45283

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

3 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA
Burn-IT

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

4 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs
ewallace

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

5 hours ago by ewallace on ACTA: Facts, misconceptions and questions
fgvrg56

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

6 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?
Ben Woods

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

7 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule
Marcus Karlsson

Any update on this, considering the claimed "first week of February"?

8 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule
apexwm

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

16 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility
txtrainguy

Replying to an old topic that I'm currently facing with my CEO (who is on a Mac). Our servers are primarily Windows Servers, office is about...

23 hours ago by txtrainguy on Windows Server 2008 drops the ball for Mac compatibility
k0tcs3

Sure, that makes perfect sense. Pay wrong-doers money and thank them for breaching your security and pointing out your flaws, that would surely...

23 hours ago by k0tcs3 on US indicts Romanian over NASA climate change hack
Random_Error

I think he's referring specifically to Android apps, as Apple do regulate their App Store, but Google seem to let any old crap onto the Android store!

23 hours ago by Random_Error on RIM: BlackBerry will keep 'garbage' apps out of store
Paul Fezziwig

Keep the crap apps out?! How will they compete with Android and Apple's claim to fame of having so many life changing apps? I wonder if the media...

1 day ago by Paul Fezziwig via Facebook on RIM: BlackBerry will keep 'garbage' apps out of store
Aigars Mahinovs

It has been shown time after time that if there is an author store that sells the songs at even 1$ per song and gives you a high-quality digital...

1 day ago by Aigars Mahinovs via Facebook on Copyright isn't working, says European Commission
awbMaven

""As a result of Butyka's alleged conduct, researchers were unable to use the computers for more than two months while NASA removed the malicious...

1 day ago by awbMaven on US indicts Romanian over NASA climate change hack
subhorup

It simultaneously worries me and uplifts me that a self-proclaimed group of internet activists name themselves after Indian mythical figures....

2 days ago by subhorup on Anonymous activists release PCAnywhere source code
naviathan

It's actually far easier to work anonymously on the internet than you think. With tools like Tor bouncing your traffic around the world before...

2 days ago by naviathan on Anonymous activists release PCAnywhere source code
Agnostic_OS

1000272134 and bluedalmatian with you both there but then I'm still in 10.04 land (and happy with it)

2 days ago by Agnostic_OS on Ten factors that make Ubuntu 11.10 a hit
apexwm

Interesting article and definitely see your points on the products mentioned. One of the top products for our Help Desk (approximately 20% of all...

2 days ago by apexwm on Ten flawed products that derail productivity
Paul Hutchinson

Absolutely - this should obviously not be handled my isp - but handled by their hosting operator. What's been suggested here is that my isp police...

2 days ago by Paul Hutchinson via Facebook on MPs urge ISPs to take down terrorist material
Techs UK

Looks like a great phone. I don't notice any deficiencies in WP7. used IOS before, that's pretty good. I don't spend much time in Apps, all i need...

2 days ago by Techs UK on Nokia pins US 're-entry' hopes on Lumia 900