Thousands of customers' emails, totalling around 700GB of data, have been lost forever, Internet service provider PlusNet has admitted.
The ISP has apologised profusely for the disaster, which happened in July, and has promised to implement a new platform with "vastly scalable, site resilient mail storage set-up".
The incident has been "taken very seriously within PlusNet", a spokesperson told ZDNet UK on Friday, adding the company's "sincerest apologies for the inconvenience caused by the loss of any customer emails and in particular the unread emails".
PlusNet estimates that half of the missing emails were spam, while only one to two percent of the remaining emails were unread at the time of their deletion.
The disaster was primarily caused by human error: an engineer mistook a live server for a backup server and mistakenly deleted the wrong one.
According to a statement PlusNet released to its customers, that error was compounded when the engineer "attempted to recover the data by creating a volume of the same size in the same place as the first volume... by creating a new volume, the existing inodes [disk indices] were wiped and all data that was on that volume was essentially gone".
The situation was even further exacerbated because the server in question — supplied by Sun after their acquisition of StorageTek — was using a proprietary OS and customised filing system. This forced data recovery specialists to heavily tweak their analysis and recovery software, thus delaying the recovery process.
In the absence of a usable index for the data, PlusNet eventually decided it would be safer to retrieve the server from the data recovery experts, rather than risk further capacity issues.
PlusNet has promised its customers that "an extensive analysis of how this happened has been carried out and working practices implemented to prevent it happening again".
The company has however reiterated its standpoint that "in line with the ISP industry we will not be offering compensation due to a break in service".
ZDNet UK's Jonathan Bennett contributed to this report.
Talkback
Further evidence that there are too many under-qualified "engineers" working in the IT industry. Nobody in their right might who had the permission to delete data from a server would have thought to create a recovery location on the SAME disk space as where it was deleted from..
*SIGH*... weed them out....
If PlusNet is willing to send the server drives to us in the U.S. we’re willing to help. In fact we will pay the shipping costs to see the the drives. Since we have no idea who they might have used for data recovery it’s quite possible the data is still on the server unless the drives have been reloaded with data thereby overwriting the files.
At the very least we could verify that the data is truly gone.
Relying on a 3rd party to securely store your data is never a good idea.
It's simple folks. If you don't want to lose your data, back it up.
Didn't plusnet have a backup strategy in place?
Accidentally deleting the data is technically no different from the drive or o/s going bang. This is a standard scenario, which well-run businesses have been used to for ages - servers containing data are always backed up to an off-site location, using a rotating backup (different one each day of the week). This has been good practice for years, even decades.
In the case of a fire at PlusNet's server room, what would they do? Oh dear all the drives have been destroyed. Sorry we have no offsite backup, everything's gone.
Let's hope they don't keep their accounting data with the same level of recoverability, or I would hate to be an investor!
Unread emails are important...
You can try Stellar phoenix Data Recovery Software
http://www.stellarinfo.com/solaris-data-recovery.htm
http://www.stellarinfo.com/solaris-sparc-data-recovery.htm
Stellar also provides data recovery service