New P2P tools mean quicker downloads

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

NEWS
A new generation of peer-to-peer tools is gaining traction on the Internet, spelling tougher times ahead for movie studios' attempts to quell online piracy. Going by names like eDonkey and BitTorrent, many of the latest generation of file-swapping tools have been designed specifically to increase the efficiency and speed of transfer for large files such as movie files. Some of these tools have been in development for several years, but are just now reaching the critical mass needed to make a dent in the file-trading world. Some in the copyright community say these new tools are finally starting to rival the piracy potential of the post-Napster generation of swapping services. "We see people downloading like crazy," said Mark Ishikawa, chief executive of BayTSP, a Silicon Valley company that monitors file-swapping networks for movie studios and record labels. "eDonkey is passing Gnutella, and is even on its way to passing FastTrack." FastTrack is the technology behind Sharman Networks' Kazaa and Grokster. File-swapping tools such as Kazaa and Morpheus are still enormously popular -- indeed, on Friday, Kazaa passed ICQ instant messaging software as the most-requested technology ever on Download.com, a software aggregation site owned by CNET News.com. Kazaa has been downloaded more than 229 million times, according to that site. The new generation of tools has been designed much like the old, by individuals or small teams of programmers working to correct the perceived shortcomings of earlier software. eDonkey is largely the product of programmer Jed McCaleb of New York. His initial plan was to make file search and distribution more efficient, while keeping the same basic network-searching functions seen in Napster and its successors. The final eDonkey product is different in two primary ways from earlier file-swapping services. The first is to do with decentralised search. When a file is shared on the network, the technology gives the file a "hash" identifier -- essentially an address based on the characteristics of the file itself. Each computer logged onto the network has a certain range of addresses assigned to it, so it can act as an index. This allows searches to be carried out more efficiently than in earlier decentralised systems. With Gnutella, for example, a search query for "Radiohead" or "Madonna," for example, ripples out through the network, asking each node if it has or is close to those files. With eDonkey, the "Radiohead" query would be directed quickly to the computer that is temporarily responsible for keeping track of the location of files in that category, and a response would be returned more quickly. The second -- and main -- advance is that the system can break up each file into tiny pieces, allowing them to be distributed independently. As soon as one person starts downloading these pieces, he or she starts offering them to the network at large. That means a movie does not have to be downloaded in its entirety before it can be offered to other people, making distribution of these and other larger files much more efficient. McCaleb has been offering various versions of eDonkey for several years, but in the past few months in particular it has been catching on more quickly, especially in Europe, he said. The tool has been downloaded close to 50 million times, he added, but said as he updates it very frequently, the number of people who have tried the software is likely closer to 8 million. Another tool, even more focused on distributing large files, has seen rapid adoption inside the open-source community in the past few months. Dubbed BitTorrent, the tool was written by San Francisco programmer Bram Cohen, again as a way to make the distribution of large files more efficient. Unlike Napster, Kazaa or eDonkey, the tool concentrates on distribution rather than search. But what it lacks in search capabilities, it makes up for in speed, its supporters say. BitTorrent works in the background of a Web browser, assisting with the uploading and downloading of files. If users -- maybe a software company or a file swapper -- want to distribute files, they have to set up a "tracker" Web site. A tracker is essentially a low-level server that keeps track of requests for a given file and directs the requests to the users offering the file. These users will have posted links to the tracker on a Web site, and these links will trigger the properly formatted BitTorrent downloads. Like eDonkey, BitTorrent splits files into tiny bits. Once someone has started downloading a file, that person's computer immediately serves as an upload server for anyone else looking for the file. The technology automatically balances upload and download speeds, ensuring that people downloading give back to the network, Cohen said. Unlike other file-swapping networks, if the number of people searching for a single file increases, it means faster downloads -- not traffic jams -- as the individual pieces get spread quickly around the community. "I'm basically measuring my success by the amount of upload capacity which gets used, which would otherwise be sitting around wasted," Cohen said in an interview conducted over an instant messaging system. Right side of the law
The BitTorrent technology isn't intended for movie piracy. Indeed, open-source advocates recently used it to distribute a new release of the Red Hat Linux software, making an end run around clogged company servers. One Web community that specialises in swapping high-quality recordings of live jam bands such as Phish, usually with the bands' permission, also uses the technology. "It's definitely a technological marvel," said Wayne Chang, a Massachusetts college student and system administrator for PickATime.com who has used the technology. "The more people using it, the faster the whole system is." People have quickly seen its potential for unauthorised online distribution of videos and movies as well as for lawful uses, however. Many popular Web sites already offer links to full movies, TV programs, games and music using the technology. The tool has been the most popular download on the open-source software aggregation site SourceForge for some time, with more than 1.4 million downloads as of 20 May. Executives from the Motion Picture Association of America (MPAA), the movie studios' trade association, say they are well aware of and are monitoring the new file-swapping technologies. "I would say that they represent a continuing threat," said Tom Temple, director of worldwide Internet enforcement for the MPA. But just as with predecessors, the new technologies expose their Internet addresses of those who download files, allowing antipiracy enforcers to track them down, he said. "They still allow us to identify the IP address of a person."
See the MP3/P2P News Section for the latest on everything from MP3 players to Napster and the other file-swapping services. Let the editors know what you think in the Mailroom.

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

UnderINK

I agree with the previous commenter wholeheartedly. I couldn't say it better myself. This is very 'Big Brother'. And while I agree with protecting...

2 hours ago by UnderINK on European e-identity plan to be unveiled this month
Simon Bisson and Mary Branscombe

Nice to see that Turing's idea of a general purpose computer doing once-hardware-powered tasks in software is now universal ;-) Mary

7 hours ago by Simon Bisson and Mary Branscombe on Software with everything
Jason Burchell

seriously now. I've only bothered to read a small bit of the comments. do me and the rest of the world a favour. stop saying it does not work or...

11 hours ago by Jason Burchell via Facebook on Music industry negotiating over 24-bit downloads
Philip Charles Cohen

Read about it and weep, John Donahoe ... In addition to Visa’s V.me, there is now MasterCard’s PayPass digital wallet soon to arrive; another...

15 hours ago by Philip Charles Cohen via Facebook on PayPal takes phone-based payments to the high street
apexwm

Leslie Satenstein : Where have you ever seen Mozilla even mention this? Firefox is the most popular browser in the GNU/Linux OS, so I don't see...

16 hours ago by apexwm on Firefox rapid release improves Fedora Linux
songmaster

SHleG: Do you remember building a clockwork scorpion kit (I'm pretty sure I have a photo of it somewhere) — I think it was called something like...

18 hours ago by songmaster on Software with everything
Chris Wortman

Good I love Yahoo! Their search engine is getting better than Google as of late. I find more of what I want on the first page, and usually within...

18 hours ago by Chris Wortman via Facebook on Linux Mint 13 ramps up for KDE release
PatrickG

openhgs has made the point for Windows 8 multiple monitors without realising it! With Windows 7 you have to switch the mouse and so your focus...

20 hours ago by PatrickG on Windows 8 could speed multi-monitor uptake
Leslie Satenstein

Mozilla has threatened to stop supporting Linux. I guess that UBUNTU is going with another browser. I indicated that if Mozilla stops supporting...

21 hours ago by Leslie Satenstein via Facebook on Firefox rapid release improves Fedora Linux
Andy Bolstridge

Much as I abhor Microsoft's licensing practices, this is almost certainly down to purchasing IT equipment via 3rd party consultants - you get the...

22 hours ago by Andy Bolstridge via Facebook on 6 million wasted licences and £1,200 PCs: welcome to government IT
Jack Schofield

@openhgs Windows users have had multiple desktops since Linus started writing Linux. They just haven't shipped as standard because not enough...

2 days ago by Jack Schofield on Windows 8 could speed multi-monitor uptake
Jack Schofield

@Phil at Cloud4 What, Microsoft gets £1,200 per PC and £1,622 per server? Gosh, I'm amazed....

2 days ago by Jack Schofield on 6 million wasted licences and £1,200 PCs: welcome to government IT
craigsc

You guys have no idea what is going on at Autonomy. Autonomy could have been a much more profitable organization. The sales operations at Autonomy...

2 days ago by craigsc on HP cuts 27,000 staff as Autonomy chief Lynch leaves
Moley

How does this impact on dual or multi booting? Seems to me to more or less prohibit this, from Windows 8 anyway. Will Grub 2 recognise Windows 8,...

2 days ago by Moley on Windows 8 start-up speed forces USB boot workaround
apexwm

I don't understand why there cannot be a slight pause during the boot process so the user can press a key. Many operating systems do this, even if...

2 days ago by apexwm on Windows 8 start-up speed forces USB boot workaround
Gavin Goodman

You can now buy the Xi3 modular computer in the UK at http://www.ocdistribution.com . This can be bought with the Tand3m software, pricing and...

2 days ago by Gavin Goodman on CES 2012: Xi3 microSERV3R
Phil at Cloud4

I agree: Mike Lynch can clearly build a business and manage strategy. I suspect the exit of Mike is more likely the end of a planned handover...

2 days ago by Phil at Cloud4 on HP cuts 27,000 staff as Autonomy chief Lynch leaves
Phil at Cloud4

This is unbeleivable government wastage with only one winner... Microsoft 1 - Tax payer Nil!

2 days ago by Phil at Cloud4 on 6 million wasted licences and £1,200 PCs: welcome to government IT
Mispam

So what do you do when you can't boot into windows? Why can't I just hold Shift while I power up instead of having to boot into windows and click a...

2 days ago by Mispam on Windows 8 start-up speed forces USB boot workaround
apexwm

I've also seen that Mac OS X for Intel machines is supposed to run in VirtualBox, which would also be a nice solution. I've never tried it though.

2 days ago by apexwm on xTreme Triple Booting: Linux, Mac & Windows