Optimise NTFS performance in Windows servers

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

ANALYSIS
At the heart of your Windows NT or Windows 2000 server's file system is NTFS, short for the NT file system, the default file system for Microsoft Windows NT and 2000. NTFS controls where Windows NT/2000 locates files on the server's hard drive. It also controls security and access privileges for those files. To get the most out of your server's hard drives, you must take NTFS into consideration. I'm going to show you how to wring the last drop of performance out of NTFS. I'll consider the importance of defragmentation, compression, naming schemes, and folder structure. Optimising and improving NTFS NTFS includes several features that can increase the performance of your system's hard disks:
  • Cluster sizes -- This is the size of units of allocation on a hard disk.
  • Standard defragmentation -- This rewrites the contents of noncontiguous data into contiguous sectors on the disk to increase read/write performance.
  • MFT defragmentation -- The Master File Table (MFT) contains information about all the files and data stored on disk.
  • Compression -- NTFS can compress files and folders stored on disk to an optimal size, maximising the available storage space.
  • Naming configurations -- This represents the naming conventions you use when naming files and folders on your server.
  • Folder structure -- This is the number of folders and subfolders and the number of files within those folders.
In the following sections, I'll show you how to use these features to tweak the performance of your server's hard disks and improve the overall performance of your network. Cluster size does matter Clusters are chunks of disk space used to organise data on a disk. The default cluster size is the smallest block of disk space that can hold a file. Versions of Windows NT later than version 3.5, including Windows 2000, won't use cluster sizes larger than 4KB for hard drives smaller than 16Terabyte (TB). This helps minimise the amount of overhead used to contain the file. When a file is stored on a disk, it's written into clusters. If the file being stored exceeds the cluster size allocated to it, the file system uses additional clusters to store the file, consuming clusters until the file is stored. Naturally, files almost never fall neatly into multiples of 4KB. So when the file system uses additional clusters, the unused portion of the last cluster is lost to overhead. For example, suppose that you have a 35KB file on your hard disk. The largest cluster size available is 4KB. Therefore, the file will use a total of nine clusters. Eight of those clusters will be a full 4KB in size. The ninth cluster will contain only 3KB of data, leaving 1KB completely wasted. If you had to store a thousand 35KB files, you'd lose 1MB of drive space. Microsoft has developed an algorithm to estimate cluster size overhead. On the typical disk partition, the overhead algorithm looks like this: (cluster size)/2 * (number of files) So in the previous example, (4KB)/2 * 1,000, the equation would estimate that you'd lose 2 MB of disk space when you've only actually lost 1MB. The equation is wrong in this case because all of the last clusters are three-quarters full. The equation assumes that the average cluster will be half full. Using smaller cluster sizes reduces the amount of space needed to store files. If you have an application that doesn't consume a lot of disk space but uses very small data files, you can more efficiently store data on a drive with smaller cluster sizes. It is possible to set the cluster size when the drive is formatted (type Format /? from a command prompt for details), but Microsoft recommends that the cluster size is chosen to work with the partition size of the drive, and has set a default cluster sizes for any given partition size. A way to get a given cluster size, and still use the default cluster size is to choose the partition size which makes NTFS default to that cluster size. NTFS default cluster sizes are described in detail here but in summary are broken down as follows:
  • 512 bytes: 0 MB to 512 MB
  • 1KB: 513 MB to 1 GB
  • 2KB: 1 GB to 2 GB
  • 4KB: 2 GB+
So if your application uses small data files, but the total of those data files won't exceed 1 GB, you can more efficiently use your server's drives by placing the data on a drive with a 1 GB partition.

Talkback

Cluster size discussion in this articlue is absolute BS!!!

via Facebook 31 October, 2004 02:50
Reply

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

Thomas Gellhaus

I also installed the KDE version; I also will probably try out razorqt since I really haven't had a chance to before. I'm looking forward to the...

3 hours ago by Thomas Gellhaus via Facebook on Mageia 2 Released
francisabigail

Acquiring when reinvention/cannibalization is too challenging for a large organization can be an excellent strategy- still, so many mergers stumble...

6 hours ago by francisabigail on Ariba buy parks SAP on Oracle's cloud turf
apexwm

All of the feedback regarding using a touch monitor for a desktop PC is right on. Several months ago, we installed a "demo" multitouch all-in-one...

11 hours ago by apexwm on Windows 8 could speed multi-monitor uptake
191706

anyone wanting to triple boot *their* own Mac

12 hours ago by 191706 on xTreme Triple Booting: Linux, Mac & Windows
SoapyTablet

Cont.. Biggest Bugbear: Win7's stop-animate-go approach to work, you develop a staggered (not in the above alchohol sense of the word) approach to...

12 hours ago by SoapyTablet on Windows 8 could speed multi-monitor uptake
SoapyTablet

Ah the joys of Windows 8 Consumer Preview... If Windows 7 was 'Vista with Lipstick', whats Windows 8? Vista with Lipstick, the morning after?...

12 hours ago by SoapyTablet on Windows 8 could speed multi-monitor uptake
daveveej

Though the metro look is quite cool on the windows mobile platform I think that think that microsoft ARE MESSING THINGS UP because what has they...

13 hours ago by daveveej on Windows 8 could speed multi-monitor uptake
Custonian

I agree, we have a few touch screen monitors in work but as Windows7 and the applications we use are not touch screen friendly (the size of the...

13 hours ago by Custonian on Windows 8 could speed multi-monitor uptake
archerthom

I find it amusing that Microsoft added the mouse, which was deemed awkward, but people were forced to use it so it stuck, and now they're saying,...

15 hours ago by archerthom on Windows 8 could speed multi-monitor uptake
BrownieBoy

Agree with other comments. Nobody's going to start reaching out to start tapping their desktop monitors with their fingers. Their arms would tire...

24 hours ago by BrownieBoy on Windows 8 could speed multi-monitor uptake
Random_Error

The only way a touch monitor would be any good is if it were horizontal on the desk, with a virtual keyboard so you could do away with that as well...

1 day ago by Random_Error on Windows 8 could speed multi-monitor uptake
JBDragon

This is just dumb! Forget that I think Windows 8 will bomb, but really, people are going to go out and buy touch Monitors now??? Just pretend...

1 day ago by JBDragon on Windows 8 could speed multi-monitor uptake
Jake Rayson

@Andy Bolstridge > Unfortunately, we need the majority to work 9-5 And therein lies the lie. I work very hard indeed for my idleness, early starts...

1 day ago by Jake Rayson on The Idle Self-employed
Burn-IT

What happens when one hosting platform "acquires data" from another? If I forced the first one to remove it, who is responsible for chasing the...

2 days ago by Burn-IT on Google picks holes in EU's 'right to be forgotten'
JohnTalich

iSpring Pro is a nice tool, that allows PowerPoint to SCORM conversion. They also have free tool, that also generates SCORM compliant courses.

2 days ago by JohnTalich on How To Convert PowerPoint To SCORM Compliant Course
aaron.sloman

I think the answer to the question requires a deeper analysis of where the income can come from who else is now competing for it, who else will be...

2 days ago by aaron.sloman on The three big questions about Facebook's IPO
Brent Pieczynski

Your correctness about Government websites not being compliant with their own websites is correct. Most criticism of other people takes so many...

2 days ago by Brent Pieczynski on Privacy watchdog to chase big companies over cookie law
Kelvyn Taylor

802.11ac does promise some tricks to improve range & reliability, but not sure how these will work in practice until I get real products to play...

2 days ago by Kelvyn Taylor via Facebook on Next-generation 802.11ac routers
mrudang009

My wife and I love our new Kindle Fire. It's lightweight, easy to use and has a great interface. The first thing I recommend anyone with a new...

2 days ago by mrudang009 on Waterstones to sell Kindles with in-store offers
mrudang009

It basically unlocks all the Android marketplace apps and unlocks the device. I am one very happy Kindle owner!

2 days ago by mrudang009 on Waterstones to sell Kindles with in-store offers