Optimise NTFS performance in Windows servers

Daily Newsletters

Sign up to ZDNet UK's daily newsletter.

ANALYSIS
At the heart of your Windows NT or Windows 2000 server's file system is NTFS, short for the NT file system, the default file system for Microsoft Windows NT and 2000. NTFS controls where Windows NT/2000 locates files on the server's hard drive. It also controls security and access privileges for those files. To get the most out of your server's hard drives, you must take NTFS into consideration. I'm going to show you how to wring the last drop of performance out of NTFS. I'll consider the importance of defragmentation, compression, naming schemes, and folder structure. Optimising and improving NTFS NTFS includes several features that can increase the performance of your system's hard disks:
  • Cluster sizes -- This is the size of units of allocation on a hard disk.
  • Standard defragmentation -- This rewrites the contents of noncontiguous data into contiguous sectors on the disk to increase read/write performance.
  • MFT defragmentation -- The Master File Table (MFT) contains information about all the files and data stored on disk.
  • Compression -- NTFS can compress files and folders stored on disk to an optimal size, maximising the available storage space.
  • Naming configurations -- This represents the naming conventions you use when naming files and folders on your server.
  • Folder structure -- This is the number of folders and subfolders and the number of files within those folders.
In the following sections, I'll show you how to use these features to tweak the performance of your server's hard disks and improve the overall performance of your network. Cluster size does matter Clusters are chunks of disk space used to organise data on a disk. The default cluster size is the smallest block of disk space that can hold a file. Versions of Windows NT later than version 3.5, including Windows 2000, won't use cluster sizes larger than 4KB for hard drives smaller than 16Terabyte (TB). This helps minimise the amount of overhead used to contain the file. When a file is stored on a disk, it's written into clusters. If the file being stored exceeds the cluster size allocated to it, the file system uses additional clusters to store the file, consuming clusters until the file is stored. Naturally, files almost never fall neatly into multiples of 4KB. So when the file system uses additional clusters, the unused portion of the last cluster is lost to overhead. For example, suppose that you have a 35KB file on your hard disk. The largest cluster size available is 4KB. Therefore, the file will use a total of nine clusters. Eight of those clusters will be a full 4KB in size. The ninth cluster will contain only 3KB of data, leaving 1KB completely wasted. If you had to store a thousand 35KB files, you'd lose 1MB of drive space. Microsoft has developed an algorithm to estimate cluster size overhead. On the typical disk partition, the overhead algorithm looks like this: (cluster size)/2 * (number of files) So in the previous example, (4KB)/2 * 1,000, the equation would estimate that you'd lose 2 MB of disk space when you've only actually lost 1MB. The equation is wrong in this case because all of the last clusters are three-quarters full. The equation assumes that the average cluster will be half full. Using smaller cluster sizes reduces the amount of space needed to store files. If you have an application that doesn't consume a lot of disk space but uses very small data files, you can more efficiently store data on a drive with smaller cluster sizes. It is possible to set the cluster size when the drive is formatted (type Format /? from a command prompt for details), but Microsoft recommends that the cluster size is chosen to work with the partition size of the drive, and has set a default cluster sizes for any given partition size. A way to get a given cluster size, and still use the default cluster size is to choose the partition size which makes NTFS default to that cluster size. NTFS default cluster sizes are described in detail here but in summary are broken down as follows:
  • 512 bytes: 0 MB to 512 MB
  • 1KB: 513 MB to 1 GB
  • 2KB: 1 GB to 2 GB
  • 4KB: 2 GB+
So if your application uses small data files, but the total of those data files won't exceed 1 GB, you can more efficiently use your server's drives by placing the data on a drive with a 1 GB partition.

Talkback

Cluster size discussion in this articlue is absolute BS!!!

via Facebook 31 October, 2004 02:50
Reply

Post your comment

In order to post a comment you need to be registered and logged in.

You can also log in with Facebook. Log in or create your ZDNet UK account below

  • Login

Will not be displayed with your comment

By signing up for this service, you indicate that you agree to our Terms and Conditions and have read and understood our Privacy Policy. Questions about membership? Find the answers in the Community FAQ

Get ZDNet UK's daily newsletter

Enter your email address to sign up

ZDNet UK Live

GrueMaster

Nice review and very informative. One thing I'd like to add (in reply to whs001's 1st question), the main reason to have the same interface from...

45 minutes ago by GrueMaster on A tale of two distros: Ubuntu and Linux Mint
Frederick Wrigley

I'be been using Mint 12 since the RC came out, and I am far more happy with the Cinnamon, the Mate, and, yes (with extensions), theGnome 3...

2 hours ago by Frederick Wrigley via Facebook on A tale of two distros: Ubuntu and Linux Mint
bdantas

Excellent article. One small correction, though--although a fresh installation of Linux Mint 12 will, indeed, provide the user with a version of...

2 hours ago by bdantas on A tale of two distros: Ubuntu and Linux Mint
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

3 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Alan Ralph

In related news, the ISPs club together to get the members of the Home Affairs Select Committee (ya goofed on that part, ZDNet UK) copies of "The...

3 hours ago by Alan Ralph via Facebook on MPs urge ISPs to take down terrorist material
Moley

For Gnome 2 die-hards, it is possible to add icons to the bottom panel (or top top panel, if you prefer) which provide the exact Gnome 2...

4 hours ago by Moley on A tale of two distros: Ubuntu and Linux Mint
ramwellian

Your comments would seem pretty naive and immature. Your 'solution' appears to be, "gee, let's all just give in to the hackers and give them...

4 hours ago by ramwellian on Cloud computing security: no more oxymoron?
BugStalker

"Interesting thought ... If you installed Win7 as a dual boot on a machine that previously only had Linux, and it wrecked your Linux installation,...

4 hours ago by BugStalker on Windows 7 Declares War on GRUB
whs001

This is an excellent summary of Ubuntu and Mint and the interface differences between them. Most such articles take a very partisan position for...

4 hours ago by whs001 on A tale of two distros: Ubuntu and Linux Mint
Moley

@ewallace. Not so clear. Anyone can obtain the text, for example from here http://www.ustr.gov/webfm_send/2379. I support ACTA so long as it and...

4 hours ago by Moley on ACTA: Facts, misconceptions and questions
45283

I think WinRT is fantastic. I just wish it was an option for people that didn't want to go through Microsoft's App Store with its attendant...

8 hours ago by 45283 on Why Windows 8 needs architectural hygiene for WOA
Burn-IT

Nine people? £30m? Who's back pocket is that lot going in? And IF they say it is for new buildings, what about all the ones the government has...

9 hours ago by Burn-IT on Police set to launch three £30m e-crime hubs
ewallace

Just to be clear, nobody knows what is in the text of ACTA, here is a photograph of the text of ACTA http://twitpic.com/8h9iju as submitted to the...

9 hours ago by ewallace on ACTA: Facts, misconceptions and questions
fgvrg56

Unfortunately main issue is that ASUS is refusing to accept that they make some mistake on this version of asus Transformer prime. 1 - GPS sensor...

10 hours ago by fgvrg56 on Asus Eee Pad Transformer Prime Wi-Fi & GPS problems?
Ben Woods

@Marcus A fair question. Just talked with Archos which said it was working on an announcement for next week....

11 hours ago by Ben Woods on Archos confirms G9 Ice Cream Sandwich update schedule
Marcus Karlsson

Any update on this, considering the claimed "first week of February"?

12 hours ago by Marcus Karlsson via Facebook on Archos confirms G9 Ice Cream Sandwich update schedule
apexwm

Bill Goodrich : Just as al_langevin pointed out, with Windows Server 2008 there is no Services for Macintosh anymore. It's gone, not available....

20 hours ago by apexwm on Windows Server 2008 drops the ball for Mac compatibility
txtrainguy

Replying to an old topic that I'm currently facing with my CEO (who is on a Mac). Our servers are primarily Windows Servers, office is about...

1 day ago by txtrainguy on Windows Server 2008 drops the ball for Mac compatibility
k0tcs3

Sure, that makes perfect sense. Pay wrong-doers money and thank them for breaching your security and pointing out your flaws, that would surely...

1 day ago by k0tcs3 on US indicts Romanian over NASA climate change hack
Random_Error

I think he's referring specifically to Android apps, as Apple do regulate their App Store, but Google seem to let any old crap onto the Android store!

1 day ago by Random_Error on RIM: BlackBerry will keep 'garbage' apps out of store