Windows IT Pro is the authoritative and independent resource for windows nt, windows 2000, windows 2003, windows xp. Features a collection of resources and magazines for windows IT professionals.
  
  
  Advanced Search 


October 11, 2005

SuperFetch: Windows Memory-Caching Gets Intelligent

RSS
Subscribe to Windows IT Pro | See More Products / Software Articles Here | Reprints | Or get the Monthly Online Pass—only $5.95 a month!

One of the demonstrations Microsoft performed at Professional Developers Conference (PDC) 2005 last month caught my eye, mostly because of its improbability. Jim Allchin, Microsoft's co-president of the Platform Products & Services Division, demonstrated how a feature called SuperFetch would more intelligently cache memory in Windows Vista and Longhorn Server, leading to vastly improved performance and efficiency when compared with today's Windows versions. Why do I think this is improbable? He also demonstrated how inserting a standard USB memory stick in a Vista or Longhorn Server-based PC would effectively extend the amount of virtual memory available to the system, further increasing performance. Chicanery, I thought.

Maybe not. In a recent briefing with Gabriel Aul, a group program manager in the Windows Division at Microsoft, I learned that SuperFetch is a potential paradigm shift, if you'll excuse my use of that tired word, which will extend the life of aging corporate PCs and notebooks and improve performance for virtually all Windows users.

In today's versions of Windows, a technology called the Windows Prefetcher performs simple memory caching in a bid to improve overall system performance. The Prefetcher uses available system RAM to cache, or prefetch, memory pages that it believes the user will need in the future. The goal is to reduce unnecessary disk access because random disk I/O is one of the most obvious performance bottlenecks on a typical PC. "To get the disk out of the way," Aul told me, "the Prefetcher precaches the data it thinks you will need. That way, the disk read operation won't be necessary."

Windows XP's Prefetcher performs this service for a wide variety of file types, including Windows Explorer, the Windows boot files, and others. But Prefetcher has some limitations. If you run several memory-intensive tasks (e.g., games, graphics editing, video editing) all of those cached memory pages will be pushed out to the disk-based page file. So when you go back to a cached task, the system has to read them back from disk, thus obviating any performance benefit.

Logically speaking, Vista's SuperFetch is the next version of the Windows Prefetcher. Like its predecessor, SuperFetch caches often-used files so that you can access them more quickly in the course of a typical work session. But SuperFetch is more efficient than Prefetcher. First, it tracks how often you access certain memory pages and over time will develop profiles of the applications you use. "These profiles include fairly complex patterns," Aul told me. "It learns that you can use different applications on weekdays and weekend days, for example, and tracks [PC] job and computer use changes." The net result is that when a memory-intensive task pushes cached memory pages out, SuperFetch will monitor operations and pull the pages back in as soon as possible to avoid a disk-intensive slowdown when you go back to using more commonly accessed applications.

Consider a typical scenario: Perhaps your IT department schedules automated tasks to run when you're not working, such as at lunchtime or overnight. These tasks won't typically be cached but could push the memory pages of your cached applications to disk. When you return to work, things aren't as snappy as they were. But with SuperFetch, you won't notice any difference. Your PC, effectively, will be as snappy as ever, as often as possible.

And what about that USB memory stick demonstration? Aul tells me that the company will let people use virtually any USB 2.0-based flash drive as a scratch buffer between your main system RAM and the hard disk. "We're not extending your system RAM with a flash drive," Aul said, "and it's not increasing virtual memory. Instead, we're creating dedicated scratch space for SuperFetch." Here's the theory: Although a typical USB flash disk isn't as fast as system RAM, it's many times faster than your hard disk, especially for random I/O (Aul tells me that it can be 20 times faster in a worst case scenario).

When you first plug a USB flash disk into a Vista PC, the system will ask whether you'd like to dedicate part of its memory space to SuperFetch (this feature isn't available in the current September 2005 Community Technical Preview--CTP--build, but will be included in the next public release, due this month). The memory you allocate to SuperFetch will be compressed and encrypted so it's secure and can't be used on other machines. And it's double-buffered to disk, so there are no reliability problems. "You can pull it right out and use it like a typical USB stick on another PC if you'd like," Aul noted.

Microsoft sees the USB flash drive solution as being a key benefit to notebook users, road warriors, and anyone who has a PC to which they can't easily add RAM. "You can use one or two USB keys on a notebook and get a massive performance improvement, even if you aren't able to upgrade the RAM," Aul said. But it's also a great desktop PC enhancement because you can get an instant speed boost by using a device that would otherwise go unused when you were at the desk. Just plug it in and get an instant performance boost.

The technology has a few limitations. You can't use one key in two or more PCs: Once you've partnered the USB flash drive with a PC, it's locked to that PC. That means you can't use a single USB flash drive for both a desktop and a notebook PC. Also, the benefits are most obvious in the 512MB to 1GB of system RAM range. If you have more than that amount, SuperFetch will simply use your faster system RAM to cache application memory pages. If you have less RAM than that, you probably shouldn't be running Vista anyway.

I'm eager to give SuperFetch and the USB flash drive feature a test drive. In the meantime, it seems like an exciting new addition to the ever-increasing Windows feature set. I'll let you know how it works in the real world when I see the next CTP build.

End of Article



Reader Comments

You must log on before posting a comment.

If you don't have a username & password, please register now.




Top Viewed ArticlesView all articles
Friday at PASS Europe 2006

Kevin talks about the closing day of the event and shares a funny Microsoft film. ...

Windows Mobile: What Went Wrong?

Paul discusses the evolution of Windows Mobile and why he thinks the platform is probably doomed. ...

Microsoft Makes Windows 7 Name Official

It's official: Microsoft's next Windows version, currently being developed under the codename Windows 7 will use that moniker as its official final name when it hits the market in early 2010. The news, delivered as is so often the case these days via a ...


Storage Whitepapers Combining Deduplication and VMware Disaster Recovery: Cascading Savings Improves Cost Effectiveness

Virtualizing Microsoft Exchange Server 2007

StoreVault SnapManagers for Microsoft Exchange and SQL Server

Related Events Check out our list of Free Email Newsletters!

Storage eBooks A Guide to Windows Certification and Public Keys

SQL Server Administration for Oracle DBAs

Keeping Your Business Safe from Attack: Encryption and Certificate Services

Related Storage Resources Become a VIP member of the Windows IT Pro community!
Get it all with the VIP CD and VIP access. A $500+ value for only $279!

Subscribe to Windows IT Pro!
Solve your toughest technical problems with our experts and access 10,000 + articles online. 30% off

Monthly Online Pass - Only $5.95!
Get instant access to 10,000+ articles from Windows IT Pro Magazine!

TechNet Virtual Labs
Evaluate and test Microsoft's newest products.

Job Openings in IT


ADS BY GOOGLE SPONSORED LINKS FEATURED LINKS

Microsoft Exchange & Windows Connections event returns to Las Vegas Nov 10 - 13
Connections returns to Las Vegas for this exciting event where each attendee will receive SQL Server 2008 standard with 1 CAL. Co-located with Microsoft ASP.NET, SQL Server, and SharePoint Connections with over 250 in-depth sessions.

Free Online Event! Virtualization:Get the Facts!
Register now and attend this free, live in-depth online conference on November 13 and 20, 2008, produced by Windows IT Pro. All registrants are eligible to receive a complimentary one-year digital subscription to Windows IT Pro (a $49.95 value)!

Check Out Hyper-V Video on ITTV
Watch Karen Forster's interview on Hyper-V's performance on ITTV.net.

Ease Your Scripting Pains with the Flexibility of PowerShell!
Join MVP Paul Robichaux on December 11, 2008 at 11:00 AM EDT as he equips you with PowerShell basics in 3 introductory lessons, each followed by a live Q&A session—all on your own computer!

PASS Community Summit 2008 in Seattle on Nov 18-21
The don’t-miss event for Microsoft SQL Server Professionals. Register now and you’ll enjoy top-notch Microsoft and Community speakers and more.



Order Your SQL Fundamentals CD Today!
Learn how to use SQL Server, understand Office integration techniques and dive into the essentials of SQL Express and Visual Basic with this free SQL Fundamentals CD.

Email Recovery and eDiscovery for Microsoft Exchange!
Discover, Recover, and Export mailboxes, folders and individual items direct from offline EDB’s or online production Exchange Servers. Free 30 Day Demo.
Windows IT Pro Home Register FAQ for Windows WinInfo News
Europe Edition About Us Contact Us/Customer Service Media Kit Affiliates / Licensing  
SQL Server Magazine Office & SharePoint Pro Windows Dev Pro IT Job Hound ITTV
IT Library Technology Resource Directory Connected Home Windows Excavator Windows SuperSite 
 
 Windows IT Pro is a Division of Penton Media Inc.
 Copyright © 2008 Penton Media, Inc., All rights reserved. Terms and Use | Privacy Statement | Reprints and Licensing