Computer Benchmarks and Other Baloney: Don't Expect 2-4x Performance from Intel Macs
- 2006.02.06 - Tip Jar
First published in Business in Vancouver/High Tech Office column
Benjamin Disraeli is famous for claiming there were three kinds of lies: lies, damn lies, and statistics. In the High Tech Office we may want to replace "statistics" with "benchmarks".
The idea behind computer benchmarks is noble - to have an objective test making it possible to compare different models of computer hardware independent from the software each is running. The problem is that no one runs a computer without software, so benchmark data offers at best a fun-house reflection of the real world.
On January 10th, Apple CEO Steve Jobs announced his company's first Macintosh models built using Core Duo processors from Intel. He boasted of benchmark tests showing the new models to be anywhere from twice to four times as fast as their PowerPC-powered predecessors.
While Jobs did the right thing of pointing out that real-world performance might not be quite so fast, most of the media ignored the fine print and highlighted the promise of super-speed.
The first Intel-powered Macs are now making it into consumers' hands, and we're getting to see the difference between benchmarks and reality.
I recently helped a colleague set up his new Intel iMac and was able to compare it to last year's (PowerPC-powered) model. A few things to note:
As the name "Core Duo" suggests, the new Intel CPU has two processor cores in a single unit. This promises twice the performance of a single CPU, which is reflected by the benchmark tests. But users will only see improvement on applications that have been written for multithreading, the ability to divide tasks between the two processors. Applications without multithreading won't see much, if any, improvement.
A computer processor's speed and power gets all the hype, but it's only one factor in the performance a user actually sees. Hard drive and memory access speed and video capabilities all affect real-world performance. The new iMacs have improvements in these areas, but nowhere near the 2x-4x speed improvements being touted.
For best performance, software code needs to be compiled into programs that are optimized for the hardware. Apple has reworked its operating system and many of its own programs to make good use of the new Intel processors, but most third-party software, including commonly used programs like Microsoft Office and Adobe Photoshop, have not yet been updated for the new hardware.
Intel Macs can run these older programs using built-in translation software called Rosetta, but the translation comes with a speed penalty. These programs feel sluggish, seeming to run at about half the speed they would on a recent-generation PowerPC iMac.
The result: The new hardware runs software optimized for it faster than the models they replace, but it runs other programs slower than last-year's models.
What's more, PowerPC Macs running the OS X operating can also run 1990s-era Mac software in so-called Classic mode. The new Intel Macs can't run Classic mode software at all.
Many Mac users, needing access to the odd Windows program, run a PC-emulator such as Microsoft Virtual PC; these emulators currently don't run on the Intel Macs. And while the Intel-powered Macs use the same sort of processors used in Windows PCs, it's proving to not be easy to get them to boot to PC operating systems like Windows or Linux.
In a few months, more software will support the new Intel-powered Macs; at that time, users should see the promise of blazing performance fulfilled. In the mean time, anyone buying a new Mac in order to see the super-speed promised by the benchmark tests is going to be sadly disappointed at the speed of their older software.
Alan Zisman is Mac-using teacher and technology writer based in Vancouver, BC, Canada. Many of his articles are available on his website, www.zisman.ca. If you find Alan's articles helpful, please consider making a donation to his tip jar.
Other articles by Alan Zisman
- Upgrading to a Solid State Drive Rejuvenates My 4-Year-Old MacBook, 2012.09.04. Booting the MacBook and launching apps is 4x to 10x as fast with the SSD as with its old 512 GB hard drive.
- Apple's G5 iMac: Wonderful in White, 2012.08.31. The iMac G5 introduced a bold new all-in-one design along with G5 processing power.
- Is There Such a Thing as Ethical Technology?, 2012.08.30. As it has grown, Apple has become a focus for the ethical technology movement, which looks at green energy, labor practices, recyclable and nontoxic materials, and more.
- More in the Mac 2 Windows index.
Links for the Day
- Mac of the Day: Centris 610, introduced 1993.02.10. This was the Mac we used when we started Low End Mac in 1997.
- May 24 in LEM history: 99: Mac sales up, iMac sales down? - 01: Speeding up digital photography - 02: The Internet, research, and plagiarism - 04: NewerTech TiBook battery - Optical mice from Contour - 06: Power Mac today or Intel tomorrow? - 07: G5: Apple's last fling with PowerPC - G3: From 233 MHz to 1.1 GHz
- Support Low End Mac
Recent Content on Low End Mac
- World Book Encyclopedia 2012 DVD, Tommy Thomas, Reviews, 2013.03.05. "You may be asking yourself, in an age of Wikipedia and instant information, is World Book still relevant?"
- Vintage Computer Festival SouthEast, April 20-21, 2013, Simon Royal, Mac Spectrum, 2013.02.25. Old Apple gear and old PCs.
- iMessage: The Ultimate Messaging Service?, Simon Royal, Mac Spectrum, 2013.02.21. In most ways, Apple's iMessage is far superior to BlackBerry Messenger.
- More links in our archive.
- Best Mac mini Deals
- Best 13" MacBook Pro Deals
- Best Intel iMac Deals
- Best iPod touch Deals
- Best iPhone Deals
- Best iPod nano Deals
- Best iPod classic Deals
- Best Apple TV Prices
- More deals in our archive.
Low End Mac Reader Specials
Cult of Mac
Shrine of Apple
The Mac Observer
Accelerate Your Mac
The Vintage Mac Museum
Mac Driver Museum
System 6 Heaven
System 7 Today
the pickle's Low-End Mac FAQ