After Moore's Law
Why Multiple Processors Matter
Dan Knight - 2 November 1999
Low End Mac Reader Specials
Memory To Go Special: New 2008 iMac 2GB $42 / iMac Intel Core2 DUO & MacBook Pro 2GB $36 - 1GB $20. MacPro 8 Core Memory 4GB kit $154 / 2GB kit $94 -- Free shipping available.
Download Typestyler, still the Ultimate Styling Tool for Internet, Print and Video Graphics. Works great in Classic with a Native OS X Version on the way. Free Tryout: www.typestyler.com
LA Computer Company: Specials on AppleCare, iMac's, Apple Batteries and Apple A/C Adapters. Also Great prices on Used Apple Computers. Call 1-800-941-7654 Click Here.
OWC: Juice up your iPod w/NewerTech High Capacity Battery from $19.99 Free Installation Videos for most models. Pro Installation Service w/FedEx Shipping From $57.95 (Battery Included). - www.MacSales.com
Mac users can finally play Party Poker for Mac. Not only that, they can also learn how to play PokerStars for Mac.
Laptop Hardware Provided by TechRestore - Overnight Mac & iPod Repairs.
Compare products like desktop computers, laptops, and LCD TVs side by side! All the information and reviews to make the best purchasing decision for a new cell phone GPS products or MP3 players. The Ciao network makes searching products easy for you.
New MacPro Memory 800Mhz With Apple Spec Heat Sink 2GB $88 / 4GB $138 / 8GB $274 - Click to Maximize your Macs...
Transistor density has been doubling roughly every eighteen months like clockwork for 40 years now. In a nutshell, that's Moore's Law.
Not only has chip density increased, but because of increasing density and an expanding market, prices for the same amount of memory or CPU power continually decrease. (Okay, there are glitches in memory pricing, but over time the trend is more for less.)
Bad news: it can't go on forever.
In fact, as Roy Brander observes in The end of Moore's Law, within ten years we may run up against the laws of physics. At a certain point electrons will freely wander between circuits, so circuits must remain above that minimum size or they will not work reliably.
Exactly where that point and our ability to manufacture circuits end up is probably somewhere in the 0.10 to 0.03 micron range. (Today's newest designs use 0.18 micron elements, so we can still expect at least four times and possibly twenty to thirty times higher density.)
Even if we make breakthroughs in optical computing or quantum computing, we will eventually hit a limit.
Corollaries to Moore's Law
Moore's Law specifically predicts transistor density. Corollaries derived from Moore's Law include:
- cost per transistor drops correspond to density increases
- transistor speed increases as density increases
- CPUs roughly double in power every 18 months
Power is intangible - it isn't just MHz. Sometimes a chip with a slower clock speed can vastly outperform one with a higher speed. Mac users saw this when the 25 MHz 68040 consistently outperformed the 40 MHz 68030 in the "wicked fast" Mac IIfx. We saw it again when the Power Mac G3/233 held its own against the vastly more expensive Power Mac 9600 with a 350 MHz 604e processor.
And we've claimed the same advantage for the G3 (and now the G4) compared with Intel's Pentium line.
But let's first look at CPU speed. If today's processes can eek out a 733 MHz processor (Intel's just-announced Pentium III), and we can expect to reach at least 0.09 micron chips, we could see 3 GHz processors in about three years. Over the following 4-5 years, technology permitting, we would see dies using 0.03 micron traces and achieving speeds of 20-25 GHz.
Those are simply mind-boggling numbers, but if engineers can maintain Moore's Law for another 7-8 years, that's what we'll see. And then we'll finally have all the processor designs on relatively even footing - they'll all run at the same clock speed, so the design efficiencies will clearly show themselves.
The Real World
But it won't necessarily happen. As Brander points out in his article, at a certain point the cost of building the factory (or fab) becomes prohibitive, more than any company or consortium can afford. That could happen within five years.
For the sake of argument, and because it's a very nice round number, let's say the industry achieves 10 GHz in about five years - and can go no further.
What's an industry based on constantly faster, bigger, more power, and lower costs going to do? How can you make a better computer when Moore's Law finally runs into the brick wall of the laws of physics?
You innovate. One way to increase computing power is to put more on the chip: more instruction pipelines, more registers, more specialized circuitry (such as AltiVec). By taking a processor and giving it more execution units, it can do more operations in the same amount of time.
You also improve the instruction set. Some commands on the G4 run twice as fast as on the G3. Chip designers will keep pushing the envelope to optimize each instruction a CPU processes.
And you use a bigger on-chip cache, so the CPU spends less time waiting for data on the relatively slow memory bus. Back in the Mac IIci era, a 32 KB level 2 (L2) cache was huge; today we're seeing Intel and Motorola designs that support a 2 MB L2 cache.
And finally, you abandon the CPU.
The SETI@home Supercomputer
The world's most powerful supercomputer doesn't exist as a single computer. It's the collection of well over a million computers across the globe working on the SETI@home project. At over 6 TeraFLOPs/sec., it puts even the G4 to shame.
Some of today's computers, including some older Macs and clones, support multiple processors. Not a central processing unit (CPU), but multiple processing units (MPUs). Rumors are that Apple will introduce MPU G4 machines next year, possibly at the Macworld Expo in January 2000. Based on efficiencies of the G4 design (see Macintosh CPUs, Part 2), a dual processor G4 system could be more powerful than two single Power Mac G4 computers.
Whether that actually happens or not, adding a second processor will roughly double the computer's performance. With Apple, Motorola, and IBM losing the MHz race to Intel and AMD, a quad-G4/500 system could claim 2 GHz overall speed - and the four AltiVec processors would put it in the 16 GFLOPs range!
Down the road, when we reach the GHz wall, when the engineers have tweaked every instruction, and when each processor has reached a limit on how many pipelines it can reasonably handle, we'll still be able to make our computers faster by strapping on more processors.
Already with OS 7.x Apple had patches (created by Daystar) to support two to four processors. That's vastly improved in OS 9, despite the fact that Apple hasn't produced a dual-processor system since 1997. And the support improves even further when you combine OS X with the expected multi-CPU G4 systems.
Conclusion
Transistor density will stop growing, probably within the next five or ten years. CPU power will probably peak at about the same time, as engineers use every trick in the book to give their processor the edge over the competition.
After that, the only ways to grow a faster computer will be by
clustering multiple computers (as SETI@home does), using multiple
processors, or doing both.
Further Reading
- Computer scientists poised for revolution on tiny scale, NY Times, 11/1/1999 (registration required). Molecular circuits could be 1/100 size of those used in today's chips.
Dan Knight has been using Macs since 1986, sold Macs for several years, supported them for many more years, and has been publishing Low End Mac since April 1997. If you find Dan's articles helpful, please consider making a donation to his tip jar.
Recent Mac Musings
- Tomorrow's Solid State Drives and Notebooks, 09.04. Flash drives are great but have some shortcomings. Some thoughts on building better SSDs and notebooks to use them.
- Looking for a Content Management System That's as Easy as Mac, 08.29. Low End Mac needs to move to a content management system, but the few we've tried just don't cut it for people used to the simple elegance of the Mac.
- MacDrought: 4 Months with No New Macs, 08.27. The most recent Mac update was over four months ago, and the Mac mini has been unchanged for over a year.
- The iMac Legacy: After the G3, 08.15. The G3 iMac influenced the whole industry, but Apple continued to move forward with innovative designs using G4, G5, and Intel processors.
- More in the Mac Musings index.
Links for the Day
- Mac of the Day: Mac LC III, Feb. 1993 - The first LC without compromise: 25 MHz 68030 CPU, 32-bit memory, up to 36 MB of RAM.
- List of the Day: G4 'Books an email list for G4 iBooks and PowerBooks.
- September 8 in LEM history: 99: Big sound from the little iMac - Ethernet alternative to USB drives - 00: Building a back-to-school bundle - 03: 17" 1.25 GHz iMac G4 - My Mac Plus revisited - 06: Inside your notebook's battery - Andy Hertzfeld, software wizard - OS X is a pleasure to use - MacBook random shutdown - Core2 7% faster
Recent Content on Low End Mac
- Anticipation: New iPods Now, New Macs Later, Kev Kitchens, Kitchens Sync, 09.05. The season of new iPods is at hand, but new Macs may wait until 2009.
- Buy a MacBook Now or Wait?, MacBook touch Patents, Samsung X360 Takes on MBA, and More, The 'Book Review, 09.05. Also 20 years of portable Macs, data backup and preservation, universal U-Charge battery charger for Mac 'Books, bargain 'Books from $150 to $2,699, and more.
- Listen to Just the Music with the V-Moda Vibe Earbuds, Tommy Thomas, Welcome to Macintosh, 09.05. Well built, the noise canceling earbuds will let you hear all the nuances of your music without letting through background noise.
- Source of iPhone 3G Problems, Army Uses iPods as Field Translators, Gains with Business, and More, iNews Review, 09.05. Also UK bans iPhone ad as 'misleading', iPhone password easy to bypass, GM to offer radios with USB in 2009 models, weather tracking software, and more.
- Macs Gain Ground in August, Consumers Most Likely to Buy Macs, LaCie USB Speakers, and More, Mac News Review, 09.05. Also migrating Time Machine to a new drive and two new keyboards from Logitech.
- Best iPod touch Deals, Low End Mac Deals, 09.05. Refurb 8 GB, $199; new, $284; refurb 16 GB, $299; new, $370; refurb 32 GB, $399; new, $453.
- Best 15" MacBook Pro Deals, Low End Mac Deals, 09.05. Used 1.83 GHz Core Duo, $999; 2.16, $1,125; new, 2.2, $1,450 after rebate; refurb 2.4, $1,699; 2.5, $1,999; 2.6 Santa Rosa, $1,849; rebates on new.
- Best iMac G4 Deals, Low End Mac Deals, 09.05. Used 15" 700 MHz CD-RW, $279; 800 Combo, $300; 1 GHz $390; 17" 800 MHz SD, $439; 1.25 GHz, $449; 20", $569.
- Overclocking a Mac mini Got Me Hooked on Souping Up Macs, Adam Geller, My First Mac, 09.04. Stories of hot rodding iBooks, G3 iMacs, and PCI Power Macs on the cheap.
- Apple Will Not Abandon Optical Drives, the Mac Drought, Purposeful Mac Acquisition, and More, Dan Knight, Low End Mac Mailbag, 09.04. Also Mac OS X 10.5 on a G4-upgraded Blue & White G3 and problems using a flat panel display with a Quadra 700.
- Only Leopard Runs Routine Maintenance Tasks after Startup or Waking from Sleep, Charles W. Moore, Miscellaneous Ramblings, 09.04. Mac OS X 10.5 runs routine system maintenance scripts as soon as possible after starting up or waking up your Mac. Earlier versions of OS X do not do this.
- Best Mac mini Deals, Low End Mac Deals, 09.04. Used 1.25 GHz G4 SD, $549; 1.42 Combo, $409; new 1.83 Core2 Combo, $569 after rebate; 2.0 SD, $769 after rebate.
- Best 12" PowerBook G4 Deals, Low End Mac Deals, 09.04. Used 867 MHz Combo, no APX, $490; 1 GHz, $550; SuperDrive, $625; 1.5 GHz w/o APX, $660; w/APX, $675.
- Best 17" PowerBook G4 Deals, Low End Mac Deals, 09.04. Used 1 GHz, $779; 1.33 GHz, $799; 1.5 GHz, $859; 1.67 GHz, $910.
- 11 Mac Browsers Compared, Simon Royal, Mac Spectrum, 09.03. The latest versions of Internet Explorer, Opera, Safari, Shiira, iCab, Radon, Firefox, Netscape Navigator, SeaMonkey, Flock, and Camino tested in Leopard.
- Save Internet Radio, USB and Hard Drives, Hardware Manufacturers vs. Linux, and More, Dan Knight, Low End Mac Mailbag, 09.03. Also Mac won't book after cleaning, newer versions of OS X improve wake from sleep, downgrading to OS 8.6, unreadable pages on Low End Mac, and more.
- Another Free POP3 Provider, Recharging a Dead PRAM Battery, Current Kanga Value, and More, Charles W. Moore, Miscellaneous Ramblings, 09.03. GMX email now available in US, Panasonic UJ-841S drive won't burn discs, restoring a dead PRAM battery in a Pismo, and thoughts on Kanga value today.
- Best eMac Deals, Low End Mac Deals, 09.03. Used 700 MHz Combo, $120; 1.25 GHz SuperDrive, $150; 1.42 GHz, $349.
- Best Mac OS X 10.5 'Leopard' Deals, Low End Mac Deals, 09.03. Mac OS X 10.5, single user, $99; 5 users, $140; 10.5 Server, 10 users, $395; unlimited, $850.
- Best MacBook Air Deals, Low End Mac Deals, 09.03. Refurb 1.6 HD, $1,499; new, $1,690 after rebate; refurb 1.8, $1,699; new, $1,919 a/r; refurb 1.6 SSD, $2,099; new, $2,294 a/r; refurb 1.8, $2,299; new, $2,400 a/r.
- Psystar Strikes Back, Countersues Apple, Frank Fox, Stop the Noiz, 09.03. Psystar is trying to paint Apple as a monopoly and force it to license the Mac OS.
- More links in our archive.
About LEM | Support | Usage | Privacy | Contacts
