Debating 7: Randall Kennedy, Thom Holwerda

Thom,
</p>

<p>
On the subject of benchmarking, if you take a moment to step outside your
personal experience space of gaming and enthusiast computing, you'll
discover that real-world performance means more than frame rates and
3DMarks. It means the ability to process potentially complex workloads
efficiently and without undue penalty from the supporting operating system.
</p>

<p>
This is why Windows XP has lingered so long in enterprise computing
circles while Vista has been soundly rejected: Because Vista placed such an
undue burden on systems that it made it nearly impossible to support the
complex workloads that make up the typical enterprise computing stack.
Simply put, it overwhelmed the hardware available at the time of its launch,
forcing customers to choose between wasting CPU upgrade cycles on
superfluous "features," like DRM and content protection, or putting them to
work improving the performance and end-user experience of their
business-critical applications. And I think we can all agree on where IT
decided to focus those finite resources.
</p>

<p>
Here's a statistic for you: At a fundamental level, Windows Vista is ~40%
slower than Windows XP on common business productivity tasks.
</p>

<p>
This isn't conjecture. It isn't speculation. It's cold, hard fact based on
extensive testing of both OS and their respective recent Service Pack
iterations: Windows XP Service Pack 3 and Windows Vista Service Pack 1.
Here's the original research work that backs this up:
</p>

<p>
http://exo-blog.blogspot.com/2007/11/vista-sp1-performance-dud.html
</p>

<p>
http://exo-blog.blogspot.com/2007/11/windows-xp-sp3-yields-performance-gains
.html
</p>

<p>
http://exo-blog.blogspot.com/2007/11/how-to-make-vista-run-like-xp-sort-of.h
tml
</p>

<p>
Note that I say at a "fundamental level." The truth is that, if you strip
away all of the "Vista" features - disable all the new services (Search,
SuperFetch, MMCS), turn-off all the new UI goodies (Aero, compositing), and
terminate every non-critical process - Windows Vista is *still* 40% slower
than Windows XP. In fact, no matter what you try, you will *never* manage to
tune Vista so that it performs like Windows XP on identical hardware. Never.
It's simply not possible.
</p>

<p>
Why? Kernel complexity. Those extra 39-40 execution threads (96-97, vs.
56-57 on XP) translate into a kind of performance anchor around Vista's
neck, causing even a stripped-down, bare-bones implementation to perform at
degradation levels that approach disabling a core or drop a GB or two of
memory. It's why XP is roughly 18% slower than Windows 2000 (22 additional
kernel threads). And it's also why Windows 7 performs almost identically to
Vista (no significant increase in kernel complexity - yippee!).
</p>

<p>
In fact, if you look at the history of the NT kernel, and you map the
increase in thread count against the decrease in performance (relative to
the previous iteration), you come up with a nice little ratio that fits the
data almost perfectly: For every additional execution thread added to the
kernel, linear performance decreases by from 1 to 1.2%.
</p>

<p>
Again, this isn't speculation. It isn't conjecture. It's an observation
made over several generations of the NT OS, a convenient "rule of thumb"
that has yet to be disproven. And I do hope that both our reader communities
will accept my not-so-subtle challenge to disprove the "kernel thread rule"
by downloading the free tools and resources of the Windows Sentinel project
(www.infoworld.com/winsentinel) and/or the exo.performance.network
(www.xpnet.com).
</p>

<p>
Some more raw data to put things into perspective:
</p>

<p>
http://www.xpnet.com/iworldtest/
</p>

<p>
http://www.infoworld.com/article/08/04/14/16TC-winoffice-performance_1.html
</p>

<p>
So, to wrap up today's lesson:
</p>

<p>
1. Performance means more than gaming and gamer-centric benchmarks.<br />
2. Vista is measurably slower than Windows XP at a fundamental level, just
as XP is slower than Windows 2000 at a fundamental level.<br />
3. Techno sucks - long live Rock & Roll!
</p>

<p>
RCK

78 Comments

  1. 2008-12-02 12:09 pm
    • 2008-12-02 1:17 pm
      • 2008-12-03 8:51 am
    • 2008-12-02 1:27 pm
    • 2008-12-02 3:37 pm
      • 2008-12-03 3:09 am
    • 2008-12-03 8:45 am
  2. 2008-12-02 12:13 pm
  3. 2008-12-02 12:16 pm
    • 2008-12-02 7:30 pm
      • 2008-12-03 1:23 am
        • 2008-12-03 2:09 am
  4. 2008-12-02 12:16 pm
    • 2008-12-02 12:35 pm
    • 2008-12-02 12:35 pm
    • 2008-12-02 3:45 pm
    • 2008-12-04 11:30 am
  5. 2008-12-02 12:25 pm
    • 2008-12-02 7:09 pm
    • 2008-12-03 5:00 am
  6. 2008-12-02 12:43 pm
    • 2008-12-02 1:10 pm
      • 2008-12-02 2:06 pm
  7. 2008-12-02 1:08 pm
    • 2008-12-03 2:10 pm
      • 2008-12-03 3:53 pm
  8. 2008-12-02 1:15 pm
  9. 2008-12-02 1:31 pm
    • 2008-12-03 4:00 pm
  10. 2008-12-02 1:32 pm
    • 2008-12-02 1:44 pm
    • 2008-12-02 5:41 pm
      • 2008-12-02 7:12 pm
    • 2008-12-02 10:13 pm
      • 2008-12-03 11:04 am
        • 2008-12-03 5:33 pm
  11. 2008-12-02 2:38 pm
  12. 2008-12-02 2:38 pm
    • 2008-12-02 3:17 pm
    • 2008-12-02 4:17 pm
  13. 2008-12-02 3:39 pm
    • 2008-12-02 4:02 pm
      • 2008-12-02 5:51 pm
    • 2008-12-02 4:15 pm
      • 2008-12-02 6:48 pm
    • 2008-12-02 5:36 pm
    • 2008-12-02 5:41 pm
      • 2008-12-02 5:46 pm
        • 2008-12-02 7:38 pm
        • 2008-12-02 9:24 pm
          • 2008-12-03 12:56 am
      • 2008-12-03 1:04 am
  14. 2008-12-02 4:46 pm
    • 2008-12-03 1:10 am
  15. 2008-12-02 6:55 pm
  16. 2008-12-02 6:55 pm
    • 2008-12-02 7:32 pm
    • 2008-12-03 12:49 am
      • 2008-12-04 9:33 am
  17. 2008-12-02 7:42 pm
    • 2008-12-03 12:37 am
      • 2008-12-03 10:18 am
  18. 2008-12-02 8:47 pm
  19. 2008-12-02 9:27 pm
  20. 2008-12-02 10:34 pm
  21. 2008-12-02 10:52 pm
  22. 2008-12-03 12:27 am
  23. 2008-12-03 12:33 am
    • 2008-12-03 4:49 am
      • 2008-12-03 11:51 am
  24. 2008-12-03 4:40 am
  25. 2008-12-03 8:25 am
  26. 2008-12-03 10:22 am
  27. 2008-12-03 10:23 am
  28. 2008-12-03 10:56 am
  29. 2008-12-03 9:50 pm
  30. 2008-12-04 4:49 am
  31. 2008-12-04 9:24 am