Linked by Thom Holwerda on Fri 27th Oct 2006 18:53 UTC, submitted by mcsimpson
Benchmarks "On Monday I posted Geekbench results for my Sun Ultra 20 M2 running Solaris and Windows. Afterwards, I received a number of requests asking how Linux performed on the same hardware. Now that I've finally managed to download Fedora Core 6, here are the Geekbench results for Fedora Core 6 (and Solaris, as a comparison) on a Sun Ultra 20 M2."
Order by: Score:
Solaris and Linux have nothing to do with it
by Wes Felter (2.76) on Fri 27th Oct 2006 19:20 UTC
Wes Felter
Member since:
2005-11-15
Fans: 1

This is actually a Sun Studio vs. GCC compiler test. BTW, Sun Studio compilers are available on both Solaris and Linux.

helf Member since:
2005-07-06
Fans: 11

yeah, it seems that most of the 'os vs os' benchmarks are really compiler benchmarks. what gives?

Ronald Vos Member since:
2005-07-06
Fans: 0

yeah, it seems that most of the 'os vs os' benchmarks are really compiler benchmarks. what gives?

If I look at what Geekbench does, it seems to be very primary operations, and simple system-calls.

rcsteiner Member since:
2005-07-12
Fans: 2

GCC is also available on Solaris. It's what I'm using here under Solaris 2.9, in fact. :-)

nalf38 Member since:
2006-09-01
Fans: 0

Either way, I'm impressed. In the benchmarks from the previous Solaris/Windows test, Solaris slammed WinXP in just about every category, and in this set of benchmarks, it looks like Linux is a real competitor. I'm sure they're out there, but I'd like to see the same set of benchmarks for Linux vs Winxp and Vista.

sbenitezb Member since:
2005-07-22
Fans: 2

" it looks like Linux is a real competitor"

I would say Solaris is a real competitor.

Babi Asu Member since:
2006-02-11
Fans: 1

" it looks like Linux is a real competitor"

I would say Solaris is a real competitor.


You may think linux super in desktop area though only has .4% market share. But in server area, linux is just a toy box. Proprietary unix like Solaris, SGI, HPUX, AIX, XENIX, etc, and FreeBSD were out there for a long time. Recently Solaris goes open source, so people can compare it with linux.

nalf38 Member since:
2006-09-01
Fans: 0

Well, Solaris x86 has been out there for much longer than Linux has, and you'd think with all the dough they've poured into it, that it would be the absolute best of breed.

So I agree with you that Solaris is a real competitor, but I think the underdog is Linux, with less time to mature and (theoretically) less centralized corporate involvement.

drdoug Member since:
2006-04-30
Fans: 0

Well, Solaris x86 has been out there for much longer than Linux has, and you'd think with all the dough they've poured into it, that it would be the absolute best of breed.

If this graph http://upload.wikimedia.org/wikipedia/en/0/0e/Unix.svg is to be believed, then Linux pre-dates Solaris 2.x (not only x86). I think the earliest Solaris x86 was release for version 2.4 in 1994.

CodeMonkey Member since:
2005-09-22
Fans: 0

Even if it is primarily depending on the compiler, I think that this is still very appropriate. As is the benchmark will reflect the relative performance of the common configurations of the 2 operating environments. When people install Solaris, chances are they'll be using the SUN compilers. When people install Linux, chances are, they'll be using GCC. Sure you can use GCC on Solaris and Sun Studio on Linux, but I would venture to say that most people don't.

Linux kernel very impressive
by nick (2.08) on Sat 28th Oct 2006 13:18 UTC in reply to "RE: Solaris and Linux have nothing to do with it"
nick Member since:
2006-04-17
Fans: 0

Yes, I never realised the Solaris compiler was so far ahead of gcc on x86, let alone SPARC. So I found these compiler benchmarks very interesting.

This makes the Linux kernel all the more impressive when you see results like these, IMO.

http://www.stdlib.net/~colmmacc/2006/04/13/more-ubuntu-on-t2000/

Although the kernel may not tend to benefit so much from compiler optimisations as things like these benchmarks, it wouldn't be unlikely to get at least another 5% or so on the above test.

jimveta Member since:
2006-09-21
Fans: 0

I would think that the OS would definitely have some part in the multi-threaded tests, wouldn't you?

Wes Felter Member since:
2005-11-15
Fans: 1

Yes, looking at the FAQ, the multi-threaded tests have four threads and this test was run on a 2-core system so there will be some context switching. However, I suspect the impact of the OS is much smaller than the compiler; given that the test has two independent variables it's impossible to tell for sure.

Hmm interesting ...
by poohgee (2.48) on Fri 27th Oct 2006 19:32 UTC
poohgee
Member since:
2005-08-13
Fans: 0

Always interesting to see numbers ;)

This reminds me of the quote I read a while ago on LWN from Linus .

Saying something along the line of : If you want something implemented in Linux just post the benchmark showing that Solaris is better at it ;)

A link to what these tests kind of do :

http://www.geekpatrol.ca/geekbench/benchmarks/

RE: Hmm interesting ...
by diegocg (4.96) on Fri 27th Oct 2006 19:56 UTC in reply to "Hmm interesting ..."
diegocg Member since:
2005-07-08
Fans: 4

Geekbench uses a number of different benchmarks to measure system performance

Integer benchmarks measure integer performance by performing a variety of processor-intensive tasks that make heavy use of integer operations

Floating point benchmarks measure floating point performance by performing a variety of processor-intensive tasks that make heavy use of floating-point operations.

Memory benchmarks measure both memory hardware and memory library performance

Stream benchmarks measure both floating point performance and sustained memory bandwidth.

Indeed, and if you look at all the geekbench benchmarks it's clear that its propose is to compare "systems", aka "different machines with different hardware". The benchmarks are compiler-biased, which is great to compare different systems running the same OS, but not two different OSes running diffrent compilers. the one remotely interesting benchmark seems to be the "memory benchmarks", which measure stdlib performance (aka, libc)

I'm amazed at how good is the sun compiler in many cases, BTW.

Edited 2006-10-27 19:59

Why Fedora Core?
by Robert Escue (2.04) on Fri 27th Oct 2006 19:34 UTC
Robert Escue
Member since:
2005-07-08
Fans: 5

Why does John and Matt use Fedora Core as a target when they could use CentOS or a similar "release quality" Linux distribution? If nothing else it would eliminate the "it's beta software" comments that will probably appear as people read and interpret the results.

Or, they could benchmark Fedora Core against a recent Solaris Express build and try to level the playing field.

More information on how the system was setup with each OS and compile options would be helpful as well.

RE: Why Fedora Core?
by Ronald Vos (1.64) on Sat 28th Oct 2006 14:07 UTC in reply to "Why Fedora Core?"
Ronald Vos Member since:
2005-07-06
Fans: 0

Why does John and Matt use Fedora Core as a target when they could use CentOS or a similar "release quality" Linux distribution?

Calling Fedora Core 'beta software' is going to rub the people behind FC very wrongly. ;)

What the...
by Tuishimi (2.72) on Fri 27th Oct 2006 19:43 UTC
Tuishimi
Member since:
2005-07-06
Fans: 4

What the hell is up with that stdlib allocate score!!!

Overall it looks like Solaris is the better performer, but I wish more data was provided to explain WHY... as in what are the code differences between the two that would account for the differences.

The other score I found interesting was the bzip test. Would it have anything to do with disk performance in that case? How does Geekbench generate the scores, are they all time-based? Yeah, I could go and read the geekbench docs I reckon... but a quick blurb about this stuff would have been extra nice.

Hmmm...
by rcsteiner (2.92) on Fri 27th Oct 2006 19:45 UTC
rcsteiner
Member since:
2005-07-12
Fans: 2

I'm using gcc 2.95.3 under SunOS GUTUX09 5.9 Generic_118558-09 sun4u sparc SUNW,UltraAX-i2.

I wonder if this will let me post?

Browser: Links (0.99pre6; SunOS 5.9 sun4u; 124x53)

Browser test.
by rcsteiner (2.92) on Fri 27th Oct 2006 19:51 UTC
rcsteiner
Member since:
2005-07-12
Fans: 2

Using Links 0.99pre6 with the User Agent changed to see if it will allow me to respond in place in a thread.

The strange thing is, even though we do development work on Solaris, our systems group won't allow us to use the Sun development tools at this point. Weird, huh?

They've been using gcc here since well before Sun's tools were free, so that explains part of it...

Somebody send me a decent Sun box, please
by ormandj (4) on Fri 27th Oct 2006 19:52 UTC
ormandj
Member since:
2005-10-09
Fans: 6

I'm getting really tired of these non-sense benchmarks. All these comparisons always test the wrong things. With the almost hatred between OS camps, it's *amazing* to me that there are VERY few decent comparisons between the OSs in real-world tasks.

Somebody send me a Sun box that can run Solaris and Linux, and I'll put it through some REAL paces. You know, webserving, database work, etc. I can't believe people have yet to do respectable benchmarking, it's not exactly rocket science.

whartung Member since:
2005-07-06
Fans: 0

Somebody send me a Sun box that can run Solaris and Linux, and I'll put it through some REAL paces. You know, webserving, database work, etc. I can't believe people have yet to do respectable benchmarking, it's not exactly rocket science.

http://www.sun.com/tryandbuy/

There ya go. I eagerly await your report.

Can I look for it in, say, about a month?

ormandj Member since:
2005-10-09
Fans: 6

We're utilizing that program for testing production operations, and they can't be dedicated to benchmarking against linux boxes at this point (we have no interest in running linux, and cannot spare the try-before-buy boxes to benchmarking.)

Again, I'll make it clear. Heck, if anybody in Hawaii has a Sun box sitting around, I'll gladly travel to your location and give it a go. Or, you're welcome to come by my data center and set it up in there.

I do appreciate your sarcasm, however, bravo.

ahmetaa Member since:
2005-07-06
Fans: 1

i just noticed they are actually talking about YOU! haha. sorry for the whole misunderstanding

ormandj Member since:
2005-10-09
Fans: 6

It's ok. ;) And yes, they are discussing me.

sbenitezb Member since:
2005-07-22
Fans: 2

" I can't believe people have yet to do respectable benchmarking, it's not exactly rocket science"

Well, most benchmarks are useless and don't really represent the real world. You should build a real world application that makes a good and fair use of OS facilities to test performance. Even then, what works best for you would not work well for others. So it's rather poinless. Look, most business are using Windows as their platform with all its problems of performance and security.

Explanation sorely needed
by spacebubble (3.5) on Fri 27th Oct 2006 19:55 UTC
spacebubble
Member since:
2006-10-24
Fans: 0

What is needed with any benchmark is an explanation of why the results are a certain way. It as far as I can tell, the GeekBench focuses on integer/floating point/memory bandwidth tests which do not depend very much on operating system structure and depend a lot on compiler quality. If the GeekBench was benchmarking I/O performance, then it would be a more appropriate measure of operating system performance.

Why would the raw integer/floating point performance be different under Windows vs. Solaris vs. Linux? What part of the operating system affects this?

v Memory = 512MB
by NotParker (-2) on Fri 27th Oct 2006 21:22 UTC
Worst. Benchmark. Ever.
by Shaman (2.76) on Fri 27th Oct 2006 22:02 UTC
Shaman
Member since:
2005-11-15
Fans: 0

Let's see... benchmarking a cross-platform C compiler on a beta operating system (designed for testing components for their enterprise version) against a full release OS and C compiler targetted directly at the hardware it's running on and designed for production use.

Yeah. That's a great benchmark. "For me to POOP ON!" - Triumph

RE: Worst. Benchmark. Ever.
by ahmetaa (2.52) on Fri 27th Oct 2006 22:07 UTC in reply to "Worst. Benchmark. Ever."
ahmetaa Member since:
2005-07-06
Fans: 1

Well, why don't you make a better comparison then.