Signal Ground: The Linux Victory? Q2 SPECWeb99 ResultsJul 06, 2000, 06:14 (7 Talkback[s])
"Yesterday's big news: Linux beat Win2k in SPEC's Second-Quarter SPECWeb99 shootout. The victory wasn't small, either -- Windows/IIS on a quad-Xeon box did only 38% as well as Linux did on nearly the same hardware. Are these meaningless numbers or valuable data? The Signal Ground team discusses the results below."
"Whenever benchmarks -- especially benchmarking results -- are discussed, many members of the Linux community shudder. This scorn is certainly not without reason. Benchmarks are an attempt to reduce huge amounts of data to a small, comprehensible quantity (sometimes even a single number). Any time such a transformation is performed, data is lost. Choices have to be made regarding weights to assign to different characteristics."
"Yet benchmarks are a powerful tool, both for the understanding of complex systems and for the sales of the same. Marketoids know the power such numbers hold, and they quote benchmark tests at every opportunity to win dollars from business decision-makers. Everybody quotes the benchmarks when they're favorable."