SHARE
Facebook X Pinterest WhatsApp

Benchmarking: Time for Vendors to Get a Clue

Written By
HN
Henry Newman
Nov 29, 2011

[ Thanks to Amy Newman for this link.
]

“Weekly and sometimes daily benchmarks claiming that a given
vendor has surpassed other vendors on XYZ I/O benchmark provides
little useful information. Most benchmarks tell us:

“1. How much hardware the vendor can fit (and I really mean
stuff) into the box it is trying to benchmark

“2. How good the benchmark team is at optimizing the software
(OS, file system, network stack, firmware for all hardware) and the
hardware

“3. How much time and money the company will want to spend
running case after case to achieve the results it wants

“You might ask how I know this, and the answer is that 1996, I
was part of a team that benchmarked some hardware, OS and file
systems to achieve 1 GiB/sec. At the time that was huge. Back then,
we got 60 percent of the performance needed with 50 percent of the
hardware, so we were not scaling very well.

“Fast forward to today, and nothing has changed.”


Complete Story

HN

Henry Newman

Recommended for you...

Red Hat reveals major enhancements to Red Hat Enterprise Linux AI
sjvn
Oct 22, 2024
How to Find AWS EC2 Instance Type Over SSH (6 Methods)
Benny Lanco
Sep 23, 2024
Crond: Daemon to Execute Scheduled Commands
Rose Hosting Blog
Sep 20, 2024
A Detailed Introduction to Oracle VirtualBox
Senthil Kumar
Sep 19, 2024
Linux Today Logo

LinuxToday is a trusted, contributor-driven news resource supporting all types of Linux users. Our thriving international community engages with us through social media and frequent content contributions aimed at solving problems ranging from personal computing to enterprise-level IT operations. LinuxToday serves as a home for a community that struggles to find comparable information elsewhere on the web.

Property of TechnologyAdvice. © 2025 TechnologyAdvice. All Rights Reserved

Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.