"In a past column, I talked about programming large numbers of
cluster nodes. By large, I mean somewhere around 10,000. If you
have been following along, at the end of the article I had promised
to mention some real alternatives to MPI and even suggest some wild
ideas. I plan to keep my promise, however, I wanted to take a
slight detour this month and develop the solution a bit further.
One point of note before we begin. To keep things simple, I will
refer to cluster nodes as if they were a single processing
"As you may recall, my conclusion was based on the notion that
dependence on large numbers of things increase the chance that one
of them will fail..."