Processing 10000 Pictures Using Many Computers With Oropo (Debian/Ubuntu)
Apr 28, 2010, 12:03 (1 Talkback[s])
[ Thanks to Falko
Timme for this link. ]
"Have you ever had a lot of data to process ? In such a
moment after a while of processing we realize that it will take
ages to complete. It would be faster if we could use two or three
or even more computers. Let's use some computers - you think it is
a lot of configuration ? You are wrong. With Oropo it's easy. Let's
"It's difficult to talk about processing without an example.
Let's discuss a problem of processing large number of pictures.
First approach for solving this problem is to process pictures
sequentially on one computer. Second approach is to process
pictures parallelly on many computers.
"The problem is to process 10000 pictures. Each picture is in
hight quality, the goal is to create a smaller version of each one.
There is a library libjpeg that provides suitable programs."