"How do I find duplicate files in a given set of
directories and delete them using a shell script or a command line
options? How do I get rid of double duplicates files stored in
~/foo and /u2/foo directory?
"You need to use a tool called fdupes. It will searche the given
path for duplicate files. Such files are found by comparing file
sizes and MD5 signatures, followed by a byte-by-byte comparison.
fdupes is a nice tool to get rid of duplicate files."