Net Grabbing and Mirroring Tools | Linux Today

Net Grabbing and Mirroring Tools

Written By
Web Webster
Web Webster
May 9, 1999

By Jeff Alami

Everyone’s experienced it before. You’re downloading an
arbitrary 60 MB file via FTP. For purposes of illustration, let’s
call this file StarOffice. Netscape has 58 MB, and then–bam!–a
timeout cuts off your connection with no chance of restarting. It’s
not a good feeling. Downloading an entire directory structure isn’t
a piece of cake either.

I was having quite a time trying to download the ISO image for
Red Hat 6.0 until I found out about these great Internet
downloading and mirroring tools.

GREED [GPL]

GREED (Get and Resume Elite EDition) is the Linux equivalent of
GetRight on the Windows platform. GREED is probably the best way to
get a single file from an HTTP or FTP source. It offers several
features, including connection retries in the case of a busy FTP
servers, download resumes, proxy support. An X11-based graphical
frontend is in the works.

GREED home
page

GREED
example

Download
GREED 0.8 source

Mirror [Open Source]

Mirror is a tool written in Perl which will fetch an entire
directory hierarchy through the FTP protocol and effectively mirror
it on the client machine. It also checks the size and timestamps on
files already downloaded to avoid downloading files unnecessarily
when doing a mirror update.

Mirror home
page
Download
Mirror 2.9

Wget [GPL]

GNU Wget is a free download utility that lets the user get files
through HTTP or FTP protocols. Wget is especially useful for making
mirrors of FTP sites and Web sites through recursive retrieval. It
works in the background, enabling it to be used without being
logged in. Wget is especially well suited for cron jobs and other
non-interactive tasks.

Wget home
page

Wget
manual

Download wget
(FTP)

Copyright
(C) 1999 Zeta Publications. (Reproduced from Bleeding Edge Magazine)

Web Webster

Web Webster

Web Webster has more than 20 years of writing and editorial experience in the tech sector. He’s written and edited news, demand generation, user-focused, and thought leadership content for business software solutions, consumer tech, and Linux Today, he edits and writes for a portfolio of tech industry news and analysis websites including webopedia.com, and DatabaseJournal.com.

Linux Today Logo

LinuxToday is a trusted, contributor-driven news resource supporting all types of Linux users. Our thriving international community engages with us through social media and frequent content contributions aimed at solving problems ranging from personal computing to enterprise-level IT operations. LinuxToday serves as a home for a community that struggles to find comparable information elsewhere on the web.

Property of TechnologyAdvice. © 2026 TechnologyAdvice. All Rights Reserved

Advertiser Disclosure: Some of the products that appear on this site are from companies from which TechnologyAdvice receives compensation. This compensation may impact how and where products appear on this site including, for example, the order in which they appear. TechnologyAdvice does not include all companies or all types of products available in the marketplace.