“This resulted in a large number of people hammering the site to
obtain a local mirror. This minor panic reminded me of the
importance of a good site mirroring tool.“The quickest and easiest way to mirror a remote Web site is to
use wget. Wget is similar to cURL (and I’ll be the first to
admit that I prefer cURL over wget), but wget has some really slick
and useful features that aren’t found in cURL, such as a
means to download an entire Web site for local viewing:”
Mirroring Web sites with wget
By
Jack Wallen
Get the Free Newsletter!
Subscribe to Developer Insider for top news, trends, & analysis