In this tutorial I will show you how to use wget in Windows.
wget is a very handy utility, I would call it "the Swiss army knife of the savvy Internet user".
Its main purpose is for mirroring HTTP and FTP sites, but you can get very creative with it and save a lot of browser navigation clicks if you have many repetitive tasks.
wget originated in the UNIX / Linux world and has been ported to Windows.
There are lots of places where you can go to download wget for Windows, just Google "wget for Windows" or "wget for Windows easy steps".


How-to #1 - Discover the REAL location of the file you're about to download

Many times a web server will attempt to obscure the location of the files it is serving.
Example from art.gnome.org
While browsing for a set of wallpaper jpeg files, I ran across this site and clicked my way to the page where you are supposed to right-click on the link and select "Save As ...", but instead of "Save As ..." I selected "Copy shortcut" ("Copy link location" in FireFox).
Then I passed the link location as the argument to wget, like this:



This made it possible for me to use an FTP client log into the ftp.gnome.org machine, cd into the /pub/GNOME/teams/art.gnome.org/backgrounds directory and do a mass download of the pictures I was interested in, using the ftp commands:



which saved me a lot of clicks.

How-to #2 - Parallel downloads (poor man's download manager)

Supposing you have a long list of hot links to picture files, movie files, PDFs or other types of files.
(By the way, megaupload, rapidshare, etc. links do not qualify as hot links since they require captchas)

<link #1>
<link #2>
...
<link #n>

you simply place the string 'start wget ' in front of each one of them, like this:



and paste the resulting script into an empty .bat file.
You then run the .bat file in a command prompt window, from within the directory where you want your files to go.
Note: this has the potential to max out your bandwidth, so be careful.

I hope you find it helpful.

-Dan

 

 

 

Reply