Wget is a command-line utility that helps download files from the web. It’s a non-interactive program that works in the background. We can use the wget commands as part of the cronjobs as well to do routine tasks.
For example, if we want to download a sample.php file from a website ‘mywebsite.com”, we could use the command below to download the file
Wget
We get frequent requests to rebuild existing sites using Drupal. When we get such a request it would help to have a copy of the full site on our local server to make it easier for themers and developers to reuse whatever existing components that can be salvaged from the original site. Wget is a powerful tool that can help mirror websites locally or on any web servers.
The command for doing this using wget is really simple.
A web developer’s life becomes much saner if he/she has easy access to all page header information. Firefox offers you PLUGIN-NAME that helps you inspect headers.
Here is something for the terminally inclined ones among you - wget. To view the http headers give the following command in gnome terminal :
wget -S --spider www.example.com