Home Products Downloads News Store Support Forums

Stan's Blog

Stan's Blog

Tips and tricks on how to use Maxprog products

Compatible with MS Windows Compatible with MacOS


Web Dumper Incremental downloads

Topics

With Web Dumper you can download entire Websites off of the Internet, and save them on your hard drive for later offline browsing. The downloaded web sites are saved on your hard drive with their directory structure intact by default. Indeed, Web Dumper automatically downloads HTML documents along with their embedded pictures, sounds, movies and so on while it screens them to look for any enclosed links to other documents.

But what if you want to download sequences of documents, pictures or directories? Web Dumper supports that too. It is known as 'Incremental Download'.

Indeed, you can use Web Dumper to fetch contents from the web, not only by using an HTML index file but also directly by name! Let's see...

You have probably seen directories or files named by number or a word followed by a number like '/01/pict1.jp', '/01/pict2.jp', '/01/pict3.jp',..., '/02/pict1.jp'... etc... right? This type of structure follows a very simple pattern. With the Incremental download feature you can fetch those contents, it is just a matter of setting the starting URL properly.

Incremental download URL

The starting URL here has been set to

http://www.maxprog.com/test[1-2]/picture[001-002].jpg

See the text surrounded by brackets? They are the sequencing setting parameters.

Indeed, test[1-2] will be replaced by 'test1' and 'test2' and picture[001-002].jpg with 'picture001.jpg' and 'picture002.jpg'.

As a result Web Dumper will try to download the following files:

http://www.maxprog.com/test1/picture001.jpg

http://www.maxprog.com/test1/picture002.jpg

http://www.maxprog.com/test2/picture001.jpg

http://www.maxprog.com/test2/picture002.jpg

By setting the starting URL to http://www.maxprog.com/picture[12-15].jpg you would get instead:

http://www.maxprog.com/picture12.jpg

http://www.maxprog.com/picture13.jpg

http://www.maxprog.com/picture14.jpg

http://www.maxprog.com/picture15.jpg

The sequence tag format is simple:

- An opening bracket '['

- The starting number, with or without heading zeros

- An hyphen '-'

- The ending number, with or without heading zeros

- A closing bracket ']'

You can insert as many sequence tags inside the URL!

How does it work?

By clicking on the 'Dump' button, Web Dumper will process the sequence tags inside the starting URL. The resulting URLs are added to the download queue. Web Dumper automatically starts downloading the files. If the file is not found, an error is shown next to the bad URL. It doesn't affect the other URLs. Once finished, just click on the 'Downloads' button. You will be taken to the folder where the pictures have been downloaded.

It is recommended to use the right starting and ending numbers. A web server may deny access temporally to a client (you) after a given amount of errors.

 




 Rate This Post!
Stan Busk Stan Busk
June 4, 2014



Recent questions from our Web Dumper users
Nothing is downloaded New
Using the List function
Empty folder after download
Can I download files with sequential numbers in their name?

Generic questions
New paragraph
How do I install Maxprog software on my computer?
macOS
MS Windows
New paragraph
How can I change an application language?
macOS
MS Windows
New paragraph
How to register the software I've just purchased?
macOS
MS Windows
New paragraph
How can I recover the serials I have lost of products I purchased here?
macOS
MS Windows
New paragraph
How can I recover my serial from a registered application?
macOS
MS Windows
New paragraph
How can I find out the product name and version my serial unlocks?
macOS
MS Windows
New paragraph
Where can I read your software License Agreement?
macOS
MS Windows
New paragraph
The software doesn't start, runs very slowly or crashes often, how comes?
macOS
MS Windows
New paragraph
Double-clicking on my files no longer opens them with the software, why?
macOS
MS Windows
Stan Busk If you want to make the most of the software that you have acquired at Maxprog, do not miss the Stan's Blog. It is a library of Tutorials and Tips covering specific features and tipical problems you may have when using our tools. This page is updated regularly depending on the topics discussed in our public forums and issues reported thru our HelpDesk. If you are interested on what we are currently working on (or want to participate in beta testings) don't miss the Stan's Logbook.
For years, MAX Programming has provided companies around the globe with sophisticated and innovative solutions. Our commitment to quality is not only evident in our products, but also in our people. It is our mission in Professional Support Services to ensure that our products perform to the fullest of their ability in order to meet the business objectives of our customers. We provide the tools and information required for improved productivity. To accomplish this, we offer an array of services including: Technical Support, Education Services and Consulting Services.

Maxprog is part of an internet site network made of desktoolset.com, emaildesignstudio.com, familycash.com, icash.promo, maxbulkmailer.com, maxprog.com, maxprog.net, maxprog.org, maxprog.us, myrecipients.com, newslettercomposer.com, sharedcontents.com, stanbusk.com, stanbusk.pairserver.com, usertools.com.
If you are viewing a Web site with your browser and you decide that you would like to make a copy of it on your hard drive, you have to manually save each page as you view it along with embedded pictures, sounds and so on.

This can be a very long and tedious process, and in many cases it's more trouble than it's worth. It doesn't have to be that way, however, as Web Dumper makes this whole process very fast and easy. With Web Dumper you can download entire Websites off of the Internet, and save them on your hard drive for later offline browsing.

Downloaded Web sites are saved on your hard drive with their directory structure intact. Web Dumper automatically downloads HTML documents along with their embedded pictures, sounds, movies and so on while it screens them to look for any enclosed links to other documents.

Web Dumper lets you select which kinds of file you want to be dumped between more than 60 available standard types, the folder depth level, how links must be processed and if it must re-link your HTML documents for offline browsing.



 !  YES! You can add Anonymous comments! They are moderated though. In order to add a comment without moderation just log in using your Google, Twitter, GitHub, GitLab or Commento login data.




Did you like this post? Share it!



Home Products Downloads News Store Support Forums