snatch 0.6 (The Man Who Couldn't Cry) – the page image grabber

History

Note: To use this module, you may first need to run perl snatch --update-cache

UPDATED the following modules to work with site changes
- Canadiana (now downloads PNGs instead of GIFs)
- Cornell University Library - New York State Historical Literature
- Kentuckiana
- Historic Pittsburgh
DISABLED the following modules because site changes have made them impossible to fix them
FIXED a minor warning related to page renumber in Schoenberg Center for Electronic Text & Image
FIXED a minor bug that caused a warning when $config{'cookiefile'} is not set in config.rc

ADDED -ua command line option to set user agent (overrides $config{'uagent'} setting)
ADDED -p command line option to set (or disable) HTTP proxy
UPDATED Our Roots module based on the update provided by Ian Clysdale (see this post at DP
UPDATED the following modules to work with URL changes:
FIXED bug in Austrian Literature Online module that prevented downloading
FIXED bug in Canadiana module for parsing page listings
FIXED some minor errors in the install documentation and added reference to new -ua commandline option.
FIXED a minor bug relating to trailing slashes in output directory names.

UPDATED Making of America Michigan Books module to work with site changes [CW]
FIXED minor bug in build script affecting download/view links in module documentation [CW]

FIXED bug in several modules that prevented proper renumbering for PDF downloads [CW]
FIXED bug preventing -l and --update-module options from working properly [CW]
FIXED Canadiana Online module previously broken due to site changes [CW]
UPDATED Michigan State University Digital & Multimedia Center module [CW]
STOLE several concepts from gharvest.pl (special thanks to Bruce Albrecht)
- Proxy support now works properly
- Random useragent now chosen if one not specified in config.rc

ADDED new module Historical Pittsburgh. [CW]
FIXED bug in Kentucky Digital Library module that prevented downloading GIF images. [CW]
FIXED minor --update-cache bug that kept module cache in memory.
Tweaked verbose code to print file download URL.

ADDED check in Canadian Literature Online module to prevent attempts to download restricted materials. [CW]
FIXED bug in Making of America - Cornell Journals module. [CW]
FIXED minor bug that prevented module name to be printed in verbose mode. [CW]
FIXED bug in build script that erroneously misname module files. [CW]
FIXED bug in documentation generation code that prevented formats from being shown in module docs. [CW]
Strictified code. [CW]

ADDED a bunch of new modules:
ADDED installation instructions to documentation, along with minor navigational tweaks [CW]
FIXED Austrian Literature Online bug that prevented renumbering [CW]
FIXED bug preventing formats other than "image" and "png" from being used. [CW]
CHANGED University of Georgia module to be faster when using -o flag to specify an offset. (Using the uga module without the -o flag is not recommended.) [CW]
CHANGED how certain modules "touch" a page to generate an image. Now the "touch" pages are called immediately before the image to be downloaded. This should help people on dialup connections from having to touch every page first before downloading any images (especially when a download fails at page #100 – you can pick back up where you left off!). [CW]
CHANGED module code to standardize common module routines and make maintenance/addition of modules easier. [CW]
CHANGED preferences code. Preferences are now stored in a file called "config.rc" – a "config.example.rc" is included (see Installation for details).[CW]
REMOVED the Universal Library Scanserver module. [CW]

Fixed a bug with Making of America - Michigan Books module where some books that had a different filename syntax weren't being downloaded. [CW]
Added a bunch of Examples [CW]