Does anyone know of any spider programs in any language that will transverse a web page, saving all the html documents to disk with the correct directory structure?
teleport-pro
dunno about scripts, but if you just wanna download a site, WebZip looks good (but absolutely crud), and Website Extractor looks crud, but works brilliantly 🙂
http://www.spidersoft.com/webzip/
http://www.esalesbiz.com/extra/
http://www.gnu.org/software/wget/wget.html
just mind you don't slurp up the entire internet :d I want some too!