Does anyone know of a script that will get a list of all the links on a page and then save them to a database? If it opened each link and got the links on that page too, that would be cool too.
Have a look at www.hotscripts.com
http://www.hotscripts.com/cgi-bin/search.cgi?bool=AND&query=spider+crawler&catid=all
Halfabee
