creating a spider

[marque]

Hi all,

I like to code in a template format, where I make one index.php file and call all content into that file from a mySQL database and other sources.

The problem is it is a job beyond my current skills to build a search function to search for the information on my sites.

My best guess would be to make a spider or crawler to crawl through a site, then:

• pull all links from a base page

• Loop through all links while looping through the subsequent links

• collect all data and put it in a database with each page associated to a seperate row

Simple ey?...

Has anyone done something like this before?

Ta.

Marc.