Hi All,
I'm sure this question has been asked a million times, but I just can't access the archives.
How do I build a dynamic content, virtual site crawler to put on my sites?
The Problem:
I have a site with multiple MySQL Tables, each table has a different page associated with it and each row has it's sub page associated with that.
Pages are called in like:
www.mydomain.com/?page=[tablename]&row=[rowIDnumber]
(not quite like that but you get the picture)
The Requirment:
I need a bot that when the user searches for something, the bot will "crawl" through my virtual site rather than "search" my directory structure or sql database.
Much the same as google does, using content rather than meta tags.
PS. If anyone can come up with a better solution please feel free to let me know.
Thanking very muchly in advance,
Marque.
