Search engine with crawler

aboldock

Hi Follks

Anyone know of some code around to search a site (code resident on) and then also index several (8) other sites. The problem is the 8 other sites are not resident and need to be crawled and indexed. Another problem.. No Database access. I will write it myself if I have to just trying to save time and money.

Thanks heaps of any help
Alan Boldock

van__

well, I'd say www.htdig.org for the htdig spider... but you said no database access.

So that means you better start rolling up your sleeves.

I assume you don't have root on your server.
So that means you're stuck with fsockopen or plain ol' fopen()

Hopefully you have cronTab atleast, or you're really screwed.

Personally, I'd forget it on your current host situation... get a real host with root, install MySQL and make a nice colorfull installation of PHP for yourself.

...but hey...
You can always try.
But, I'd suggest you don't for sanities sake.
I mean think about what you are proposing.

aboldock

Yer not a pretty thought.
I was hoping someone would say "hey acme co have just thing!" but oh well better start writting (yuck)

Thanks anyhow
Alan

[deleted]

Have a look at a software called Alkaline at http://alkaline.vestris.com . If you have a non commercial site, you could get a free license.

In fact, i use PHP to highlight the searched terms in the summary of the results aka Google.

Have a look