Please :) Help!

[Anon]

Hi Guys

My question/problem is in relation to an admin script, which I'm trying
to write for a search engine. Basically what it needs to do is validate (URL)
records in a simple text database.

The format of the database is as follows:

There are 6 fields.

date_time type title description url keywords name

The delimiter is ----

Example: -

12/27/2000 09:46:11----html----Sublite Web Design----Sublite Web Site Design Services.----http://www.sublite.co.uk----sublite,website,development,site,internet----(none given)

I need to write a script that loops though the database and tests each
record to see if it's URL is working.

The script then should delete any record(s) which point to dead URL's
and produce 404 errors etc.

Any ideas on how I could go about coding this?

Greg🙂

[e-mail]

[Anon]

Issue a HTTP HEAD request and check for the returned headers. Look at the fsockopen() function in the manual, it gives you an example; just replace the line with GET by these ones :

fputs($fp, "HEAD $path HTTP/1.1\r\n");
fputs($fp, "Host: $host\r\n");
fputs($fp, "\r\n");

Before doing this, use the parse_url() function to extract all the components (host, port, path...) of the URL.

The HTTP return code comes in the first header line :

HTTP/1.1 code message

Check for the different possible values (corresponding to Ok, Not found, Redirection, Not authorized...).

[Anon]

Thanks Pal 🙂

I will look into the fsockopen() function in the manual.

If anyone can add anything to this example then please feel
free to do so.

Greg🙂

[e-mail]