[Resolved] Block Search Engine Bots

[andrewm]

What would be the simplest way to block most search engine bots from accessing a specific page?

It doesn't have to work 100% of the time, just most of the time.

So far, I've figured out how to block google:
if (eregi("google",$HTTP_USER_AGENT)) {
exit();
}

Thanks.

[superwormy]

Use a robots.txt file. Search Google for more details.

Or continue the way you're doing it, but you're doing it the hard way.

[andrewm]

Ah, I thought robots.txt was only for blocking an entire site.

Thanks for the heads up.

[andrewm]

This is all the robots.txt file needed:

User-agent: *
Disallow: /helpful/

Thanks!