PHP Mod rewrite problem

[rremm2000]

Hello and thanks for reading my question.

I have a script and I have it set up for mode rewrite, and everything works great on the user end.

However, the stupid bots including google seem to be bypassing my mode rewrite.

all the links are story-29.html but these bots are doing story.php?cid=29 as an example. There are NO links that show story.php?cid=29 is a valid url.

1. how are they finding out I'm doing mode rewrite
2. how do I stop them ?

Can I some how stop them from doing anything with story.php and only following the the html links

Also how could I tell if they hit story.php?cid=nn and 301 them to the story-nn.html...It like I need a mode rewrite for my mode rewrite....

It seems they want to find anything to punish any site like the whole duplicate content thing because they see an html page and php? page....sorry this just -CENSORED- me off

[bpat1434]

There's an edit button in the lower right hand corner of your posts, please use it rather than posting twice. Also, watch the language, and don't actively try to get around any filters that are in place here.

You can stop Google and other spiders with a robots.txt file. Google for it.

You can solve your problem by removing the ".html" file and just use story.php/xx as your SEO URL and you're problems are solved.

You could always look in the $_SERVER['QUERY_STRING'] to see if it's set and if it has the cid in it and give a 301; although, Google may stop indexing your pages if you do that.

[rremm2000]

Why would google stop indexing by giving it a 301 page moved, is that what 301 is for

[bpat1434]

I mean, that your ".html" pages wouldn't be indexed (because of the 301) so it'd be better to change your site to allow search engines to index your site (like I said above).