weird file() problem

[kelliinpb]

Hi everyone,
I'm having an...interesting...file() problem. I was trying to scrape a site to compare the information I wanted to information I already had. My problem is, even though I had successfully used the same code on this particular site and others, I believe they caught on and have banned me from accessing the site through file().

So even though I can't access it through file(), I can still see the pages through my browser, but when I use file(), it gives me an error like the page isn't there.

I have never heard of this before, maybe I wasn't paying close enough attention, but I would really like this information, what can I do? Here is my error:

Warning: file(http://www.example.com) [function.file]: failed to open stream: HTTP request failed! HTTP/1.1 999 in /test/scrape.php on line 3

Thanks for any help!
--Kelli

[laserlight]

I was trying to scrape a site to compare the information I wanted to information I already had. My problem is, even though I had successfully used the same code on this particular site and others, I believe they caught on and have banned me from accessing the site through file().

If you are not allowed to run a script to scrape information from that website, then just cease and desist, or negotiate with the website owner.