Browser Implementation in PHP

[ranam]

Hi,

I am coding a spider and I am using the following code to connect:

$fp = fsockopen ($host, $port, $errno, $errstr, 30);
if (!$fp) {
    echo "$errstr ($errno)<br>\n";
} else {
	fputs($fp,"GET $path?$query HTTP/1.0\n\n");
    while (!feof($fp)) {
		$buffer .= fgets($fp, 4096);
	    //echo $buffer;
    }
    fclose ($fp);
}

Works fine. But I got a site that detects browsers and won't let access without a proper browser. So how can I emulate IE or netspcape?

Thanks

[emcb_php]

Hi,

Im not sure if you can do this with php but try it:

...
fputs($fp, "HTTP-User-Agent: Mozilla/4.0");
...

if that wont work you should consider using perl. perl5 has a robot module which would have all the funcs for your own spider.

[ranam]

🙁, didn't work.

[Anon]

Yes, it should:

fputs($fp,"GET $path?$query HTTP/1.0\n");
fputs($fp, "HTTP-User-Agent: Mozilla/4.0\n\n");

Diego