[RESOLVED] HTTP requests failing for unexplained reasons?

[examancer]

Can anyone explain why I get the following error? :

Warning: file_get_contents(http://digg.com/rss/containertechnology.xml) [function.file-get-contents]: failed to open stream: HTTP request failed! in /home/linkleaf/public_html/linkleaf2/test2.php on line 5

Here is the code in its entirety:

$url = 'http://digg.com/rss/containertechnology.xml';
$data = file_get_contents($url);
echo($data);

This code works perfectly for most any URL, but for some reason it always fails on digg feeds. Is there something I'm missing? Do you think I have to do a socket connection or something and send some headers? I'm working on a feed reader so this may be the case for more than just digg and I need some guidance about what I can do to make sure my requests aren't blocked like this one.

[leatherback]

from the manual on [man]file_get_contents[/man] I find this:

Tip
You can use a URL as a filename with this function if the fopen wrappers have been enabled. See fopen() for more details on how to specify the filename and Appendix M, List of Supported Protocols/Wrappers for a list of supported URL protocols.

Have you tried file() instead?

[examancer]

I know fopen wrappers are enabled because i use the same code for other URLs and it works fine. I actually use fopen() and fread() on the real feed reader, but simplified it hear to attempt to determine what is going on. I haven't used file() yet, but according to the manual its identical to file_get_contents() except it puts the contents into an array instead of a string. Worth a shot, but since even fopen()/fread() aren't working, it doesn't sound promising.

[examancer]

OK, confirmed... same error with file() with digg urls, and it works fine with other urls. Any other ideas?

[scrupul0us]

have u tried specifying "r" for read only mode? ive run into that issue before

[examancer]

Still getting the same error. Here is my current code:

$url = 'http://digg.com/rss/containertechnology.xml';
$url2 = 'http://del.icio.us/rss/';

$fp = fopen($url, "r");
$data = array();
if ($fp) {
	while (!feof($fp)) {
		$data[] = fgets($fp);
	}
}
print_r($data);

$fp2 = fopen($url2, "r");
$data2 = array();
if ($fp2) {
	while (!feof($fp2)) {
		$data2[] = fgets($fp2);
	}
}
print_r($data2);

the fopen for $url fails, while the fopen for $url2 works just fine and outputs the feed contents as expected. Is digg doing something to reject my request because I'm not sending browser headers first or something? Can anyone else try this and see if they are able to grab digg feeds with fopen()?

[Installer]

It looks like they want a user-agent string. This works for me:

$url = 'http://digg.com/rss/containertechnology.xml'; 
$agent = "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; .NET CLR 1.1.4322; .NET CLR 2.0.50727)";
$ch = curl_init(); 
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt($ch, CURLOPT_USERAGENT, $agent);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, 1); 
curl_setopt($ch, CURLOPT_HEADER, 0);
$result = curl_exec($ch);
curl_close($ch);
echo $result;

[examancer]

SWEET! I figured it was something like that, and your example will help a ton. Thanks :-)

... Now if only I could figure out how to mark this thread resolved. Been so long since I've been here.

[leatherback]

-- have a look at thread tools on top --