[RESOLVED] Help with CurL Posting

Oni

Hey--

Never use CurL that much, and now that I want to use it I'm having some problems.

I want to search for a term in Wikipedia. I have two versions, both of them don't seem to work.

I get a http problem, saying that the document has been moved. Of course, seeing that the file is 'Special:Search' I would except a problem like that...

<?
$url="http://www.wikipedia.org/wiki/Special:Search";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_POST, 1);
curl_setopt ($ch, CURLOPT_POSTFIELDS, "search=php&go=Go&fulltext=search");
//Not sure what the last & does after the last 'search'? Do i need one?

curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
$store = curl_exec ($ch);
$content = curl_exec ($ch); # This returns HTML
print $content;
curl_close ($ch);

?>

Now I had first tried to search using the front page--

<?
$url="http://www.wikipedia.org/search-redirect.php";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
curl_setopt ($ch, CURLOPT_POST, 1);
curl_setopt ($ch, CURLOPT_POSTFIELDS, "search=php&lang=en&go=Go&");
#curl_setopt ($ch, CURLOPT_COOKIEJAR, 'cookie.txt');
curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
$store = curl_exec ($ch);
$content = curl_exec ($ch); # This returns HTML
curl_close ($ch);
print $content;
?>

I just get a '1' from that, probably the 1 that I specified at the RETURNTRANSFER part...

Any tips?
Thanks!

tsinka

Hi,

I think you need to set the option

curl_setopt ($ch, CURLOPT_FOLLOWLOCATION, 1);

because curl won't follow the permanent move otherwise.

Thomas

jansky

Cat

Oni

Thanks for the code-- but it still doesn't function the way I want it to.
The second example I posted now atleast displays something, but it seems as though I was not able to post the data, because it still has only a search form on display...

So in other words, I just see the page that I'm trying to post to...

tsinka

Ok,

this one did it:

<?
$search=urlencode("php curl");
$url="http://en.wikipedia.org/wiki/Special:Search?search=".$search."&fulltext=Search";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
//Not sure what the last & does after the last 'search'? Do i need one?

curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
$store = curl_exec ($ch);
$content = curl_exec ($ch); # This returns HTML
print $content;
curl_close ($ch);
?>

You can just use get to search

But to get the full page you need to set the base href (the browser tries to download the styles and images from your server otherwise):

<?
$search=urlencode("php mysql");
$url="http://en.wikipedia.org/wiki/Special:Search?search=".$search."&fulltext=Search";
$ch = curl_init();
curl_setopt($ch, CURLOPT_URL, $url);
//Not sure what the last & does after the last 'search'? Do i need one?

curl_setopt ($ch, CURLOPT_RETURNTRANSFER, 1);
$store = curl_exec ($ch);
$content = curl_exec ($ch); # This returns HTML
$content = str_replace("<head>","<head>\n<base href=\"http://en.wikipedia.org/\">",$content);
print $content;
curl_close ($ch);
?>

The str_replace part above has to be on one line.

Thomas

Oni

Aha, I see--

Thanks alot for your great explanasion, I've read over a dozen comments on php.net and none of them came close to being that easy to understand...

Thanks! 😃