file_get_contents() problem

[celebx]

For some reason the folowing URLs aren't able to be fetched, it keeps loading and doesn't return.

http://www.free-teens-galleries.com/ RETURN LINK NOT FOUND!
the link is perfectly there on bottom of the page..

I'm using the folowing code:

$handle = fopen($row[siteurl], "rb"); 
do { 
   $data = fread($handle, 8192); 
   if (strlen($data) == 0) { 
       break; 
   } 
$position_located = preg_match('/href="*http:\/\/(www.celeb-x.com)/i', $data);
if ($position_located) {$found_link=1;break;} 
} while (true); 
fclose($handle);

and also tried:

$source=fiile_get_contents($row[siteurl]);
$position_located = preg_match('/href="*http:\/\/(www.celeb-x.com)/i', $source);
if ($position_located) {$found_link=1;} 

Let me know if you know what the problem could be and if you know any faster solution to search for links in external html files.

Best Regards,
Snt

[drew010]

try this:

$source = file_get_contents($row['siteurl']);

if (preg_match("/href=\"http:\/\/(www)?celeb\-x\.com(.*)>/i", $source)) {
    echo "found";
} else {
    echo "not found";
}

that'll match things like:
http://www.celeb-x.com/anyfolder/anypage.html
http://celeb-x.com/
http://www.celeb-x.com
etc...

[celebx]

Hi!

Your searchcode doesn't seem to work:
http://www.celeb-x.com/hardlinks/checker.php

[celebx]

also, please note how slow it loads, it's due to the http://www.free-teens-galleries.com/ domain wich doesn't seem to be loadable for some reason..

http://www.celeb-x.com/hardlinks/checker.php?domaincheck=hoes.ca

[celebx]

please note, the returnlink on hoes.ca is found verry fast with my other codes.

Also, let me know if it would be faster to use the code wich process the file part by part, for example when a link is placed on top of the page.

[drew010]

here, i accidentally left out a . after the www in the regular expression. this one should work..

if (preg_match("/href=\"http:\/\/(www\.)?celeb\-x\.com(.*)>/si", $source)) {
    echo "found";
} else {
    echo "not found";
}

it may be slow just because the persons site is slow, but regular expressions can be slow as well. if you wanted to check for the link you could use [man]stripos[/man] as well. thats the faster alternative to preg.

using file_get_contents should be just as fast as fopen if not faster, because with the fopen you keep assigning to a variable which takes some time, esp if the page is large.

[celebx]

Hi!

Thanks a lot for your support!

For as it seems the site wich doesn't get loaded via file_get_contents() loads pretty fast via the web and is only 53k in size. Also, the site is verry clean in setup, just lot's of links and some text:
http://www.free-teens-galleries.com/

It seems the site just doesn't get loaded for some reason... (set_time_limit(0)😉

Let me know if you know any explaination for it.

[drew010]

i made a little test script to see if it takes a long time to get that page.

here it is

<?

$start = getmicrotime();
$source = file_get_contents("http://www.free-teens-galleries.com/");
$end = getmicrotime();


$before_regex = getmicrotime();
if (preg_match("/href=\"http:\/\/(www\.)?celeb\-x\.com(.*)>/si", $source, $matches)) {
    echo "found";
} else {
    echo "not found";
}
$after_regex = getmicrotime();


echo "<br /><br />";

$download =  $end - $start;
$search = $after_regex - $before_regex;

echo "Took $download seconds to get the page, and $search seconds to search the text.";


function getmicrotime()
{
   list($usec, $sec) = explode(" ", microtime());
   return ((float)$usec + (float)$sec);
}

?>

this was the output...
found

Took 0.90922403335571 seconds to get the page, and 0.00054502487182617 seconds to search the text.

so on my server, it took just under a second to download that page, and 5/10,000ths of a second to perform the regex.

doesnt seem too long to me. try it on your server and see if it takes much longer to get the page.

[celebx]

not found

Took 189.00166606903 seconds to get the page, and 9.608268737793E-05 seconds to search the text.

http://www.celeb-x.com/hardlinks/test.php

[drew010]

okay, i guess there is a problem with your server getting that page, because its still taking under a second for my site to get the page and search it.

[celebx]

Yes, maybe the webmaster of the site has blocked my site wich wouldn't be verry logical since we're trading traffic..

Anyway, thanks a lot for your enhanced regular expression code!

Best Regards,
Snt