regex - extract data from web page

rupam_jaiswal

Hi,
My html looks like this

<div style="margin:20px; margin-top:5px">
<div class="smallfont" style="margin-bottom:2px">Code:</div>
<pre class="alt2" dir="ltr" style="
margin: 0px;
padding: 6px;
border: 1px inset;
width: 470px;
height: 34px;
text-align: left;
overflow: auto">http://www.sample1.com/part1.html
http://www.sample1.com/part1.html
http://www.sample1.com/part1.html</pre>
</div><br />

<div class="smallfont" style="margin-bottom:2px">Code:</div>
<pre class="alt2" dir="ltr" style="
margin: 0px;
padding: 6px;
border: 1px inset;
width: 470px;
height: 1490px;
text-align: left;
overflow: auto">http://www.sample1.com/part1/sample_code.part01.rar
http://www.sample1.com/part1/sample_code.part01.rar</pre>

</div></div>

I want all the values that are after Code:</div> and between pre tags.
eg http://www.sample1.com/part1.html
http://www.sample1.com/part1.html
http://www.sample1.com/part1.html
and
http://www.sample1.com/part1/sample_code.part01.rar
http://www.sample1.com/part1/sample_code.part01.rar

Please note that at the start in meta tag there is also string Code: and I don't value from it.
Thanks in advance
Regards

NogDog

One way:

<?php
$html = <<<EOD
<html>
<head>
   <title>test</title>
   <meta name="description" content="New info! Code: http://www.example/index.html Code: http://testing.com/fil" />
</head>
<body>
<!-- message -->
<div id="post_message_510223" class="vb_postbit"><font color="green"><font size="3">Temp</font></font><br />
   <br />
   <br />
   <img src="http://sample/test.jpg" border="0" alt="" onload="NcodeImageResizer.createOn(this);" /><br />
   <br />
   <br />
   info!<br />
   <br />

   <div style="margin:20px; margin-top:5px">
      <div class="smallfont" style="margin-bottom:2px">Code:</div>
      <pre class="alt2" dir="ltr" style="
           margin: 0px;
           padding: 6px;
           border: 1px inset;
           width: 470px;
           height: 34px;
           text-align: left;
           overflow: auto">http://www.sample1.com/part1.html
http://www.sample1.com/part1.html
      http://www.sample1.com/part1.html</pre>
   </div><br />

   <div class="smallfont" style="margin-bottom:2px">Code:</div>
   <pre class="alt2" dir="ltr" style="
        margin: 0px;
        padding: 6px;
        border: 1px inset;
        width: 470px;
        height: 1490px;
        text-align: left;
        overflow: auto">http://www.sample1.com/part1/sample_code.part01.rar
   http://www.sample1.com/part1/sample_code.part01.rar</pre>

</div>
</body>
</html>
EOD;

$urls = array();
$doc = new DOMDocument();
$doc->loadHTML($html);
$nodeList = $doc->getElementsByTagName('pre');
foreach($nodeList as $pre)
{
   if($pre->hasAttribute('class') and $pre->getAttribute('class') == 'alt2')
   {
      preg_match_all('#\bhttp://\S*(?=\s|$)#i', $pre->textContent, $matches);
      $urls = array_merge($urls, $matches[0]);
   }
}
echo "<pre>".print_r($urls,1)."</pre>";
?>

Output:

Array
(
    [0] => http://www.sample1.com/part1.html
    [1] => http://www.sample1.com/part1.html
    [2] => http://www.sample1.com/part1.html
    [3] => http://www.sample1.com/part1/sample_code.part01.rar
    [4] => http://www.sample1.com/part1/sample_code.part01.rar
)

nrg_alpha

Using Nog's heredoc $html EOD variable, another possible solution would be to use DOM / XPath:

$dom = new DOMDocument;
@$dom->loadHTML($html); // you would change this to @DOM->loadHTMLFile('http://www.somesite.com/someFolder/someFile.php'); but use the actual URL in question
$xpath = new DOMXPath($dom);
$preTag = $xpath->query('//pre[contains(@class, "alt2")]');

foreach ($preTag as $val) {
	$arr[] = explode("\n", $val->nodeValue);
}

$arr = array_merge($arr[0], $arr[1]);
$arr = array_map('trim', $arr);
echo '<pre>'.print_r($arr,true);