parsing a HTML webpage

padresangel

I am a complete newbie so be nice!! ....

i have to show a webpage with a white background in an iframe of my html page which has a black background.

I wish to change the webpage with the white background to a black background with white text so it looks part of the site. I was told that i could use fopen and preg_match and replace but i dont seem to be getting anywhere.

Can anyone point me in the right direction?

Cheers

Lindsay😕

justsomeone

the advice is good.

use fopen or curl or anything like that to read the page into memory. Use one of the regex functions to change the colours as you like. Then display your modified html in the iframe.

Why aren't you getting anywhere? What problems are you having? What's your code?

padresangel

ok glad i am on the right track..... its not that im not getting anywhere with the code its just different sites tell me different things....

can u recommend a site that would tell me how to do this??

with the code i have managed to get it to read the site i want and find the tag i want and i think it changes the colour.. but it prints out just the variable i want to change.... i just want to know how to print out the whole of the page with the changed variables i have specified....

cheers

Lindsay

justsomeone

if you've got the changed page in memory somehow, then your 90% there. All you need to do is display it. Do you have the page stored in one long text string? If so just print() it. If it's in an arrya, just loop through the array and print() each element.

padresangel

Hi i dont think i have stored it into memory.... these are the examples that i have been playing with from different sites so far.......


$fh = fopen("web address", "r");


  //-----------first example start---------------//

  //This works  it displays the page
 while ($buf = fread($fh, 8192))
   print $buf;
   fclose($fh); 

//-----------first example end----------------//



//------------2nd example start---------------//

 // this section i cant tell if it works... it just prints the word white which is the variable

 while ($buf = fread($fh, 8192))
    print $buf;
 echo ("$buf<br />");
if (!preg_match('/<font face="verdana,helv,sans-serif" size=2>/i', $buf, $match)) die("preg_match found no match."); 
 if (!preg_match('/<body>([^<]*)<\/body>/i', $buf, $match)) die("preg_match found no match."); 
if (!$found_comment = $match[1]) die("\$match[1] was not set."); 
echo "<p>$found_comment</p>\n\n"; 
$text = "white";
$improved = preg_replace('/\[([^]]+)\]/', '<font face="verdana,helv,sans-serif" size=2 color=\\1>([^<]*)', $text);
echo "$improved";

  fclose($fh); 

//------------- 2nd example end--------------------// 




//--------------3rd example start-------------------//

 function tag_rep($tag) 
{ 
return preg_replace('/(?<!\<)(\S+)\s*=\s*(?<![\'"])([^\s\'"]+)(?![\'"])/','\1="\2"',$tag); 
}

$html="<p class=MsoNormal id=par><font size=10 face=\"Comic Sans 
MS\"><span lang=NL style='font-size:12.0pt;font-family:\"Comic Sans 
MS\"'><a 
href=http://www.php.net/index.php>&nbsp;key=value&nbsp;</a></span></font></p>";

echo 'Normal HTML:<br><textarea cols="70" rows="10">'; 
echo $html; 
echo "</textarea><br><br>";

$improved_html = preg_replace('/\<(.*)\>/Ueis','"<".tag_rep("\1").">"',$html); 
echo 'Improved HTML:<br><textarea cols="70" rows="10">'; 
cho str_replace("\\'","'",$improved_html); 
echo "</textarea>"; 


//----------------3rd example end-----------------//

Hope this helps u understand where i am coming from.....

I'm more of a JSP girl to be honest ive just picked up php cos the server working on does not run Tomcat properly... plus never done parsing before but i understand the concept but cant get to grip with the correct php code...

any help will be much appreciated!

Lindsay

justsomeone

here's a very basic example for you. Maybe you can build on this? This example takes the www.php.net homepage and converts text colour from black to red...

$lines = file('http://www.php.net/');
for ($i=0; $i<sizeof($lines); $i++){
    $lines[$i] = str_replace ("text=\"#000000\"", "text=\"#ff0000\"", $lines[$i]);
    print ($lines[$i]);
}

padresangel

dont mean to be stupid but i cant get your example to work... it hangs on the for loop.... and the error message is not informative of what it is objecting to....

All i did was comment all of my code so all that should be live code is your example!

any suggestions??

Lindsay

justsomeone

Try pasting my code into a brand new empty file. It works fine for me.

if you still can't get it to work, post the error message. Also try inserting echos in the code, eg echo "$i<br>" in the loop, to see if you can follow what's going on.

padresangel

still get the error message.... its:

Parse error: parse error in /home/virtual/site18/fst/var/www/html/testParse2.php on line 12

here is the code in the php file:

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<title>Untitled Document</title>
</head>

<body>
<?php
$lines_=_file('http://www.php.net/'); 
for_($i=0;_$i< sizeof($lines);_$i++){ 
____$lines[$i]_=_str_replace_("text=\"#000000\"",_"text=\"#ff0000\"",_$lines[$i]); 
____print_($lines[$i]); 
}
?>
</body>
</html>

Does anything stand out that i am doing wrong??

Lindsay

padresangel

oh line 12 is the for loop!!

lindsay

justsomeone

The first question that springs to mind is "What's with all those underscores?"

padresangel

well those underscores are not in my code.... it must have happened when i pasted it into my post!

Lindsay

justsomeone

OK, Just checking.

I'm baffled so, I just pasted that code in from a working script. What OS are you running on? What version of PHP?

Just on a wild speculation, as there seems to be an underscore thing going on with your copy and paste, the code SHOULD have an underscore between "str" and "replace" (it's a PHP function). Does your code have this underscore?

Oh hang on, you don't need all that HTML around the php. Get rid of it all, so that you just have the php code - and nothing outside the <?php>...</?> tags. All of the html will be output by the for loop, so you don't need any - I wonder if that's the problem?

padresangel

got rid of html code above and below the php code but still not working... still objecting to the for loop... maybe its the 'sizeof' bit?

am running it on a live web server running linux fedora with Apache 2.0.48 and i think php4 but not sure on that one!

Any thoughts?

Lindsay

justsomeone

There's a couple of things I'd try.

My gut feeling is that something bad has happened the syntax.

Could some non-printable characters have found their way into your code? Try typing it by hand instead of copy/paste.
Could it be that you can't request the external page? A php configuration parameter controls whether or not you can pass a URL as parameter to the file() function (or to any fucntion which normally expectes a filename as argument. You can check this setting by creating a simple php script with just one line:

phpinfo()

This will output a whole load of info about your PHP setup. Search through the output for "allow_url_fopen" which should have a value of 1. If it doesn't that's going to break it. If this setting is worng, you will need to reset it in php.ini and restart.

I would have thought that this would give you a more meaningful "unable to open..." type error, though.

The phpinfo() command will also show you what version of php you're running. file() needs version 3, 4 or 5
sizeof() also needs version 3, 4 or 5

padresangel

Am so thick... by retyping the code in a new file your example worked!! always the simple solutions are overlooked!

One more question..... on the page i need to change the colour of it does not have the body tag or any font colour tags... is it possible to add code to the page rather than use the replace function in your example?

thanks for all of your help...... very much appreciated...

Lindsay😃

justsomeone

you can do whetever you like to the source 🙂

the file command loads the entire source html into an array. The first line is in $lines[0] and so on.

All you need to do is to find the line you want to edit and edit it.

If the page you're redisplaying is unlikely to change often, or at least unlikely to change layout ofthen, you could just stufy the source html identify what extra html you'd like to insert and what line you'd like to append it after. For example, if you wanted to insert " after the 5th line of html, you could just do $lines[4] .= "; after the file() command.

If you'd like to completely replace the 5th line with your own line, just do
$lines[4] = "";

If the line you want to edit could move about, then you need to go into the for loop and use regular expressions or someuch to make the change you want.

Hint:
Forget that you're dealing with files or web pages or any of those complications. You're now just going through an array of strings, checking each one to see if it matches a pattern, and making a change to it if it does.

padresangel

Cheers for that have now got it all to work how i want it to......

Thanks for all ur help and patience....

Lindsay

justsomeone

Glad it worked out 🙂

Welcome to the world of PHP!

padresangel

Hello its me again!!

Got one more question...... and that will be it i promise!!

I have a slight problem keeping the format of the page i have created with the php code.... on the page with the format i want it has a search box like google and then when the user clicks on the search button it goes to a search page... once it goes the the search page it loses the formatting i did on the previous page.....

I have created an example with google....... i only put in the absolute address in the <a href /> for the search not for image searches etc....

<?php
//get the web page and put it into an array called $lines
$lines = file('http://www.google.co.uk');
$lines[11] =  "</head><body bgcolor=#000000 text=#ffffff link=#0000cc vlink=#551a8b alink=#ff0000 onLoad=sf() topmargin=3 marginheight=3><center><img src=http://www.google.co.uk/intl/en_uk/images/logo.gif width=276 height=110 alt=Google><br><br>";
$lines[12] = "<form action=http://www.google.com/search name=f><table border=0 cellspacing=0 cellpadding=4><tr><td nowrap><font size=-1><b>Web</b>&nbsp;&nbsp;&nbsp;&nbsp;<a id=1a class=q href=/imghp?hl=en&tab=wi&ie=UTF-8>Images</a>&nbsp;&nbsp;&nbsp;&nbsp;<a id=2a class=q href=/grphp?hl=en&tab=wg&ie=UTF-8>Groups</a>&nbsp;&nbsp;&nbsp;&nbsp;<a id=4a class=q href=/nwshp?hl=en&tab=wn&ie=UTF-8>News</a>&nbsp;&nbsp;&nbsp;&nbsp;<a id=5a class=q href=/frghp?hl=en&tab=wf&ie=UTF-8>Froogle<sup><a	style=text-decoration:none><font	color=red>New!</font></a></sup></a>&nbsp;&nbsp;&nbsp;&nbsp;<b><a href=/options/index.html class=q>more&nbsp;&raquo;</a></b></font></td></tr></table><table cellspacing=0 cellpadding=0><tr><td width=25%>&nbsp;</td><td align=center><input type=hidden name=hl value=en><input type=hidden name=ie value=ISO-8859-1><input maxLength=256 size=55 name=q value=><br><input type=submit value=Google Search name=btnG><input type=submit value=I'm Feeling Lucky name=btnI></td><td valign=top nowrap width=25%><font size=-2>&nbsp;&nbsp;<a href=/advanced_search?hl=en>Advanced Search</a><br>&nbsp;&nbsp;<a href=/preferences?hl=en>Preferences</a><br>&nbsp;&nbsp;<a href=/language_tools?hl=en>Language Tools</a></font></td></tr><tr><td colspan=3 align=center><font size=-1>Search: <input id=all type=radio name=meta value= checked><label for=all> the web</label><input id=cty type=radio name=meta value=cr=countryUK|countryGB ><label for=cty>pages from the UK</label></font></td></tr></table></form><br><br><font size=-1><a href=/ads/>Advertising&nbsp;Programmes</a> - <a href=/services/>Business Solutions</a> - <a href=/intl/en/about.html>About Google</a> - <a href=http://www.google.com/ncr>Go to Google.com</a></font><p><font size=-2>&copy;2005 Google - Searching 8,058,044,651 web pages</font></p></center></body></html>";
for ($i=0; $i<sizeof($lines); $i++){
print ($lines[$i]);
}
?>

any ideas on how i can keep the formatting??

cheers in advance

Lindsay