Web Portal

[DigitalExpl0it]

Hi,

I'm making a little portal that allows me to access sites through my site, now Everyhting works great the only thing im having problems with is the header being sent by the server. Is there a way to not show this?

Right now im filtering the headers but I cannot get them all

Filters

//Slashdot Stuff
   $getdata = eregi_replace("HTTP/1.1 200 OK", "", $getdata);
   $getdata = eregi_replace("Cache-Control: private", "", $getdata);
   $getdata = eregi_replace("Pragma: private", "", $getdata);
   $getdata = eregi_replace("Vary: User-Agent,Accept-Encoding", "", $getdata);
   $getdata = eregi_replace("Connection: close", "", $getdata);
   $getdata = eregi_replace("Transfer-Encoding: chunked", "", $getdata);
   $getdata = eregi_replace("Content-Type: text/html; charset=iso-8859-1", "", $getdata);
   $getdata = eregi_replace("Server: Apache/1.3.33 (Unix) mod_gzip/1.3.26.1a mod_perl/1.29", "", $getdata);   

   $getdata = eregi_replace("SLASH_LOG_DATA: shtml", "", $getdata);   

   $getdata = eregi_replace("X-Powered-By: Slash 2.005000", "", $getdata);
   $getdata = eregi_replace("e5a", "", $getdata);

   //CNN Stuff
    $getdata = eregi_replace("Server: Apache", "", $getdata);
	$getdata = eregi_replace("Content-Type: text/html", "", $getdata);
	$getdata = eregi_replace("Cache-Control: max-age=60, private", "", $getdata);
	$getdata = eregi_replace("Vary: Accept-Encoding,User-Agent", "", $getdata);
	$getdata = eregi_replace("Content-Length: 61153", "", $getdata);

//MISC
$getdata = eregi_replace("X-Powered-By: PHP/4.3.10", "", $getdata);
$getdata = eregi_replace("mod_ssl/2.8.16", "", $getdata);
$getdata = eregi_replace("OpenSSL/0.9.6b PHP/4.3.10 e70", "", $getdata);
$getdata = eregi_replace("Accept-Ranges: bytes", "", $getdata);
$getdata = eregi_replace("Keep-Alive: timeout=15, max=996", "", $getdata);
$getdata = eregi_replace("Connection: Keep-Alive", "", $getdata);

//MSN
$getdata = eregi_replace("X-Powered-By: ASP.NET", "", $getdata);
$getdata = eregi_replace("X-AspNet-Version: 1.1.4322", "", $getdata);
$getdata = eregi_replace("Cache-Control: no-cache", "", $getdata);
$getdata = eregi_replace("Pragma: no-cache", "", $getdata);
$getdata = eregi_replace("Expires: -1", "", $getdata);
$getdata = eregi_replace("Content-Length: 29258", "", $getdata);
$getdata = eregi_replace("Server: Microsoft-IIS/5.0", "", $getdata);
$getdata = eregi_replace('P3P:CP="BUS CUR CONo FIN IVDo ONL OUR PHY SAMo TELo"', "", $getdata);
$getdata = eregi_replace('Server: Microsoft-IIS/6.0', "", $getdata);
$getdata = eregi_replace('; charset=utf-8', "", $getdata);
$getdata = eregi_replace('Content-Length: 29245', "", $getdata);

here some header info, from when I goto www.msn.com.

On top of the page I get this...

Thu, 31 Mar 2005 10:37:55 EST Date: Thu, 31 Mar 2005 15:37:57 GMT Set-Cookie: mh=MSFT; domain=.msn.com; expires=Tue, 31-Mar-2015 15:37:58 GMT; path=/ Set-Cookie: MSNADS=UM=; domain=.msn.com; expires=Tue, 26-Apr-2022 19:00:00 GMT; path=/ Set-Cookie: SPEED=N; domain=.msn.com; expires=Thu, 14-Apr-2005 14:37:58 GMT; path=/ Content-Length: 29257

Im using PHP fsockopen

My main Function

 function fetchURL( $url ) {
   $url_parsed = parse_url($url);
   $host = $url_parsed["host"];
   $port = $url_parsed["port"];
   if ($port==0)
       $port = 80;
   $path = $url_parsed["path"];

   //if url is [url]http://example.com[/url] without final "/"
   //I was getting a 400 error
   if (empty($path))
   $path="/";

   //redirection if url is in wrong format
   if (empty($host)):
   $host="www.daemonprojects.com";
   $path="/404.php";
   endif;

   if ($url_parsed["query"] != "")
       $path .= "?".$url_parsed["query"];
   $out = "GET / HTTP/1.1\r\n";
   $out .= "Host: ".$host."\r\n";
   $out .= "Content-type: application/x-www-form-urlencoded\r\n";
   $out .= "User-Agent: mozilla Portal\r\n";
   $out .= "Connection: Close\r\n\r\n";
   $fp = fsockopen($host, $port, $errno, $errstr, 30);
   fwrite($fp, $out);
   while (!feof($fp)) {

   //filter
   $getdata = fgets($fp, 128);
   //Slashdot Stuff
   $getdata = eregi_replace("HTTP/1.1 200 OK", "", $getdata);
   $getdata = eregi_replace("Cache-Control: private", "", $getdata);
   $getdata = eregi_replace("Pragma: private", "", $getdata);
   $getdata = eregi_replace("Vary: User-Agent,Accept-Encoding", "", $getdata);
   $getdata = eregi_replace("Connection: close", "", $getdata);
   $getdata = eregi_replace("Transfer-Encoding: chunked", "", $getdata);
   $getdata = eregi_replace("Content-Type: text/html; charset=iso-8859-1", "", $getdata);
   $getdata = eregi_replace("Server: Apache/1.3.33 (Unix) mod_gzip/1.3.26.1a mod_perl/1.29", "", $getdata);   

   $getdata = eregi_replace("SLASH_LOG_DATA: shtml", "", $getdata);   

   $getdata = eregi_replace("X-Powered-By: Slash 2.005000", "", $getdata);
   $getdata = eregi_replace("e5a", "", $getdata);

   //CNN Stuff
    $getdata = eregi_replace("Server: Apache", "", $getdata);
	$getdata = eregi_replace("Content-Type: text/html", "", $getdata);
	$getdata = eregi_replace("Cache-Control: max-age=60, private", "", $getdata);
	$getdata = eregi_replace("Vary: Accept-Encoding,User-Agent", "", $getdata);
	$getdata = eregi_replace("Content-Length: 61153", "", $getdata);

//MISC
$getdata = eregi_replace("X-Powered-By: PHP/4.3.10", "", $getdata);
$getdata = eregi_replace("mod_ssl/2.8.16", "", $getdata);
$getdata = eregi_replace("OpenSSL/0.9.6b PHP/4.3.10 e70", "", $getdata);
$getdata = eregi_replace("Accept-Ranges: bytes", "", $getdata);
$getdata = eregi_replace("Keep-Alive: timeout=15, max=996", "", $getdata);
$getdata = eregi_replace("Connection: Keep-Alive", "", $getdata);

//MSN
$getdata = eregi_replace("X-Powered-By: ASP.NET", "", $getdata);
$getdata = eregi_replace("X-AspNet-Version: 1.1.4322", "", $getdata);
$getdata = eregi_replace("Cache-Control: no-cache", "", $getdata);
$getdata = eregi_replace("Pragma: no-cache", "", $getdata);
$getdata = eregi_replace("Expires: -1", "", $getdata);
$getdata = eregi_replace("Content-Length: 29258", "", $getdata);
$getdata = eregi_replace("Server: Microsoft-IIS/5.0", "", $getdata);
$getdata = eregi_replace('P3P:CP="BUS CUR CONo FIN IVDo ONL OUR PHY SAMo TELo"', "", $getdata);
$getdata = eregi_replace('Server: Microsoft-IIS/6.0', "", $getdata);
$getdata = eregi_replace('; charset=utf-8', "", $getdata);
$getdata = eregi_replace('Content-Length: 29245', "", $getdata);


   echo $getdata;
   }
   fclose($fp);
   return $in;
}

[sysera]

This seems interesting. What is the purpose of your project, I don't quite follow what's going on.

[DigitalExpl0it]

here test it out 🙂

http://daemonprojects.com/portal/

basicly I want to load websites within the same page. So its all going through my site kinda like a proxy server. This is for my psp 🙂

[bpat1434]

I get the header output on the page when viewing the cnn.com page.

Have you thought of just using a regex to replace those values?

RegEx Documentation
RegEx Help

You would essentially use
ereg_replace("String_expression", "string_replace", String_Name);

Right now, you could use str_replace() and achieve the same effect.

~Brett

[sysera]

Originally posted by DigitalExpl0it
here test it out 🙂

http://daemonprojects.com/portal/

basicly I want to load websites within the same page. So its all going through my site kinda like a proxy server. This is for my psp 🙂

This is neat. Thank you for sharing. 🙂

[DigitalExpl0it]

Originally posted by bpat1434
I get the header output on the page when viewing the cnn.com page.

Have you thought of just using a regex to replace those values?

RegEx Documentation
RegEx Help

You would essentially use
ereg_replace("String_expression", "string_replace", String_Name);

Right now, you could use str_replace() and achieve the same effect.

~Brett

hey thanks 🙂

   //filter
   $getdata = fgets($fp, 128);
	$getdata = eregi_replace("^Content-Type:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Server:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Date:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Last-Modified:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Cache-Control:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Vary:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Expires:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Content-Length:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Connection:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^SLASH_LOG_DATA:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^X-Powered-By:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^X-Bender:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Pragma:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^Transfer-Encoding:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("^X-Fry:.[a-z]+.*", "", $getdata);
	$getdata = eregi_replace("HTTP/1.1 200 OK", "", $getdata);

[DigitalExpl0it]

for who ever wants the code for a little portal of there own heres the link to the code

http://daemonprojects.com/portal/code.txt

[bpat1434]

Might want to change the eregi_replace("^{Content-Length:.[a-z]+.",} "", $getdata);
with:
$getdata = eregi_replace("^{Content-Length:.[a-z0-9]+.}", "", $getdata);

I say this because CNN.com has a content length of: 59096

Just an FYI.

~Brett

[DigitalExpl0it]

now to check and change url links on the page.

like

<a target="new" href="/cnnsi/scorecard/">Truth & Rumors: Griffey a Yankee?</a><br>

need to change the link to have the url ($host) in front of the link nt sure how to do this

<a target="new" href="http://www.cnn.com/cnnsi/scorecard/">Truth & Rumors: Griffey a Yankee?</a><br>

[bpat1434]

what was that directed to, and what does it mean?

~Brett

[DigitalExpl0it]

basicly since most web programmers use

short urls in there a href tags I need to check them and put the full url back in

example:

<a href="images/img1.jpg">

needs to be

<a href="http://www.yoursite.com/images/img1.jpg">

[bpat1434]

are you asking how to do it, or telling people that use your script to do it?

~Brett

[DigitalExpl0it]

haha sorry how to do it

[bpat1434]

Use another regex and search for strings like:

^{="[a-zA-Z0-9]/[a-zA-Z0-9].[a-zA-Z]"$}

and replace with:

="$url.previous_code"

~Brett

[DigitalExpl0it]

umm this seems not to do anything

	$get_url = strstr($getdata, 'href="');
	$get_url = eregi_replace('href="', '', $get_url);
	$get_url = eregi_replace('">', '', $get_url);
	$getdata = eregi_replace('^href="[a-zA-Z0-9]/[a-zA-Z0-9].[a-zA-Z]"$', 'href='.$host.$get_url, $getdata);