Grab Source and Create Page Question

BlackList

Howdy Guys,

I am looking for help on creating a script that will grab the source code of a site and create the page with the source code.

Now my idea is to have some kind of spider go and grab the code then add it to a variable then use a fopen to upload to a site

I am wanting to create a page dynamically then grab the source and create a .html page that mirrors the dynamic page.

Any Ideas on how to do this?

BlackList

As I was searching around the internet I found this code...

 // for grabbing html sources in your domain by reading from url 
 //$source = file ("http://www.php.net/", "r");

 // for grabbing html in your domain by reading from shared folder
 $source = file ("g:/shared/a.html", "r");

 for ($i=0; $i<count($source); $i++)
   echo htmlspecialchars($source[$i])."<br>";

What does the htmlspecialchars do?

And if it does get the source should I put a \n instead of a <br> and save it as a variable? With something like

$code = htmlspecialchars(blah)."\n"; ??

BlackList

Ok, Well I tested it and the code does spit out the html...

BUT, When I try to save it as a variable it only saves the last line of code.

How would I create the loop so it captures all the source?

NogDog

$file = "g:/shared/a.html";
if(is_readable($file))
{
   echo htmlspecialchars(file_get_contents($file));
}
else
{
   user_error("File '$file' does not exist or is not readable.", E_USER_WARNING);
}

big_nerd

BlackList ->

$source is an array... so it is a variable as it is.

The statement:

for ($i=0; $i<count($source); $i++) 
   echo htmlspecialchars($source[$i])."<br>";

What do you want to do with this?

Perhaps there is another approach you are unaware of.

Regards,

Michael [big.nerd]

BlackList

After putting my head down with some trial and error I came up with this.

$source = file_get_contents("http://www.mysite.com/index.php", 200000);

So that work.

Heres what my goal is...

To grab the content on the page and output it to another page.

while($copy = mysql_fetch_array($copyPages)){

$ourFileName = "ftp://siteuser:password@url.com/".$copy['incname']."1.php";
$ourFileHandle = fopen($ourFileName, 'w') or die("can't open file");
$source = file_get_contents("http://www.mysite.com/".$copy['incname'].".php", 2000000000);
fwrite($ourFileHandle, $source );

}

Now when I run this it says there is to many ftp connections.

What is the best way to create all these files with one ftp connection...

I looked at the FTP section in the manual but I could not find anything that will create a page... I dont have alot of experiance with this so I could really use yalls help.

big_nerd

BlackList,

You are fetching an array from a MySQL Database, are you putting this information from an HTML page into a MySQL Database, Then taking it out of the database in order to output to a file?

From what I understand, you wish to take an html file, and put the output into a file, and ftp it somewhere else?

Regards,

Michael [big.nerd]

BlackList

Let me see how I can explain this... sorry for the confusion.

I have created a CMS and when the client wants to leave my service I want to take out my CMS code in the page but still leave them with the content they wrote.

So in theory I can scrape the code from the page, save it to a variable, delete the page then upload the same page with the scraped html content. This creates a identical page without the PHP.

So for example, Johnny Drake has a service with us. His website has 5 pages.
Index, About, Service, Solutions and Contact Us.

He decieds he can get better service else where, so I click delete in my admin and the server goes through the index page, scrapes the generated html code, deletes the index page and re uploads the index page with the scraped generated html code. Then it does it for the rest of the pages.

This would work if I allowed more connections to my ftp, but I would like to do it with one connection. What is the best way to do this?

Weedpacket

Assuming you can determine the appropriate URL for viewing each page:

$generated_html = file_get_contents('http://client.example.com/About');

Ask the web server for the page. For the web server to serve the page it will have to ask (another instance of) PHP to generate the page and send back the resulting HTML.

BlackList

Well, I can determine the URL.

Ok, So I have the contents but I have about 5 pages that I want to do this to and every time I do the fopen/fwrite thing it opens a new ftp and when it does that it creates to many connections to the server.

How do I do this while only creating one server?

BlackList

I figured out how to do it.

I started a FTP connection.
Downloaded the old files.
Got the source of the generated pages.
Used fopen to edited the already downloaded pages.
Then reuploaded the pages to overwrite the old ones with the generated code.

Thanks for your help. Learned alot with trial and erroring this.