str_replace doesnt work with a lot of data

[Godius]

I have a small script that replaces the names of the database tabels in a database dump.

<?php

// bestanden openen
$file	= fopen("database.txt",'r+');
$file2	= fopen("database2.txt",'w');

$data = fread($file,filesize("database.txt"));
fclose($file);

// data bewerken
//$data = str_replace("CategorieEigenschappen", "pw_new_CategorieEigenschappen", $data);
//$data = str_replace("Categorieen", "pw_new_Categorieen", $data);
//$data = str_replace("EigenschapItems", "pw_new_EigenschapItems", $data);
//$data = str_replace("Merken", "pw_new_Merken", $data);
//$data = str_replace("OnderdeelEigenschappen", "pw_new_OnderdeelEigenschappen", $data);
//$data = str_replace("Onderdelen", "pw_new_Onderdelen", $data);
//$data = str_replace("Prijzen", "pw_new_Prijzen", $data);
//$data = str_replace("WinkelVestigingen", "pw_new_WinkelVestigingen", $data);
//$data = str_replace("Winkels", "pw_new_Winkels", $data);

// wegschrijven 
fwrite($file2,$data);

// afsluiten zooi
fclose($file2);

?>

My script crashes because the .txt file is more than 5Megabytes big. Therefore it doesnt work. Is there another way 2 do this?

[planetsim]

if your text files are that big id suggest taking advantage of a database. Im not sure on the limitations of the str_replace() and how much data it can handle but like i said before text files that big should be in a database.

Id say your processing speed would be quite slow, having the database and indexing feilds not only help reduce server overload but make accessing the site much quicker

[HalfaBee]

Why not do it in decent sized chunks, say 100,000

<?php 

// bestanden openen 
$file    = fopen("database.txt",'r+'); 
$file2    = fopen("database2.txt",'w'); 

while( $data = fread($file, 100,000 ) ) {

// data bewerken 
//$data = str_replace("CategorieEigenschappen", "pw_new_CategorieEigenschappen", $data); 
//$data = str_replace("Categorieen", "pw_new_Categorieen", $data); 
//$data = str_replace("EigenschapItems", "pw_new_EigenschapItems", $data); 
//$data = str_replace("Merken", "pw_new_Merken", $data); 
//$data = str_replace("OnderdeelEigenschappen", "pw_new_OnderdeelEigenschappen", $data); 
//$data = str_replace("Onderdelen", "pw_new_Onderdelen", $data); 
//$data = str_replace("Prijzen", "pw_new_Prijzen", $data); 
//$data = str_replace("WinkelVestigingen", "pw_new_WinkelVestigingen", $data); 
//$data = str_replace("Winkels", "pw_new_Winkels", $data); 

// wegschrijven 
fwrite($file2,$data); 

}
    // afsluiten zooi 
    fclose($file2); 
    fclose($file); 

?> 

HalfaBee

[Weedpacket]

It's not str_replace that's the problem, but the memory_limit setting in php.ini; the default is 8MB and during processing you'll need 10MB to store a 5MB string and its working copy.

Just as a suggestion, you can pass arrays to str_replace. Also, preg_replace might be looked at:

$tables=array(
'CategorieEigenschappen',
'Categorieen',
'EigenschapItems',
...
);
$tablestring='/('.join('|',$tables).')/';
$data = preg_replace($tablestring,"pw_new_$1", $data);