php time out

tygg

Hi all.

I use a php script to make subdomains from a txt file, but the shared server I use times out after 5 mins. What can I do to prevent this.

Thanks for an answer, best, t.

Houdini

Perhaps it is the script itself and not the server why dont you post it? Please when posting code use the button that looks like ~ inside a white dogeared page after selecting the code with your mouse. or place the BB Code manually [ php ] and [ /php ] without the spaces between the brackets [] other wise the post parser would interpret it as a valid code to render PHP.

tygg

$words = file("subdomains.txt");
foreach ($words as $word) {
$response = file_get_contents(

"http://user: [email]pass@*****:2082/frontend/rvlightolive/subdomain/doadddomain .html[/email]?domain=$word&rootdomain=fr***** .info");

//do error checking by seeing if $response contains the HTML output of that URL you expect
}
echo "Done! Added " . count($words) . " subdomains.";

bradgrafelman

So basically, you're grabbing a line from a file, and making an HTTP request for each line? Wow, talk about resource heavy.

This might be a possible option, though I don't know if it would be a good solution or not, so I'm open to opinions:

 * Splitting up the load - only do a certain number of subdomains per execution. Use multiple instances (though not too many!) simultaneously to work through the list. If you're on a unix server, you could do something like this:

$words = file('subdomains.txt');
$lines = count($words);

$limit = 15; // how many subdomains per instance

for($i = 0; $i <= $lines; $i+= $limit) {
     exec("/path/to/php -d register_argc_argv=On -f myScript.php $i " . ($i+$limit) . ' &');
}

Then, in myScript.php, you would use the first parameter passed as the starting point in the files() array, and use the second parameter to determine how many subdomains the script should do before stopping.

EDIT: By the way, this solution assumes that you: a) Are on a Unix-based server, and b) Have [man]exec[/man]ute permissions

tygg

Thanks. Could you please show me how the complete code would look like. I am new on php: )

bradgrafelman

Well... what all are you doing? I see you're retrieving a remote web page, and then you say this:

//do error checking by seeing if $response contains the HTML output of that URL you expect

How are you checking? What do you do if it doesn't contain what you expect? What do you do if it does?

tygg

What I do is that I create subdomains on my domain from a txt file.

This code part confirms that the sub domains are made:

//do error checking by seeing if $response contains the HTML output of that URL you expect
}
echo "Done! Added " . count($words) . " subdomains.";

bradgrafelman

Oh, I see, so by simply making a request to the URL, the subdomain is created?

If that's the case, can you show me the string you check for in the HTML to verify it was created successfully?

tygg

That must be the string from the original code I suppose:
"http://**:@***:2082/frontend/rvlightolive/subdomain/doadddomain.html?domain=$word&rootdomain=***.info");

This is the string you get when you create a sub domain in control panel and control panel confirms that the sub domain are created.

bradgrafelman

Is that the string that you check for, or is that the URL?

I'm talking about what text are you searching for inside the HTML of the page returned (inside $response) that tells you if it was successful or not.

tygg

That is the url yes.

This is the text on the page:

"SubDomain Added
Bind reloading on using rndc zone: [*.info] The subdomain, **.*****.info has been added. "

Anyway, I dont really need confirmation. If its easyer to forget the below code, just forget it.

//do error checking by seeing if $response contains the HTML output of that URL you expect
}
echo "Done! Added " . count($words) . " subdomains.";

bradgrafelman

Is there any way you can contact me via an IM program such as AIM, MSN, or YIM? If so, which?

tygg

I wish, that would be nice, but I dont have any of them, not even messenger.

Somebody mentioned this:

http://au.php.net/register-shutdown-function
Allows a script to continue running after it closes its connection with a browser. I dont understand it, can I use it in my case ?

bradgrafelman

Dang... I was hoping you would so we could do some real-time troubleshooting and Q&A.

Well... the best I can do is attach what I did to this post along with a little instruction and hope that you can work it out from there! :p

Basically what you'd do is place the two .txt files into the same directory as subdomains.txt and then rename the two files to have a .php extension (don't forget to do this!!).

Now you would simply open up a browser and visit the add_subdomains.php page. If all goes well, it will start the worker processes that will start adding subdomains. The first snag I see is that I'm assuming the php executable has been placed in some bin location so that you can run it just like you would any other command. If this is not so, you'll have to modify line #35 of add_subdomains.php and instead of exec("php -d you'll have to use exec("/path/to/php -d" .

If you encounter any errors (make sure display_errors is set to On and error_reporting set to E_ALL), let me know.

EDIT: Well, not sure... the time limit sounds like it's being enforced by PHP's max execution time. One thing you might try instead is calling [man]ini_set/man at the top of your script and set 'max_execution_time' to something high.

What I find strange is that you mention the 5 minute timeout, which is actually the default timeout for Apache's Timeout directive. In that case, the webserver would be stopping your script after that timeout no matter what time limit you set in PHP. That's why I went with my approach of splitting up the workload.

tygg

Great, I will try my best : )
Thanks a lot. Its in the middle of the night now and should sleep, I will see how much I can do before I sleep.

bradgrafelman

No problem.

Feel free to give up on it and get some rest for tonight. I have email notification turned on, so you can reply back sometime tomorrow when you've had a chance to mess around with this and we can talk then.

tygg

Answer to your previous post: The time out is always after 5 mins so splitting it up must be the solution.

I tried this:

ini_set("safe_mode" , "0");
ini_set("max_execution_time" , "100");

and:

ini_set("max_execution_time","0");

non of them can overcome the time limit.

With your script I get this message:

Fatal error: Call to undefined function: intlval() in /home/mosktinf/public_html/add_subdomains.php on line 44

and a bunch of txt files on my server with the number 0 inside.

bradgrafelman

Ick! Typo! Change this:

	$lines = intlval(@$_GET['lines']);

to this:

	$lines = intval(@$_GET['lines']);

tygg

Ok, I found the same typo in line 10 also. Typos comes when you least expect them : )

Now I get:

Warning: file_get_contents(worker_1.txt): failed to open stream: No such file or directory in /home/mosktinf/public_html/freeworldcityinfo/add_subdomains.php on line 48

The server is still processing the subdomains...

If you are not redirected within 10 seconds, click here

(You have waited 10 of 600 seconds.)

I get .txt files on the server:
worker_0.txt
worker_15.txt
worker_30.txt
worker_45.txt
and so on

bradgrafelman

Once again, this is my fault in not checking over my code. Replace your copy of add_subdomains.php with the attached text file (renaming it to .php, of course)