download / inser large data amount

olaf

Hallo,

I have to download a file (CSV) that holds ca. 7000 rows. These rows have to be inserted into the database.

Should there a problem while processing the script?

If I use set_time_limit(600), would that be a problem?

Note: I have absolut no problems with code it's only about the performance.
See this script as example:
http://www.finalwebsites.com/snippets.php?id=23

Thanks...

SumitGupta

Hi,

Usually running that CSV will taken less than the time you have set...though you can set it to "0" zero so that it will never time out...

I haev written a script that parse more than 50000 record a time so it has no problem in it...

and for the Parsing of the file it is better if you put the CSV in the Web location I mean to say the CSV should be in the server itself if you want to insert it in database as it was much faster than uploading file and parse it at same time...

Have a nice day...

olaf

Thanks for your answer...

The CSV file is generated with PHP on a remote location. Maybe i should copy the (result) first?

SumitGupta

Your are most welcomed ..can you make your site in english...🙂

I am not able to read the contents..🙂

olaf

hehe... the content for the int. public is in english language (snippets) and the contact form is in two languages after I got mails more than twice because the user did not understand the messages 😃

olaf

Ah.. one thing more, not the case of a time-out likes me a problem but more the max_execution_time...

any ideas?

olaf

Finally, I thought about a system which will do several tasks:

1 process somthing
2 process more
3 ...
4 email process results

It's possible that the execution time for all processes together take more time then 1 minute.

I would like to run this/these script with a CRON job, thats why I want to know if set_time_limit() is the only thing I have to set?

How are maintenance scripts regulary processed?

olaf

Hello,

Is here no programmer with some knowledge about this item?

SumitGupta

Hi,

Sorry I am a bit late..

Yes you just need to set the set_time_limit() and it will run for the given time...😃

olaf

Thanks for helping again...

so you mean I have to put all code into one script and then raise the time limit?

Is there a maximum?