I'm building an upload interface for a company and they a 3 meg tab delimited file which they export from their Quickbooks accounting software... (an .IIF file) which is their inventory file.
There are numerous fields in the file, but I only need to place 8 of the fields for each item in the file into a table in their mySQL database on their hosted site.
I have been able to code in PHP to browse to the file, upload it to the webserver, and parse the file on the webserver using PHP, pulling the needed data elements, write them into the database table, and when done, delete the file.
This all works great with my smaller (100 items) version of the .IIF file... but when I run the full size file, it always gags after about 1 minute 30 seconds.... after almost 1000 rows are entered into the datebase. (which is maybe only about 5-10% of the rows in the file)
The error I get is just a failed SQL query (my generic error message if the query fails).. .but it fails at exactly the same point every time. I have looked at the source file and see no error in the data structure that is causing it to halt at this location... is there a time limit or number of querys per second I can't exceed with mysql or the webserver that is causing this file to stop at this point?
how can I test to see if this is the probelm or if it is something else?
