Max records my script can handle?

techrat

I've written a script that I need to test for overload breakage. The script does several things:

Parses a CSV file (101 fields, over 1200 records) into an array
Grabs the first line of the array to create a temp table & columns
Populates the temp table with the rest of the array data
Selects the 'real' data from the temp table into the real table
Displays the counts for the scrubbed data

Another script I'm writting will deal with manipulating the real database. What I would like to find out is if someone knows a good way for me to test this thing to see what is the MAX number of records it will process before memory or timer overload?

Before someone asks:
The client refuses to accept a web based interface for inputting the data directly into a database.

Techrat
🙂

TTT

timer is set in php.ini (default 30 sec).
i you think that you run out of memory, i suggest that you make counter that check ex. mod coutner 100 == 0 --> sleep(4) , that gives time to other process

techrat

The program will not be necessarily running on my server. Meaning, I might not be able to change the timer or memory settings, so I need to find out how many records will max out the program.

Bunkermaster

will probably depend on CPU and memory available at the time of your parsing...

drsenay

Why not have the script call itself after every 1000 records or so, passing a pointer to the last row it processed, thus it just re-starts itself every 20 seconds or so and picks up right where it left off! Just keep track of where you are in the file (bytes, lines, whatever) and have a counter running...

As to NOT having a web based interface, point out to your client the value of a centralized master system with high ROI, low TCO, no need to roll out new versions of software to terminals/workstations etc, and how well the system can perform... One of my business units (partysite.com) has a web interface for customers to work with (it is afterall a web portal) and processes requests most of the time in under a second, at the most a couple of seconds, but the big thing to remember is that the database has OVER 1,500,000 records in it...

Scott...

plumfool

Looks like you have been hacked! 🙁