May array size?

Tracer

Whats the Maximum array size in PHP?

I am querying an enterprise database from ODBC, playing with the data, then puttin it into a MySQL DB. About 15,000 records per script run (each record has about 10 fields).

Should I save this info to some sort of flat file before putting it into MySQl, or just create a giant array?

LordShryku

Well, I'd think the flat file would be easier to do. Save them in the file as SQL Insert queries, and you can load the whole file in one shot using mysql command line.

To answer the question, it should be safe to load it into an array, if that's the way you want to go. AFAIK, arrays have no defined maximum size.

Weedpacket

Originally posted by LordShryku
If that's the way you want to go. AFAIK, arrays have no defined maximum size.

I've worked with arrays containing 16e6+ integers at times; needless to say I had to bump up PHP's maximum memory allowance.

I was wondering though why the "sort of flat file" or giant array would be necessary. If the "playing with the data" involves global operations then a flat file would be useless, but if it doesn't, then surely the results could be moved into the MySQL db as they're generated, without having to wait until everything has been read from the ODBC db.

Tracer

Well, the PHP script generating the ODBC query is on an on-site Intranet machine. The MySQL server is off-site.

The ODBC query already takes about 30 minutes to run and fetch the data locally, so I would rather submit all the results in one big insert or set of inserts rather than ODBC --> RECORD --> MANIPULATE --> MySQL (x10,000 times.)

Weedpacket

In that case I'd agree with LordShryku's suggestion; write a text file containing INSERT queries, and then just blat all that into MySQL.