The company I work for does a large amount of data processing. We rely on checking the logs on the FTP server to verify that all files were processed. Here is my dilemma as I am developing some intranet applications for the data center:
We would like to bring the log file (in a CSV format from a Microsoft FTP server) into a database, where my programs would associate with a specific customer and a specific event. What is the best way to bring this into the database? My build of MySQL has load data disabled. I need a way to enable it or to get around that. We're not talking about huge log files. Usually they contain 2,000 to 4,000 entries in a day, with heavy days hitting 6,000. (This does not mean 6,000 files transferred, as it logs log ons, directory changes, etc.) I could do an FTP get from a php function and pull the file into the DB through load data, but is there a better way?
