Over the past few weeks I've been writing an Apache Log file parser, which breaks down each file entry into variables and then creates individual records that are inserted into a mysql db.
The problem which I am having is that whenever the parser is run, even if files have already been parsed and inserted into the db, they are "reparsed " and entered again.
At the moment I am thinking along the lines of recording each "parsed" filename in a seperate file (entered.dat), and then only carrying out the parsing/insertion if the current file is not listed in entered.dat
Any pointers on where and/or how to start to solve this problem.
Cheers
