I developed a document review system and am currently creating the latest version.
What is the most efficient way to track user activity? I am currently updating a .txt file with username, timestamp, IP and URL. The file was 3.6MB after 2 months of tracking while developing and being the only user. There are almost 260 users, but only 146 have actually entered information into the system. I already track information when comments are entered or modified, but I want to track ALL page hits by everyone.
This program gets hit pretty hard by a large number of people entering comments for their document reviews. Once this new version is released, I don't want to have the user activity log take 9 hours to load.