Is that too long?
If it is, you could consider using system function - rm - to do the delete, assuming you're able to identify which files are cache files (rm *_cache say). I don't know if you're using subdirectories to store your cache files (and with that many files you should be grouping them - many filesystems would struggle with a figure like 100,000 files in one directory anyway, so even the system call might be slow) - hang on, I don't think Cache_Lite has that, I think I'm thinking of Cache.