Hey everyone. I have an app that I am planning to scale by cloning the server at will and using a cloud managed database. This will give me parallel processing power. What I need is a way to aggregate the logs across these servers. I currently generate about 5,000 log messages per day on one server and soon it will be 10-20x that amount.
I don't want to use sentry for this because 1. they charge per log so it will get expensive fast, and 2. I am logging a lot of informational notices and warnings not just errors.
I have looked at datadog and I might go that route. But it is very complex and probably one step ahead of where my brain is at currently.
Right now I just have my own client app I have built which parses my logs. So if I could create one aggregate log, this would be fine. I use Monolog for logging currently.
I have thought of a few different ideas but what I am unsure of is reliability in an exception or error thrown situation.