• PHP Help
  • Best way to aggregate logs across servers in scalable application?

Hey everyone. I have an app that I am planning to scale by cloning the server at will and using a cloud managed database. This will give me parallel processing power. What I need is a way to aggregate the logs across these servers. I currently generate about 5,000 log messages per day on one server and soon it will be 10-20x that amount.

I don't want to use sentry for this because 1. they charge per log so it will get expensive fast, and 2. I am logging a lot of informational notices and warnings not just errors.

I have looked at datadog and I might go that route. But it is very complex and probably one step ahead of where my brain is at currently.

Right now I just have my own client app I have built which parses my logs. So if I could create one aggregate log, this would be fine. I use Monolog for logging currently.

I have thought of a few different ideas but what I am unsure of is reliability in an exception or error thrown situation.

    Not my area of expertise, but I do know that where I work we're currently looking at migrating from ELK (Elasticache, Logstash, Kibana) to Datadog, due to apparent pricing benefits of the latter. FWIW. 🙂

      My company just started looking at DataDog, and I gotta say it looks pretty freakin' hot so far.

        You're not the first spammer to try posting a Reddit thread and following it up with advertising.

        Write a Reply...