Grafana Loki: Architecture and running in Kubernetes with AWS S3 storage and boltdb-shipper

Click for: original source

In the new project, there is no logging system at all, and since we all love the Grafana stack, we also decided to use Loki for logging. Loki is built on a microservices architecture, with all microservices assembled into a single binary. By Arseny Zinchenko.

The article then makes a good job explaining:

  • Grafana Loki architecture
  • Loki components
  • Data flow
  • Read Path
  • Write Path
  • Simple scalable deployment mode
  • Microservices mode
  • Grafana Loki Storage
  • Loki Helm charts
  • Helm chart, and Deployment Mode

… and more. All commands and configuration included. Loki receives data from multiple streams, where each stream is a tenant_id and a set of tags. When receiving new records from the stream, they are packed into chunks and sent to long-term storage, which can be AWS S3, a local file system, or databases such as AWS DynamoDB or Apache Cassandra. Interesting read!

[Read More]

Tags monitoring cicd cio devops cloud aws