Log management
Feature state: stable
Automated log management on Kubernetes
Log events are essential when hosting mission critical software. All Kubernetes clusters deployed by Avisi Cloud come with a log event forward agent configured, that will automatically pick up any container logging and forward it to a centralized system. Powered by Grafana’s open-source project Loki.
Automatic Log Collection
Key Features
- Automatic Log Collection: All Kubernetes clusters deployed by Avisi Cloud are equipped with a log event forward agent. This agent automatically collects logs from all containers.
- Centralized Log Aggregation: Logs from various sources are aggregated into a centralized system, making it easier to analyze and manage them.
- Powered by Grafana Loki: Utilizes the open-source project Loki from Grafana, known for its efficiency and scalability in handling logs.
Benefits
- Simplified Management: Eliminates the complexity of manually configuring log collection and management. Scalability: Effortlessly scales with your Kubernetes deployments.
- Real-Time Insights: Provides real-time visibility into your applications and infrastructure.
- Cost-Effective: Reduces the cost associated with traditional log management solutions.
What are Logs in Kubernetes?
Logs in Kubernetes are records of events that happen in the containers running within the pods of a Kubernetes cluster. These logs are vital for understanding the behavior of applications and the Kubernetes system itself.
In Kubernetes, container logs can be written to stdout, which is the standard output stream. This allows logs to be easily collected and forwarded.
Importance of Log Management
- Troubleshooting and Debugging: Quickly identify and resolve issues within applications and infrastructure.
- Monitoring and Performance Analysis: Track the health and performance of applications and infrastructure.
- Security and Compliance: Monitor logs for security incidents and ensure compliance with various standards.
How It Works
Log Collection
The log event forward agent deployed in each Kubernetes cluster automatically detects and collects logs from all running containers. The agent is designed to handle logs of various formats and sources.
Log Forwarding
Collected logs are forwarded to a centralized log management system. This process is seamless and ensures no loss of log data during transmission.
Log Storage and Management
Logs are stored in a scalable and secure manner. Grafana Loki, known for its high-performance and low-cost storage, is used for log storage. The logs are stored in a multi-tenant solution with strong authentication and access control. Access to the logs is protected through Access Tokens, with optional IP restrictions and API scopes (read-only).
Log Analysis and Visualization
Users can analyze and visualize logs using Grafana or any other Loki compatible solution, an open-source platform for monitoring and observability. This provides powerful querying capabilities and customizable dashboards for in-depth analysis.