Apache Kafka
Logs Collected
The four types of logs collected and sent to Stackdriver are:
controller
log_cleaner
server
state_change
Below are some example screenshots to illustrate what a user will see within Google Stackdriver Logging


Apache Kafka Controller Logs Example


Apache Kafka Log_Cleaner Logs Example


Apache Kafka Server Logs Example


Apache Kafka State_Changed Logs Example
Supported Versions
Apache Kafka: 1.0.0 - 2.0.10+
Log Collection Setup
Follow these steps to set up log collection from Apache Kafka.
Pre-requisites
Locate the local Tomcat access log directory.
Configure a Apache Tomcat Source
- Install the BindPlane Log Agent on the host system.
- Login to BindPlane and select the Logs tab.


Logs Tab
- Select the Sources tab.


Sources Tab
- In the top-right portion of the screen, click on the Add Source Configuration button


Add Source Configuration Button
- Choose Apache Kafka
- Select which log files you want to monitor, and fill out the Kafka file locations for them.


Apache Kafka Log Configuration Form
Kafka Log location
To find your Kafka logging location you can check your Kafka configuration.
For more information, Click here.
Updated over 2 years ago