The four types of logs collected and sent to Stackdriver are:
controllerlog_cleanerserverstate_change
Below are some example screenshots to illustrate what a user will see within Google Stackdriver Logging
Apache Kafka Controller Logs Example
Apache Kafka Log_Cleaner Logs Example
Apache Kafka Server Logs Example
Apache Kafka State_Changed Logs Example
Follow these steps to set up log collection from Apache Kafka.
Pre-requisites
Locate the local Tomcat access log directory.
Configure a Apache Tomcat Source
- Install the BindPlane Log Agent on the host system.
- Login to BindPlane and select the Logs tab.
Logs Tab
- Select the Sources tab.
Sources Tab
- In the top-right portion of the screen, click on the Add Source Configuration button
Add Source Configuration Button
- Choose Apache Kafka
- Select which log files you want to monitor, and fill out the Kafka file locations for them.
Apache Kafka Log Configuration Form
Kafka Log location
To find your Kafka logging location you can check your Kafka configuration.
For more information, Click here.