Apache Kafka

Logs Collected

The four types of logs collected and sent to Stackdriver are:

  • controller
  • log_cleaner
  • server
  • state_change

Below are some example screenshots to illustrate what a user will see within Google Stackdriver Logging


Apache Kafka Controller Logs Example


Apache Kafka Log_Cleaner Logs Example


Apache Kafka Server Logs Example


Apache Kafka State_Changed Logs Example

Supported Versions

Apache Kafka: 1.0.0 - 2.0.10+

Log Collection Setup

Follow these steps to set up log collection from Apache Kafka.


Locate the local Tomcat access log directory.

Configure a Apache Tomcat Source

  1. Install the BindPlane Log Agent on the host system.
  2. Login to BindPlane and select the Logs tab.

Logs Tab

  1. Select the Sources tab.

Sources Tab

  1. In the top-right portion of the screen, click on the Add Source Configuration button

Add Source Configuration Button

  1. Choose Apache Kafka
  2. Select which log files you want to monitor, and fill out the Kafka file locations for them.

Apache Kafka Log Configuration Form


Kafka Log location

To find your Kafka logging location you can check your Kafka configuration.

For more information, Click here.