BindPlane Documentation

Apache Kafka

Suggest Edits

Logs Collected

The four types of logs collected and sent to Stackdriver are:

  • controller
  • log_cleaner
  • server
  • state_change

Below are some example screenshots to illustrate what a user will see within Google Stackdriver Logging

Apache Kafka Controller Logs ExampleApache Kafka Controller Logs Example

Apache Kafka Controller Logs Example

Apache Kafka Log_Cleaner Logs ExampleApache Kafka Log_Cleaner Logs Example

Apache Kafka Log_Cleaner Logs Example

Apache Kafka Server Logs ExampleApache Kafka Server Logs Example

Apache Kafka Server Logs Example

Apache Kafka State_Changed Logs ExampleApache Kafka State_Changed Logs Example

Apache Kafka State_Changed Logs Example

Supported Versions

Apache Kafka: 1.0.0 - 2.0.10+

Log Collection Setup

Follow these steps to set up log collection from Apache Kafka.

Pre-requisites

Locate the local Tomcat access log directory.

Configure a Apache Tomcat Source

  1. Install the BindPlane Log Agent on the host system.
  2. Login to BindPlane and select the Logs tab.
Logs TabLogs Tab

Logs Tab

  1. Select the Sources tab.
Sources TabSources Tab

Sources Tab

  1. In the top-right portion of the screen, click on the Add Source Configuration button
Add Source Configuration ButtonAdd Source Configuration Button

Add Source Configuration Button

  1. Choose Apache Kafka
  2. Select which log files you want to monitor, and fill out the Kafka file locations for them.
Apache Kafka Log Configuration FormApache Kafka Log Configuration Form

Apache Kafka Log Configuration Form

📘

Kafka Log location

To find your Kafka logging location you can check your Kafka configuration.

For more information, Click here.

Updated over 2 years ago