Apache Kafka

Logs Collected

The four types of logs collected and sent to Stackdriver are:

  • controller
  • log_cleaner
  • server
  • state_change

Below are some example screenshots to illustrate what a user will see within Google Stackdriver Logging

19581958

Apache Kafka Controller Logs Example

19541954

Apache Kafka Log_Cleaner Logs Example

19541954

Apache Kafka Server Logs Example

19461946

Apache Kafka State_Changed Logs Example

Supported Versions

Apache Kafka: 1.0.0 - 2.0.10+

Log Collection Setup

Follow these steps to set up log collection from Apache Kafka.

Pre-requisites

Locate the local Tomcat access log directory.

Configure a Apache Tomcat Source

  1. Install the BindPlane Log Agent on the host system.
  2. Login to BindPlane and select the Logs tab.
284284

Logs Tab

  1. Select the Sources tab.
249249

Sources Tab

  1. In the top-right portion of the screen, click on the Add Source Configuration button
576576

Add Source Configuration Button

  1. Choose Apache Kafka
  2. Select which log files you want to monitor, and fill out the Kafka file locations for them.
986986

Apache Kafka Log Configuration Form

📘

Kafka Log location

To find your Kafka logging location you can check your Kafka configuration.

For more information, Click here.