Jump to Content

BindPlane Documentation

Apache Kafka

Logs Collected

The four types of logs collected and sent to Stackdriver are:

controller
log_cleaner
server
state_change

Below are some example screenshots to illustrate what a user will see within Google Stackdriver Logging

1958 — Apache Kafka Controller Logs Example

1958 — Apache Kafka Controller Logs Example

1954 — Apache Kafka Log_Cleaner Logs Example

1954 — Apache Kafka Log_Cleaner Logs Example

1954 — Apache Kafka Server Logs Example

1954 — Apache Kafka Server Logs Example

1946 — Apache Kafka State_Changed Logs Example

1946 — Apache Kafka State_Changed Logs Example

Supported Versions

Apache Kafka: 1.0.0 - 2.0.10+

Log Collection Setup

Follow these steps to set up log collection from Apache Kafka.

Pre-requisites

Locate the local Tomcat access log directory.

Configure a Apache Tomcat Source

Install the BindPlane Log Agent on the host system.
Login to BindPlane and select the Logs tab.

284 — Logs Tab

284 — Logs Tab

Select the Sources tab.

249 — Sources Tab

249 — Sources Tab

In the top-right portion of the screen, click on the Add Source Configuration button

576 — Add Source Configuration Button

576 — Add Source Configuration Button

Choose Apache Kafka
Select which log files you want to monitor, and fill out the Kafka file locations for them.

986 — Apache Kafka Log Configuration Form

986 — Apache Kafka Log Configuration Form

📘
Kafka Log location
To find your Kafka logging location you can check your Kafka configuration.
For more information, Click here.

Updated almost 3 years ago