Bindplane

The Bindplane Developer Hub

Welcome to the Bindplane developer hub. You'll find comprehensive guides and documentation to help you start working with Bindplane as quickly as possible, as well as support if you get stuck. Let's jump right in!

Apache Hadoop

Logs Collected

The information being sent to Google Stackdriver Logging is collected from

  • DataNode log files
  • ResourceManager log files
  • NameNode log files
    Below are a few examples of Apache Hadoop events being sent to Google Stackdriver Logging using the BindPlane Log Agent.

Hadoop General NameNode Logs Example

Hadoop General Resource Manager Logs Example

Hadoop Yarn Resource Manager Logs Example

Supported Versions

Apache Hadoop: 2.7.x+

Log Collection Setup

Follow these steps to setup log collection from Apache Hadoop.

Pre-requisites

  • Locate the file path for General and Yarn DataNode log files.
  • Locate the file path for General and Yarn ResourceManager log files.
  • Locate the file path for General and Yarn NameNode log files

Configure an Apache Hadoop Source

  1. Install the BindPlane Log Agent on the host system.
  2. Login to BindPlane and select the Logs tab.

Logs Tab

  1. Select the Sources tab.

Sources Tab

  1. In the top-right portion of the screen, click on the Add Source Configuration button

Add Source Configuration Button

  1. Choose Apache Hadoop
  2. Fill out the Apache Hadoop log configuration options.

Apache Hadoop Log Configuration Form

Updated about a year ago

Apache Hadoop


Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.