Microsoft Azure Stream Analytics

❗️

This source has been deprecated

observIQ is in the process of transitioning a subset of BindPlane's monitoring capabilities to the observIQ OpenTelemetry Collector. As a result, this Source is no longer publicly available in BindPlane. If you need access to this Source, please reach out to our support via chat or via [email protected].

Please refer to the Microsoft Azure Sources topic for additional information on how to configure the LPU, and general Azure Data Collection setup details.

Least Privileged User

Steps:

  1. Using the Azure CLI Client, find the Subscription ID and Tenant ID from your account list
  2. Create a custom RBAC role using the JSON provided. Include your Subscription ID and rename the file to azure.json
  3. Create an Active Directory Service Principal and assign the custom RBAC role t it.

Creating custom roles using the Azure CLI:

https://docs.microsoft.com/en-us/azure/role-based-access-control/custom-roles

Assigning roles using the Azure CLI:

https://docs.microsoft.com/en-us/azure/role-based-access-control/role-assignments-portal

{
  "Name": "LPU Microsoft Azure Stream Analytics",
  "Description": "LPU for Microsoft Azure Stream Analytics",
  "Actions": [
    "Microsoft.StreamAnalytics/streamingjobs/*/read",
    "Microsoft.Insights/metrics/*/read",
    "Microsoft.Authorization/*/read"
  ],
  "AssignableScopes": [
    "/subscriptions/[Subscription ID]"
  ]
}

Connection Parameters

NameRequired?Description
Subscription IDRequiredGUID Subscription ID
Tenant IDRequiredGUID Tenant ID (also known as Directory ID)
Client IDRequiredGUID Client ID (also known as Application ID)
Client SecretRequiredThe Secret (also known as Key) corresponding to the Client ID.
Maximum HTTP Retry Time (seconds)The maximum amount of time in seconds to retry each API request when the API is throttling.
HTTP Request Timeout (seconds)The maximum amount of time in seconds before a single HTTP request will fail.

Metrics

API Usage

NameDescription
Average PagesThe average amount of pages needed for a paged resource type.
Average Request RetriesThe average number of retry requests per unique requests made.
Average Retry AttemptsThe average number of retry requests made per unique request that was retried.
Average Retry Wait (Milliseconds)The average amount of time retried requests spent waiting.
Client IDThe client ID used to make API calls.
Failed RequestsThe total number of requests that returned a failure response.
Maximum PagesThe most amount of pages needed for a paged resource type.
Maximum RetriesThe highest number of retries made for a single request.
Maximum Retry Wait (Milliseconds)The most amount of time a retried request spent waiting.
Minimum PagesThe least amount of pages needed for a paged resource type.
Minimum Retry Wait (Milliseconds)The least amount of time a retried request spent waiting.
Other Status ResponsesThe total number of successful requests that responded with some other accepted status.
Request TimeoutsThe total number of requests that timed out waiting for a response.
Requests RetriedThe number of unique requests that were retried.
Retry Status ResponsesThe total number of successful requests that responded with the status TOO MANY REQUESTS (429).
Retry TimeoutsThe total number of requests that needed to be retried, but the request retry time exceeded the maximum retry time.
Status OK ResponsesThe total number of successful requests that responded with the status OK (200).
Subscription IDThe subscription ID used to make API calls.
Successful RequestsThe total number of requests that returned a successful response.
Tenant IDThe tenant ID used to make API calls.
Total Monitor RequestsThe total number of requests made to get monitor metrics.
Total Paged RequestsThe total amount of resource types that required paging.
Total RequestsThe total number of requests made during collection.
Total RetriesThe total number of retry requests that were made.
Unique Monitor RequestsThe number of unique requests made to get monitor metrics.
Unique RequestsThe number of requests made with unique endpoints.

Function

NameDescription
IDAzure resource ID.
NameAzure resource name.
TypeJob function type.

Input

NameDescription
Compression TypeData compression type.
Data TypeData type.
Datasource TypeData source type.
IDAzure resource ID.
NameAzure resource name.
Serialization TypeData serialization type.

Job

NameDescription
Azure Machine Learning Callout Input Events CountTotal number of Azure Machine Learning callout input events.
Azure Machine Learning Callout Requests CountTotal number of Azure Machine Learning callout requests.
Azure Machine Learning Failed Requests CountTotal number of failed Azure Machine Learning callout requests.
Conversion Errors CountTotal number of conversion errors.
Created DateJob creation date.
Deserialization Errors CountTotal number of deserialization count.
Dropped Events CountTotal number of dropped or adjusted events.
Early Input Events CountTotal number of early input events.
Errors CountTotal number of errors.
Events Late Arrival Maximum Delay (Seconds)Maximum delay for events arriving late.
Events Out Of Order Maximum Delay (Seconds)Maximum delay for out of order events.
Events Out Of Order PolicyJob policy for out of order events.
IDAzure resource ID.
Input Events CountTotal number of input events.
Input Events Size (Bytes)Total size of input events.
Last Output Event TimeTime of last output event.
Late Input Events CountTotal number of late input events.
LocationLocation where this resource lives.
NameAzure resource name.
Output Error PolicyJob policy for output errors.
Output Events CountTotal number of output events.
Output Start ModeWhen to start job output.
Output Start TimeTime when job starts output.
Provisioning StateProvisioning state of this job.
SKU NameAzure SKU name.
StateJob runtime state.
Streaming Units Utilization (%)The current utilization of streaming units.

Output

NameDescription
Compression TypeData compression type.
Data TypeData type.
Datasource TypeData source type.
IDAzure resource ID.
NameAzure resource name.
Serialization TypeData serialization type.