OpenStack and Microsoft Fabric Integration

Input and output integration overview

This plugin collects metrics from essential OpenStack services, facilitating the monitoring and management of cloud infrastructures.

The Microsoft Fabric plugin writes metrics to Real time analytics in Fabric services, enabling powerful data storage and analysis capabilities.

Integration details

OpenStack

The OpenStack plugin allows users to collect performance metrics from various OpenStack services such as CINDER, GLANCE, HEAT, KEYSTONE, NEUTRON, and NOVA. It supports multiple OpenStack APIs to fetch critical metrics related to these services, enabling comprehensive monitoring and management of cloud resources. As organizations increasingly adopt OpenStack for their cloud infrastructure, this plugin plays a vital role in providing insights into resource usage, availability, and performance across the cloud environment. Configuration options allow for customized polling intervals and filtering unwanted tags to optimize performance and cardinals.

Microsoft Fabric

This plugin allows you to leverage Microsoft Fabric’s capabilities to store and analyze your Telegraf metrics. Eventhouse is a high-performance, scalable data-store designed for real-time analytics. It allows you to ingest, store and query large volumes of data with low latency. The plugin supports both events and metrics with versatile grouping options. It provides various configuration parameters including connection strings specifying details like the data source, ingestion types, and which tables to use for storage. With support for streaming ingestion and event streams, this plugin enables seamless integration and data flow into Microsoft’s analytics ecosystem, allowing for rich data querying capabilities and near-real-time processing.

Configuration

OpenStack

[[inputs.openstack]]
  ## The recommended interval to poll is '30m'

  ## The identity endpoint to authenticate against and get the service catalog from.
  authentication_endpoint = "https://my.openstack.cloud:5000"

  ## The domain to authenticate against when using a V3 identity endpoint.
  # domain = "default"

  ## The project to authenticate as.
  # project = "admin"

  ## User authentication credentials. Must have admin rights.
  username = "admin"
  password = "password"

  ## Available services are:
  ## "agents", "aggregates", "cinder_services", "flavors", "hypervisors",
  ## "networks", "nova_services", "ports", "projects", "servers",
  ## "serverdiagnostics", "services", "stacks", "storage_pools", "subnets",
  ## "volumes"
  # enabled_services = ["services", "projects", "hypervisors", "flavors", "networks", "volumes"]

  ## Query all instances of all tenants for the volumes and server services
  ## NOTE: Usually this is only permitted for administrators!
  # query_all_tenants = true

  ## output secrets (such as adminPass(for server) and UserID(for volume)).
  # output_secrets = false

  ## Amount of time allowed to complete the HTTP(s) request.
  # timeout = "5s"

  ## HTTP Proxy support
  # http_proxy_url = ""

  ## Optional TLS Config
  # tls_ca = /path/to/cafile
  # tls_cert = /path/to/certfile
  # tls_key = /path/to/keyfile
  ## Use TLS but skip chain & host verification
  # insecure_skip_verify = false

  ## Options for tags received from Openstack
  # tag_prefix = "openstack_tag_"
  # tag_value = "true"

  ## Timestamp format for timestamp data received from Openstack.
  ## If false format is unix nanoseconds.
  # human_readable_timestamps = false

  ## Measure Openstack call duration
  # measure_openstack_requests = false

Microsoft Fabric

[[outputs.microsoft_fabric]]
  ## The URI property of the resource on Azure
  connection_string = "https://trd-abcd.xx.kusto.fabric.microsoft.com;Database=kusto_eh;Table Name=telegraf_dump;Key=value"

  ## Client timeout
  # timeout = "30s"

Input and output integration examples

OpenStack

1. Cross-Cloud Management: Leverage the OpenStack plugin to monitor and manage multiple OpenStack clouds from a single Telegraf instance. By aggregating metrics across different clouds, organizations can gain insights into resource utilization and optimize their cloud architecture for cost and performance.

2. Automated Scaling Based on Metrics: Integrate the metrics gathered from OpenStack into an automated scaling solution. For example, if the plugin detects that a specific service’s performance is degraded, it can trigger auto-scaling rules to launch additional instances, ensuring that system performance remains optimal under varying workloads.

3. Performance Monitoring Dashboard: Use data collected by the OpenStack Telegraf plugin to power real-time monitoring dashboards. This setup provides visualizations of key metrics from OpenStack services, enabling stakeholders to quickly identify trends, pinpoint issues, and make data-driven decisions in managing their cloud infrastructure.

4. Reporting and Analysis of Service Availability: By utilizing the metrics collected from various OpenStack services, teams can generate detailed reports on service availability and performance over time. This information can help identify recurring issues, improve service delivery, and make informed decisions regarding changes in infrastructure or service configuration.

Microsoft Fabric

1. Real-time Monitoring Dashboards: Utilize the Microsoft Fabric plugin to feed live metrics from your applications into a real-time dashboard on Microsoft Fabric. This allows teams to visualize key performance indicators instantly, enabling quick decision-making and timely responses to performance issues.

2. Automated Data Ingestion from IoT Devices: Use this plugin in scenarios where metrics from IoT devices need to be ingested into Azure for analysis. Using the plugin’s capabilities, data can be streamed continuously, facilitating real-time analytics and reporting without complex coding efforts.

3. Cross-Platform Data Aggregation: Leverage the plugin to consolidate metrics from multiple systems and applications into a single Azure Data Explorer table. This use case enables easier data management and analysis by centralizing disparate data sources within a unified analytics framework.

4. Enhanced Event Transformation Workflows: Integrate the plugin with Eventstreams to facilitate real-time event ingestion and transformation. By configuring different metrics and partition keys, users can manipulate the flow of data as it enters the system, allowing for advanced processing before the data reaches its final destination.

Feedback

Thank you for being part of our community! If you have any general feedback or found any bugs on these pages, we welcome and encourage your input. Please submit your feedback in the InfluxDB community Slack.