MQTT and Clarify Integration

Input and output integration overview

The MQTT Telegraf plugin is designed to read from specified MQTT topics and create metrics, enabling users to leverage MQTT for real-time data collection and monitoring.

The Clarify plugin allows users to publish Telegraf metrics directly to Clarify, enabling enhanced analysis and monitoring capabilities.

Integration details

MQTT

The MQTT plugin allows for reading metrics from specified MQTT topics, creating metrics using supported input data formats. This plugin operates as a service input, which listens for incoming metrics or events rather than gathering them at set intervals like normal plugins. The flexibility of the plugin is enhanced with support for various broker URLs, topics, and connection features, including Quality of Service (QoS) levels and persistent sessions. Its configuration options incorporate global settings to modify metrics and handle startup errors effectively. It also supports secret-store configurations for securing username and password options, ensuring secure connections to MQTT servers.

Clarify

This plugin facilitates the writing of Telegraf metrics to Clarify, a platform for managing and analyzing time series data. By transforming metrics into Clarify signals, this output plugin enables seamless integration of collected telemetry data into the Clarify ecosystem. Users must obtain valid credentials, either through a credentials file or basic authentication, to configure the plugin. The configuration also provides options for fine-tuning how metrics are mapped to signals in Clarify, including the ability to specify unique identifiers using tags. Given that Clarify supports only floating point values, the plugin ensures that any unsupported types are effectively filtered out during the publishing process. This comprehensive connectivity aligns with use cases in monitoring, data analysis, and operational insights.

Configuration

MQTT

[[inputs.mqtt_consumer]]
  servers = ["tcp://127.0.0.1:1883"]
  topics = [
    "telegraf/host01/cpu",
    "telegraf/+/mem",
    "sensors/#",
  ]
  # topic_tag = "topic"
  # qos = 0
  # connection_timeout = "30s"
  # keepalive = "60s"
  # ping_timeout = "10s"
  # max_undelivered_messages = 1000
  # persistent_session = false
  # client_id = ""
  # username = "telegraf"
  # password = "metricsmetricsmetricsmetrics"
  # tls_ca = "/etc/telegraf/ca.pem"
  # tls_cert = "/etc/telegraf/cert.pem"
  # tls_key = "/etc/telegraf/key.pem"
  # insecure_skip_verify = false
  # client_trace = false
  data_format = "influx"
  # [[inputs.mqtt_consumer.topic_parsing]]
  #   topic = ""
  #   measurement = ""
  #   tags = ""
  #   fields = ""
  #   [inputs.mqtt_consumer.topic_parsing.types]
  #      key = type

Clarify

[[outputs.clarify]]
  ## Credentials File (Oauth 2.0 from Clarify integration)
  credentials_file = "/path/to/clarify/credentials.json"

  ## Clarify username password (Basic Auth from Clarify integration)
  username = "i-am-bob"
  password = "secret-password"

  ## Timeout for Clarify operations
  # timeout = "20s"

  ## Optional tags to be included when generating the unique ID for a signal in Clarify
  # id_tags = []
  # clarify_id_tag = 'clarify_input_id'

Input and output integration examples

MQTT

1. Smart Home Monitoring: Use the MQTT Consumer plugin to monitor various sensors in a smart home setup. In this scenario, the plugin can be configured to subscribe to topics for different devices, such as temperature, humidity, and energy consumption. By aggregating this data, homeowners can visualize trends and receive alerts for unusual patterns, enhancing the overall quality and efficiency of home automation systems.

2. IoT Environmental Sensing: Deploy the MQTT Consumer to gather environmental data from sensors distributed across different locations. For instance, this can include readings from air quality sensors, temperature sensors, and noise level meters. The plugin can be configured to extract relevant tags and fields from the MQTT topics which allows for detailed analyses and reporting on environmental conditions at scale, supporting better decision making for urban planning or environmental initiatives.

3. Real-Time Vehicle Tracking and Telemetry: Integrate the MQTT Consumer plugin within a vehicle telemetry system that collects data from various sensors in real-time. With the plugin, metrics related to vehicle performance, location, and fuel consumption can be sent to a centralized monitoring dashboard. This real-time telemetry data enables fleet managers to optimize routes, reduce fuel costs, and improve vehicle maintenance schedules through proactive data analysis.

4. Agricultural Monitoring System: Leverage this plugin to collect data from agricultural sensors that monitor soil moisture, crop health, and weather conditions. The MQTT Consumer can subscribe to multiple topics associated with farming equipment and environmental sensors, allowing farmers to make data-driven decisions to improve crop yields while also conserving resources, enhancing sustainability in agriculture.

Clarify

1. Automated Data Monitoring: By integrating the Clarify plugin with sensor data collection, organizations can automate the monitoring of environmental conditions, such as temperature and humidity. The plugin processes metrics in real-time, sending updates to Clarify where they can be analyzed for trends, alerts, and historical tracking. This use case makes it easier to maintain optimal conditions in data centers or production environments, reducing the risk of equipment failures.

2. Performance Metrics Analysis: Companies can leverage this plugin to send application performance metrics to Clarify. By transmitting key indicators such as response times and error rates, developers and operations teams can utilize Clarify’s capabilities to visualize and analyze application performance over time. This insight can drive improvements in user experience and help identify areas in need of optimization.

3. Sensor Data Aggregation: Utilizing the plugin to push data from multiple sensors to Clarify allows for a comprehensive view of physical environments. This aggregation is particularly beneficial in sectors such as agriculture, where metrics from various sensors can be correlated to decision-making about resource allocations, pest control, and crop management. The plugin ensures the data is accurately mapped and transformed for effective analysis.

4. Real-Time Alerts and Notifications: Implement the Clarify plugin to trigger real-time alerts based on predefined thresholds within the metrics being sent. For instance, if temperature readings exceed certain levels, alerts can be generated and sent to operational staff. This proactive approach allows for immediate responses to potential issues, enhancing operational reliability and safety.

Feedback

Thank you for being part of our community! If you have any general feedback or found any bugs on these pages, we welcome and encourage your input. Please submit your feedback in the InfluxDB community Slack.