Hashicorp Nomad and GroundWork Integration

Powerful performance with an easy integration, powered by Telegraf, the open source data connector built by InfluxData.

info

This is not the recommended configuration for real-time query at scale. For query and compression optimization, high-speed ingest, and high availability, you may want to consider Nomad and InfluxDB.

5B+

Telegraf downloads

#1

Time series database
Source: DB Engines

1B+

Downloads of InfluxDB

2,800+

Contributors

Table of Contents

Powerful Performance, Limitless Scale

Collect, organize, and act on massive volumes of high-velocity data. Any data is more valuable when you think of it as time series data. with InfluxDB, the #1 time series platform built to scale with Telegraf.

See Ways to Get Started

Input and output integration overview

This plugin allows users to collect metrics from Hashicorp Nomad agents in distributed environments.

This plugin writes to a GroundWork Monitor instance, allowing for effective metrics management and monitoring in a centralized manner.

Integration details

Hashicorp Nomad

The Hashicorp Nomad input plugin is designed to gather metrics from every Nomad agent within a cluster. By deploying Telegraf on each node, it can connect to the local Nomad agent, typically available at ‘http://127.0.0.1:4646’. With this setup, users can systematically collect and monitor metrics related to the performance and status of their Nomad environment, ensuring they maintain a healthy and efficient cluster operational state. This plugin enables visibility into the operational aspects of Nomad, which is essential for maintaining reliable cloud infrastructure.

GroundWork

The GroundWork plugin enables Telegraf to send metrics to a GroundWork Monitor instance, specifically supporting GW8 and newer versions. This integration allows users to leverage the robust monitoring capabilities of GroundWork, enabling comprehensive oversight of metrics collected from diverse sources. Users can specify various parameters such as the GroundWork instance URL, agent IDs, and authentication credentials, allowing for a tailored fit within their existing monitoring setups. It also supports secret-store secrets to enhance security for sensitive fields like username and password. Tags used within the plugin provide fine-grained control over how metrics are categorized and displayed within the GroundWork interface, allowing for custom configurations that adapt to different monitoring needs. However, users should be aware that string metrics are currently not supported by GroundWork, impacting how they manage their data.

Configuration

Hashicorp Nomad

[[inputs.nomad]]
  ## URL for the Nomad agent
  # url = "http://127.0.0.1:4646"

  ## Set response_timeout (default 5 seconds)
  # response_timeout = "5s"

  ## Optional TLS Config
  # tls_ca = /path/to/cafile
  # tls_cert = /path/to/certfile
  # tls_key = /path/to/keyfile

GroundWork

[[outputs.groundwork]]
  ## URL of your groundwork instance.
  url = "https://groundwork.example.com"

  ## Agent uuid for GroundWork API Server.
  agent_id = ""

  ## Username and password to access GroundWork API.
  username = ""
  password = ""

  ## Default application type to use in GroundWork client
  # default_app_type = "TELEGRAF"

  ## Default display name for the host with services(metrics).
  # default_host = "telegraf"

  ## Default service state.
  # default_service_state = "SERVICE_OK"

  ## The name of the tag that contains the hostname.
  # resource_tag = "host"

  ## The name of the tag that contains the host group name.
  # group_tag = "group"

Input and output integration examples

Hashicorp Nomad

  1. Cluster Health Monitoring: Use the Hashicorp Nomad plugin to aggregate metrics across all nodes in a Nomad deployment. By monitoring health metrics such as allocation status, job performance, and resource utilization, operations teams can gain insights into the overall health of their deployment, quickly identify and resolve issues, and optimize resource allocation based on real-time data.

  2. Performance Analytics for Job Execution: Leverage the metrics provided by Nomad to analyze job execution times and resource consumption. This use case enables developers to adjust job parameters effectively, optimize task performance, and illustrate trends over time, ultimately leading to increased efficiency and reduced costs in resource allocation.

  3. Alerting on Critical Conditions: Implement alerting mechanisms based on metrics scraped from Nomad agents. By setting thresholds for critical metrics like CPU usage or failed job allocations, teams can proactively respond to potential issues before they escalate, ensuring higher uptime and reliability for applications running on the Nomad platform.

  4. Integration with Visualization Tools: Use the data collected by the Hashicorp Nomad plugin to feed into visualization tools for real-time dashboards. This setup allows teams to monitor cluster workloads, job states, and system performance at a glance, facilitating better decision-making and strategic planning based on visual insights into the Nomad environment.

GroundWork

  1. Centralized Monitoring Dashboard: Use the GroundWork plugin to aggregate metrics from multiple Telegraf instances into a single GroundWork Monitor dashboard. This configuration offers complete visibility into system health across various components, enabling swift identification of performance bottlenecks and improved incident response times.

  2. Service Health Monitoring with Alerts: Configure this plugin to send critical service metrics to GroundWork, establishing a robust alerting system. Metrics such as CPU usage and service statuses can trigger alerts based on threshold values, informing administrators of potential issues before they escalate, thereby enhancing system reliability.

  3. Historical Data Analysis: Leverage the historical metric capabilities of GroundWork using this plugin to conduct trend analysis over time. This application allows organizations to make data-driven decisions based on comprehensive historical performance metrics, which can assist in capacity planning and optimize resource allocation.

  4. Custom Service Tags for Enhanced Monitoring: Extend the functionality of this plugin by utilizing custom tags for different services and hosts. By customizing these tags, users can filter and categorize metrics more effectively within their monitoring framework, leading to tailored monitoring experiences that align specifically with business objectives.

Feedback

Thank you for being part of our community! If you have any general feedback or found any bugs on these pages, we welcome and encourage your input. Please submit your feedback in the InfluxDB community Slack.

Powerful Performance, Limitless Scale

Collect, organize, and act on massive volumes of high-velocity data. Any data is more valuable when you think of it as time series data. with InfluxDB, the #1 time series platform built to scale with Telegraf.

See Ways to Get Started

Related Integrations

HTTP and InfluxDB Integration

The HTTP plugin collects metrics from one or more HTTP(S) endpoints. It supports various authentication methods and configuration options for data formats.

View Integration

Kafka and InfluxDB Integration

This plugin reads messages from Kafka and allows the creation of metrics based on those messages. It supports various configurations including different Kafka settings and message processing options.

View Integration

Kinesis and InfluxDB Integration

The Kinesis plugin allows for reading metrics from AWS Kinesis streams. It supports multiple input data formats and offers checkpointing features with DynamoDB for reliable message processing.

View Integration