Azure Storage Queue and New Relic Integration

Input and output integration overview

This plugin gathers sizes of Azure Storage Queues, providing users with metrics that enhance observability and management of their storage resources.

This plugin allows the sending of metrics to New Relic Insights using the Metrics API, enabling effective monitoring and analysis of application performance.

Integration details

Azure Storage Queue

The Azure Storage Queue plugin allows users to gather various metrics concerning the size and message age of Azure Storage Queues. This plugin connects to Azure Storage, requiring specific credentials and offers configurable options to enhance performance. By collecting metrics, users gain valuable insights into the performance of their storage queues, enabling them to monitor usage patterns, peak loads, and optimize storage management effectively. The integration with Azure’s storage infrastructure provides a straightforward way to monitor queue metrics, ensuring that users can react to changes promptly, maintaining the efficiency and reliability of their applications.

New Relic

This plugin writes metrics to New Relic Insights utilizing the Metrics API, which provides a robust mechanism for sending time series data to the New Relic platform. Users must first obtain an Insights API Key to authenticate and authorize their data submissions. The plugin is designed to facilitate easy integration with New Relic’s monitoring and analytics capabilities, supporting a variety of metric types and allowing for efficient data handling. Core features include the ability to add prefixes to metrics for better identification, customizable timeouts for API requests, and support for proxy settings to enhance connectivity. It is essential for users to configure these options according to their requirements, enabling seamless data flow into New Relic for comprehensive real-time analytics and insights.

Configuration

Azure Storage Queue

[[inputs.azure_storage_queue]]
  ## Required Azure Storage Account name
  account_name = "mystorageaccount"

  ## Required Azure Storage Account access key
  account_key = "storageaccountaccesskey"

  ## Set to false to disable peeking age of oldest message (executes faster)
  # peek_oldest_message_age = true

New Relic

[[outputs.newrelic]]
  ## The 'insights_key' parameter requires a NR license key.
  ## New Relic recommends you create one
  ## with a convenient name such as TELEGRAF_INSERT_KEY.
  ## reference: https://docs.newrelic.com/docs/apis/intro-apis/new-relic-api-keys/#ingest-license-key
  # insights_key = "New Relic License Key Here"

  ## Prefix to add to add to metric name for easy identification.
  ## This is very useful if your metric names are ambiguous.
  # metric_prefix = ""

  ## Timeout for writes to the New Relic API.
  # timeout = "15s"

  ## HTTP Proxy override. If unset use values from the standard
  ## proxy environment variables to determine proxy, if any.
  # http_proxy = "http://corporate.proxy:3128"

  ## Metric URL override to enable geographic location endpoints.
  # If not set use values from the standard
  # metric_url = "https://metric-api.newrelic.com/metric/v1"

Input and output integration examples

Azure Storage Queue

1. Monitoring Queue Performance in Real-time: Use the Azure Storage Queue plugin to continuously track the size and age of messages in queues, providing operators with real-time insights. This information can help teams understand throughput and delays, enabling them to adjust processing rates or troubleshoot bottlenecks.

2. Dynamic Alerting Based on Queue Metrics: Integrate metrics from the Azure Storage Queue plugin into an alerting system. By defining thresholds for message age and queue size, organizations can automate notifications, ensuring they promptly address situations where queues become too long or messages are delayed, maintaining a healthy and responsive system environment.

3. Optimizing Cost Management: Leverage the insights from the Azure Storage Queue metrics to identify periods of inactivity and implement cost-saving measures by adjusting storage scales. By analyzing queue size trends, organizations can make informed decisions about resource allocation, effectively balancing performance needs with cost efficiency.

4. Enhancing Application Fault Tolerance: Use the age metrics of the oldest message to design smarter retry strategies within applications. In scenarios where message processing fails, understanding how long messages sit in the queue allows developers to fine-tune their error handling logic, enhancing the resilience and reliability of their applications.

New Relic

1. Application Performance Monitoring: Use the New Relic Telegraf plugin to send application performance metrics from a web service to New Relic Insights. By integrating this plugin, developers can collect data such as response times, error rates, and throughput, enabling teams to monitor application health in real-time and resolve issues quickly before they impact users. This setup promotes proactive management of application performance and user experience.

2. Infrastructure Metrics Aggregation: Leverage this plugin to aggregate and send system-level metrics (CPU usage, memory consumption, etc.) from various servers to New Relic. This helps system administrators maintain an comprehensive view of infrastructure performance, facilitating capacity planning and identifying potential bottlenecks. By centralizing metrics in New Relic, teams can visualize trends over time and make informed decisions regarding resource allocation.

3. Dynamic Metric Naming for Multi-tenant Applications: Implement dynamic prefixing with the metric_prefix option to differentiate between different tenants in a multi-tenant application. By configuring the plugin to include a unique identifier per tenant in the metric names, teams can analyze usage patterns and performance metrics per tenant. This provides valuable insights into tenant behavior, supporting tailored optimizations and enhancing service quality across different customer segments.

4. Real-time Anomaly Detection: Combine the New Relic plugin with alerting mechanisms to trigger notifications based on unusual metric patterns. By sending metrics such as request counts and response times, teams can set thresholds in New Relic that, when breached, will automatically alert responsible parties. This user-driven approach supports immediate responses to potential issues before they escalate into larger incidents.

Feedback

Thank you for being part of our community! If you have any general feedback or found any bugs on these pages, we welcome and encourage your input. Please submit your feedback in the InfluxDB community Slack.