Staying Afloat in a Sea of Data: Downsampling Time Series Data At Scale With Telegraf, Kapacitor, and InfluxDB
Session date: Dec 17, 2019 08:00am (Pacific Time)
What do you do when you when you have so much data, that it’s hard to query, and you’re preparing for 2-3x the volume during the Cyber 5 weekend?
Chris Clark of Wayfair will discuss a new Aggregation Framework leveraging a variety of tools including Kafka, Telegraf, Kapacitor and InfluxDB to downsample high volume time series metrics. Chris will go over the evolution of the Version 1 Architecture and will discuss some challenges that were overcome and some that still need to be addressed in order to scale even further.
Chris Clark
DevOps Engineer | Metrics, Wayfair
Chris Clark is a member of the Metrics team at Wayfair, which manages their time-series database and visualization platforms. Prior to joining Wayfair in 2018, he worked primarily in the entertainment industries, first in theatrical automation, then the world of public media.