Glossary

Anomaly detection is the process of finding data points that are outliers from the rest of a data set.

Apache Arrow a language-agnostic software framework for developing data analytics applications that process columnar data. It contains a standardized column-oriented memory format that is able to represent flat and hierarchical data for efficient analytic operations.

Apache Arrow Flight SQL provides a high performance SQL interface for working with databases over a network

DataFusion is an in-memory query planning, optimization, and execution framework. DataFusion was created in 2017 and donated to the Apache Arrow project in 2019.

Apache Parquet is an open source columnar data file format that supports different encoding and compression schemes to optimize it for efficient data storage and retrieval in bulk.

An Autoregressive Integrated Moving Average (ARIMA) model is a widely used time series forecasting technique.

Batch processing is a computer processing technique where a large amount of data is collected and processed at once rather than in real time

CAP theorem is a computer science theory related to the tradeoffs involved with designing distributed databases.

In the context of databases cardinality is the number of unique sets of data stored in a database. Specifically, it refers to the total number of unique values possible within a table column or database equivalent.

Column databases are a type of DBMS that store data formatted in columns rather than rows and are optimized for analytics workloads.

Learn about the powerful concept of data fabric and its potential to transform the way organizations manage and utilize their data.

What is continuous profiling? Learn this technique to identify and resolve potential performance bottlenecks and other issues.

A data warehouse is a data management system that supports business intelligence, such as data analysis. Data warehouses help you make more insightful decisions about your business.

Database-as-a-service (DBaaS) is a cloud computing service that provides access to a cloud database system without needing to set up, configure, or manage software or physical infrastructure.

Database denormalization is a process for designing a database to enable faster data reads. One way to do this is by introducing redundant data where necessary.

The index of a database table acts like the index in a physical textbook. On this page, we will learn what database indexing is and more.

Distributed databases system spreads data storage and processing across multiple servers instead of relying on a single server.

Tracing is a method for understanding how interconnected components of a distributed system interact with each other.

Edge computing is a type of computing that happens near a data source. It allows you to perform computing tasks as close to an IoT device or end user as possible instead of using a data center or the cloud.

ETL stands for Extract, Transform, Load and is the process of moving and manipulating data from different sources before storing it in another database.

Fuzz testing, also referred to as fuzzing, is a software testing technique designed to identify vulnerabilities, bugs, and potential crashes in software applications, systems, or protocols.

The Internet of Things refers to the network of interconnected "things" with sensors, software, processing ability, and other technologies that connect and exchange data with other internet-connected devices. IoT devices include smartphones, medical sensors, fitness trackers, smart security systems, and other technologies.

In the digital landscape, IoT security plays a pivotal role in ensuring the confidentiality, integrity, and availability of data transmitted and stored across networks.

Software observability is the practice of monitoring your software in order to understand its behavior and identify issues.

Online Analytical Processing (OLAP) is an approach to working with typically multidimensional data for analytics use cases.

OPC UA is a cross-platform standard for moving data between sensors and cloud applications.

Overall Equipment Effectiveness (OEE) is a metric for measuring manufacturing productivity.

Predictive Maintenance is a maintenance strategy that uses a combination of sensors and data analysis to detect issues in machinery or other equipment before they become major problems.

Prometheus stores four metric types for monitoring needs: counters, gauges, histograms, and summaries.

Today, a real-time database can mean different things. This glossary page considers two categories of real-time databases.

Real User Monitoring(RUM) is the process of collecting user data to gain insights into your application's performance and how it is being used.

SCADA stands for Supervisory Control and Data Acquisition. A SCADA system is usually a collection of both software and hardware components that allow supervision and control of industrial plants.

Seasonality is the presence of regular and predictable change in time series data.

SQL is a domain specific language used in programming and designed for managing data held in a relational database management system.

Stationarity refers to a time series where the statistical properties of that series don’t depend on the time when observing it.

Stream processing is a technique to process continuous data (unbounded data) streams where data flows in real time from one point to another, like from a sensor to a database.

Vector processing is a computer method that can process numerous data components at once. It operates on every element of the entire vector in one operation.