Glossary

Anomaly detection is the process of finding data points that are outliers from the rest of a data set.

Apache Arrow a language-agnostic software framework for developing data analytics applications that process columnar data. It contains a standardized column-oriented memory format that is able to represent flat and hierarchical data for efficient analytic operations.

Apache Arrow Flight SQL provides a high performance SQL interface for working with databases over a network

DataFusion is an in-memory query planning, optimization, and execution framework. DataFusion was created in 2017 and donated to the Apache Arrow project in 2019.

Apache Parquet is an open source columnar data file format that supports different encoding and compression schemes to optimize it for efficient data storage and retrieval in bulk.

APM helps developers detect and diagnose application performance issues, allowing them to address problems promptly and maintain a high level of service and user experience.

An Autoregressive Integrated Moving Average (ARIMA) model is a widely used time series forecasting technique.

Batch processing is a computer processing technique where a large amount of data is collected and processed at once rather than in real time

CAP theorem is a computer science theory related to the tradeoffs involved with designing distributed databases.

In the context of databases cardinality is the number of unique sets of data stored in a database. Specifically, it refers to the total number of unique values possible within a table column or database equivalent.

Column databases are a type of DBMS that store data formatted in columns rather than rows and are optimized for analytics workloads.

What is continuous profiling? Learn this technique to identify and resolve potential performance bottlenecks and other issues.

Learn about the powerful concept of data fabric and its potential to transform the way organizations manage and utilize their data.

Data governance is a framework that establishes the rules, policies, and procedures for organizations to ensure the quality, integrity, security, and usability of their data assets.

A Data Historian is a type of software specifically designed for capturing and storing time-series data from industrial operations.

Data lakes serve as a centralized repository, enabling the storage of large volumes of both structured and unstructured data.

What is continuous profiling? Learn this technique to identify and resolve potential performance bottlenecks and other issues.

Data modeling is the process of creating a representation of an organization or application's data and the relationships between different data points.

A data warehouse is a data management system that supports business intelligence, such as data analysis. Data warehouses help you make more insightful decisions about your business.

Database-as-a-service (DBaaS) is a cloud computing service that provides access to a cloud database system without needing to set up, configure, or manage software or physical infrastructure.

Database denormalization is a process for designing a database to enable faster data reads. One way to do this is by introducing redundant data where necessary.

The index of a database table acts like the index in a physical textbook. On this page, we will learn what database indexing is and more.

Database sharding is a strategy for scaling a database by breaking it into smaller, more manageable pieces.

DevSecOps is an extension of DevOps that's sometimes known as secure DevOps. The main objective is to integrate security into the software development workflow.

A digital twin is a virtual model or replica of a physical object, process, or system that is used for simulation, analysis, and understanding.

Distributed databases system spreads data storage and processing across multiple servers instead of relying on a single server.

Tracing is a method for understanding how interconnected components of a distributed system interact with each other.

Edge computing is a type of computing that happens near a data source. It allows you to perform computing tasks as close to an IoT device or end user as possible instead of using a data center or the cloud.

ETL stands for Extract, Transform, Load and is the process of moving and manipulating data from different sources before storing it in another database.

Fog computing is a type of decentralized computing infrastructure that extends cloud computing capabilities to the edge of an enterprise's network.

Fuzz testing, also referred to as fuzzing, is a software testing technique designed to identify vulnerabilities, bugs, and potential crashes in software applications, systems, or protocols.

An inverted index is a data structure that is commonly used as a database index to allow for fast full text search.

IoT cloud is an internet-based cloud service that stores data from IoT devices. This post goes over the benefits of IoT cloud.

The Internet of Things refers to the network of interconnected "things" with sensors, software, processing ability, and other technologies that connect and exchange data with other internet-connected devices. IoT devices include smartphones, medical sensors, fitness trackers, smart security systems, and other technologies.

An IoT platform is crucial in the development and administration of IoT applications. Learn more on this page.

In the digital landscape, IoT security plays a pivotal role in ensuring the confidentiality, integrity, and availability of data transmitted and stored across networks.

Learn about the world of MLOps - machine learning operations. Automate workflows, deploy ML models, and learn best practices for deploying AI/ML models in production.

NoSQL databases are a type of database system that provide a mechanism for data storage and retrieval, differing from traditional relational databases which are structured and require data to fit into predefined tables.

Software observability is the practice of monitoring your software in order to understand its behavior and identify issues.

Online Analytical Processing (OLAP) is an approach to working with typically multidimensional data for analytics use cases.

OPC UA is a cross-platform standard for moving data between sensors and cloud applications.

Overall Equipment Effectiveness (OEE) is a metric for measuring manufacturing productivity.

Predictive analytics is a form of analytics that tries to predict future events, trends, or behaviors based on historical and present data.

Predictive Maintenance is a maintenance strategy that uses a combination of sensors and data analysis to detect issues in machinery or other equipment before they become major problems.

Prometheus stores four metric types for monitoring needs: counters, gauges, histograms, and summaries.

Today, a real-time database can mean different things. This glossary page considers two categories of real-time databases.

Real User Monitoring(RUM) is the process of collecting user data to gain insights into your application's performance and how it is being used.

SCADA stands for Supervisory Control and Data Acquisition. A SCADA system is usually a collection of both software and hardware components that allow supervision and control of industrial plants.

Seasonality is the presence of regular and predictable change in time series data.

Security information and event management (SIEM) is a powerful integration of two security systems: security information management (SIM) and security event management (SEM).

SQL is a domain specific language used in programming and designed for managing data held in a relational database management system.

Stationarity refers to a time series where the statistical properties of that series don’t depend on the time when observing it.

Stream processing is a technique to process continuous data (unbounded data) streams where data flows in real time from one point to another, like from a sensor to a database.

Learn about time series plots: their working, types, and different use cases. Also, check how you can implement them in Python language.

Unstructured data refers to information that does not fit into a pre-defined model or structure. It is typically non-relational and often unorganized or incomplete, unlike structured data which fits into well-defined models, such as tables and fields.

Vector processing is a computer method that can process numerous data components at once. It operates on every element of the entire vector in one operation.