Core Concepts

Understanding the fundamental concepts behind the platform is essential for effective usage and implementation.

Data Flow Architecture

The platform follows an ELT (Extract, Load, Transform) pattern where:

• Extract: Data is pulled from various sources
• Load: Raw data is loaded into your destination
• Transform: Data is processed and transformed in your destination system

Key Components

Organizations

The top-level entity that contains all resources and manages billing, security, and access control.

Workspaces

Logical containers within an organization that group related data pipelines and configurations.

Sources

External systems or services from which data is extracted.

Destinations

Target systems where processed data is loaded and stored.

Schedules

Automated triggers that determine when data extraction and loading processes run.