Workflows
Pipeline Templates
Every pipeline starts from a template. Here's what each one does and what it needs from you to get started.
Ingestion + Quality Gate
Imports data from a source, then automatically checks it against a quality suite. If the data fails the check, the pipeline stops there instead of letting bad data through.
What you'll need to provide
- Which source to import from
- Which quality suite to validate against
Transform Chain
Runs a list of saved transforms one after another, in the order you set — useful when one table depends on another being built first.
What you'll need to provide
- The saved transforms to run, in order
Compaction + Snapshot Expiration
Routine housekeeping for your tables — tidies up old table history so storage stays efficient without affecting current data.
What you'll need to provide
- Which tables to clean up
- How far back to keep history (defaults to 30 days)
dbt Build
Runs your dbt project's models and syncs the resulting lineage into the Catalog, so downstream tables show where they came from.
What you'll need to provide
- Your dbt project
- (Optional) which models to include