Tutorial#

If you're new to Dagster, we recommend working through this tutorial to become familiar with Dagster's feature set and tooling, using small examples that are intended to be illustrative of real data problems.

Intro Tutorial#

The tutorial is divided into several sections:

• Setup for the Tutorial has instructions for installing Dagster.
• A Single-Solid Pipeline explains Dagster's core concepts and shows how to execute a single-step pipeline.
• Connecting Solids in Pipelines shows how to build pipelines with multiple solids.
• Configuring Solids shows how to parameterize pipelines with configuration.
• Testing Solids and Pipelines shows how to write unit-tests for solids and pipelines.

Advanced Tutorials#

These sections will introduce some advanced features and give you deeper insight into Dagster.

• Advanced: Dagster Types covers Dagster's type system.
• Advanced: Solid Re-use and Composition demonstrates more ways you can use solids, e.g. by creating reusable solids.
• Advanced: Pipelines demonstrates configuring pipeline-wide facilities to avoiding repeated code or config with unchanged business logic.
• Advanced: Materializations demonstrates a way to make Dagster aware of your persistent artifacts outside the system.
• Advanced: Organizing Pipelines in Repositories & Workspaces demonstrates constructs that are useful when you have many pipelines that you need to organize.
• Advanced: Scheduling Pipeline Runs will show you how to schedule pipelines to run at regular intervals using cron.