• Lesson 1: Introduction

    • What's data engineering?
    • What's an orchestrator?
    • Orchestration approaches
    • Why is asset-centric orchestration good for data engineering?
    • Project preview

  • Lesson 2: Requirements & installation

    • Requirements
    • Set up local
    • Set up Codespace
    • Project files

  • Lesson 3: SDAs

    • Overview
    • What's an asset?
    • Defining your first asset
    • Asset materialization
    • Viewing run details
    • Troubleshooting failed runs
    • Coding practice: Create a taxi_zones_file asset
    • Recap

  • Lesson 4: Asset dependencies

    • Overview
    • What's a dependency?
    • Assets and database execution
    • Loading data into a database
    • Practice: Create a taxi_zones asset
    • Assets with in-memory computations
    • Practice: Create a trips_by_week asset

  • Lesson 5: Definitions & code locations

    • Overview
    • What's the Definitions object?
    • What's a code location?
    • Code locations in the Dagster UI

  • Lesson 6: Resources

    • Overview
    • What's a resource?
    • Setting up a database resource
    • Using resources in assets
    • Practice: Refactoring assets to use resources
    • Analyzing resource usage using the Dagster UI
    • Lesson recap

  • Lesson 7: Schedules

    • Overview
    • What are schedules?
    • Practice: Create a weekly_update_job
    • Creating a schedule
    • Practice: Create a weekly_update_schedule
    • Updating the Definitions object
    • Jobs and schedules in the Dagster UI

  • Lesson 8: Partitions and backfills

    • Overview
    • What are partitions and backfills?
    • Creating a partition
    • Practice: Create a weekly partition
    • Adding partitions to assets
    • Practice: Partition the taxi_trips asset
    • Creating a schedule with a date-based partition
    • Practice: Partition the trips_by_week asset
    • Partitions and backfills in the Dagster UI
    • Recap

  • Lesson 9: Sensors

    • Overview
    • What's a sensor?
    • Configuring asset creation
    • Creating an asset triggered by a sensor
    • Creating a job
    • Building the sensor
    • Updating the Definitions object
    • Sensors in the Dagster UI
    • Enabling the sensor

  • Capstone

  • Extra credit: Metadata

    • Overview
    • What's metadata?
    • Definition metadata - Asset descriptions
    • Definition metadata - Asset groups
    • Practice: Grouping assets
    • Materialization metadata
    • Practice: Add metadata to taxi_zones_file
    • Asset metadata as Markdown