How to drive the terminal
Each chapter is short, copy-paste runnable, and follows the readme order. Start at the top or jump to the part you need.
- 01
Install
Get the runtime, the CLI, and (optionally) the data-frame interop extras.
▶ READ - 02
Connections
Connections are the first thing to set up — every pipeline references one or more by name.
▶ READ - 03
Pipelines
One decorator binds a source query to a target table, a load strategy, and a cron schedule.
▶ READ - 04
Load modes
append, truncate, merge (scd1), scd2 — plus how merge keys are resolved and how watermarks work.
▶ READ - 05
Scheduling
Cron, one-shot, programmatic — and how DAG dependencies between pipelines work.
▶ READ - 06
Streaming pipelines
Long-running consumers for Kafka / RabbitMQ / Pub/Sub / Kinesis with at-least-once delivery and DLQ support.
▶ READ - 07
Stream processing
SQL transforms, scalar + aggregate UDFs, tumbling/hopping/session windows over streaming sources.
▶ READ