skip to content

#pipelines (7)

Cheat sheets (7)

dagster — Asset-Oriented Data Orchestration

Package-level reference for Dagster on PyPI — install variants, the dagster-* plugin family, version policy, and alternatives.
pip package orchestration pipelines

prefect — Python Workflow Orchestration

Package-level reference for Prefect on PyPI — install variants, version policy, cloud-vs-OSS extras, and alternatives.
pip package orchestration pipelines

PowerShell Pipelines — Objects, Not Text

Deep dive on PowerShell's object pipeline: Where-Object, Select-Object, ForEach-Object, Sort-Object, Group-Object, Measure-Object, Compare-Object, Out-GridView, parallel execution, and the two filter forms.
powershell scripting pipelines web-researched

Haystack 2.x — Pipelines for LLM Applications

Build production-grade LLM pipelines with Haystack 2.x. Covers components, the pipeline graph, indexing and querying, retrievers, generators, RAG patterns, and evaluation.
python haystack llm rag ai pipelines deepset retrievers generators

scikit-learn — Classical Machine Learning

Build classical ML pipelines with scikit-learn. Covers the estimator API, train_test_split, Pipeline, ColumnTransformer, cross-validation, metrics, and model persistence.
python scikit-learn ml data-science pipelines modeling classification

dagster — Modern Data Orchestration

Build, schedule, and observe data pipelines as software-defined assets with Dagster. Covers assets, jobs, schedules, sensors, resources, partitions, and the Dagster UI.
python dagster orchestration data pipelines assets etl mlops

prefect — Workflow Orchestration

Build, schedule, and observe Python workflows with Prefect. Covers flows, tasks, retries, schedules, deployments, caching, concurrency, and Prefect Cloud.
python prefect orchestration workflows scheduling etl pipelines