DataOps is the practice of applying engineering discipline to the movement of data from source to decision. It borrows lean manufacturing's idea of an assembly line with quality checks at every station, and DevOps's idea that changes should be small, tested, automated and reversible. The unit of work is a dataset rather than a service, but the mechanics are familiar: version the transformation in Git, review it, test it, promote it through environments, and observe it once it is live.
What makes DataOps distinct from DevOps is that correctness has two dimensions. Application CI asks whether the code runs; DataOps has to ask whether the code runs and whether the data it produced is trustworthy. That adds a second class of test — freshness, completeness, uniqueness, referential integrity, distribution — enforced as gates in the pipeline rather than as a dashboard nobody reads. It also adds contracts: an explicit agreement about schema, semantics and service level between the team producing a dataset and the teams consuming it, so a column rename upstream fails a check instead of silently breaking a report.
In practice DataOps is built from a small, stable set of pieces. Git-based workflows and pull-request checks for SQL and ELT code. Orchestration as directed graphs with retries, SLAs and backfills, usually Airflow or a managed equivalent. Environment parity so a transformation behaves the same in dev, staging and production. Quality expectations executed on every run. Lineage and cataloguing so impact can be traced both ways. And flow metrics, the data equivalent of DORA, that tell you whether the platform is getting faster or just busier.
Why this skill matters now
Analytics stopped being a quarterly reporting function and became a dependency of live products. Pricing, fraud scoring, recommendation, forecasting and regulatory reporting all read from pipelines, which means a broken load is now an incident rather than an inconvenience.
Meanwhile the platform itself changed shape. Cloud warehouses and lakehouses made compute elastic and cheap enough that the bottleneck moved from processing to change management: hundreds of models, dozens of contributors, schemas evolving weekly, and no equivalent of the release process that application teams have had for a decade. Most data teams have adopted the tooling of modern data stacks without adopting the practices, and the symptoms are consistent — environment drift, silent schema breaks, duplicated pipelines, rework, and no reliable answer to who consumes this table.
The demand is therefore for engineers who can bring release discipline to data without stalling delivery. That combination — SQL and pipeline fluency plus CI/CD, testing, orchestration and governance — is what organisations are hiring for, and it is exactly what DataOps names.