databuild/design/why-databuild.md

366 B

Why DataBuild?

(work in progress)

Why?

  • Orchestration logic changes all the time, better to not write it directly
  • Declarative -> Compile time correctness (e.g. can detect when no job produces a partition pattern)
  • Compartmentalized jobs + data deps -> Simplicity and compartmentalization of complexity
  • Bazel based -> Easy to deploy, maintain, and update