databuild/docs/ideas/querying.md
Stuart Axelbrooke 2cf778a07b
Some checks failed
/ setup (push) Has been cancelled
big bump
2025-11-16 22:21:56 -08:00

690 B

Querying seems to be a fundamental factor of the problem. For instance:

  • Upon canceling a want, canceling all wants it spawned, and the jobs attached to them.
  • Answering the question, "what in-progress job runs were spawned by this want?"
  • Answering, "why was this partition built?"
  • Answering, "what partitions needed to be built and jobs run to fulfill this want?"
  • Answering, "what jobs produce the partitions missed by this job run?"

Let's start prefixing functions that should probably be mostly queries with query_.

Notes on JTBDs and queries:

  • When a want is schedulable (query), map the requested partitions to the job runs that create them (query), and start them