databuild/docs/ideas/metadata.md
Stuart Axelbrooke 2cf778a07b
Some checks failed
/ setup (push) Has been cancelled
big bump
2025-11-16 22:21:56 -08:00

361 B

It would be cool to have user-defined partition/want/job-run metadata, and allow querying of this metadata. Basic example: adding a run_url to a job or adls_location to a partition. More advanced: adding a dbx_cores field to job runs, and using querying over job runs downstream from a want to control parallelism down to the number-of-cores-used level.