361 B
361 B
It would be cool to have user-defined partition/want/job-run metadata, and allow querying of this metadata. Basic example: adding a run_url to a job or adls_location to a partition. More advanced: adding a dbx_cores field to job runs, and using querying over job runs downstream from a want to control parallelism down to the number-of-cores-used level.