databuild/databuild
2025-07-31 19:59:13 -07:00
..
cli Big compile time correctness commit 2025-07-21 19:22:51 -07:00
client Big compile time correctness commit 2025-07-21 19:22:51 -07:00
dashboard Add type safety 2025-07-23 17:56:42 -07:00
dsl/python Big bump 2025-07-31 19:59:13 -07:00
event_log Status code/enum refactor WIP 2025-07-20 14:24:08 -07:00
graph Big bump 2025-07-31 19:59:13 -07:00
job Implement log/metric serving 2025-07-28 22:46:35 -07:00
orchestration Status code/enum refactor WIP 2025-07-20 14:24:08 -07:00
repositories Big compile time correctness commit 2025-07-21 19:22:51 -07:00
runtime Big bump 2025-07-31 19:59:13 -07:00
service Implement log/metric serving 2025-07-28 22:46:35 -07:00
test Big bump 2025-07-31 19:59:13 -07:00
BUILD.bazel Big bump 2025-07-31 19:59:13 -07:00
databuild.proto Implement log/metric serving 2025-07-28 22:46:35 -07:00
format_consistency_test.rs Big compile time correctness commit 2025-07-21 19:22:51 -07:00
lib.rs Implement log/metric serving 2025-07-28 22:46:35 -07:00
log_access.rs Implement log collection in graph 2025-07-28 21:40:46 -07:00
log_collector.rs Implement log/metric serving 2025-07-28 22:46:35 -07:00
mermaid_utils.rs Code/name WIP 2025-07-20 16:01:40 -07:00
metric_templates.rs Implement log/metric serving 2025-07-28 22:46:35 -07:00
metrics_aggregator.rs Implement log/metric serving 2025-07-28 22:46:35 -07:00
prost_generator.rs Pre-typescript mithril commit 2025-07-20 17:54:32 -07:00
proto.py Big bump 2025-07-31 19:59:13 -07:00
proto_wrapper.py Add python protobuf dataclass generation 2025-07-30 20:54:36 -07:00
README.md Add shared core plan 2025-07-19 19:28:54 -07:00
rules.bzl Big bump 2025-07-31 19:59:13 -07:00
status_utils.rs Big compile time correctness commit 2025-07-21 19:22:51 -07:00

DataBuild

API

A sort of requirements doc for the semantics of DataBuild, enumerating the nouns and verbs they can do.

Graph

  • analyze - Produce the job graph required to build the requested set of partitions.
  • build - Analyze and then execute the produced job graph to build the requested partitions.
  • builds
    • list - List past builds.
    • show - Shows current status of specified build and list events. Can tail build events for a build with --follow/-f
    • cancel - Cancel specified build.
  • partitions
    • list - Lists partitions.
    • show - Shows current status of the specified partition.
    • invalidate - Marks a partition as invalid (will be rebuilt, won't be read).
  • jobs
    • list - List jobs in the graph.
    • show - Shows task statistics (success %, runtime, etc) and recent task results.
  • tasks (job runs)
    • list - Lists past tasks.
    • show - Describes current task status and lists events.
    • cancel - Cancels a specific task.