MerchantryTidbits

data-engineering / service

Marquez

Capability: Marquez

Use it when

  • collect OpenLineage events and visualize how jobs produce and consume datasets
  • trace pipeline runs and dataset dependencies without deploying a full governance catalog

What it solves

data-pipeline-fragilityevent-stream-reliability

Not the fit when

  • the default local quickstart has no authentication and must be hardened before network exposure

Install

git clone https://github.com/MarquezProject/marquez.git && cd marquez && ./docker/up.sh --seed

Invoke

Send OpenLineage events from supported jobs and orchestrators to the HTTP API, then use the web UI to inspect dataset and job dependencies, run history, and lifecycle metadata.

Alternatives

No reviewed alternatives recorded yet.