2 links tagged with all of: data-governance + open-source
Click any tag below to further narrow down your results
Links
Marquez is an open-source metadata server that collects and visualizes data lineage across your organization's pipelines. It works with major tools like Airflow, Spark, dbt, and Dagster to show you where data comes from, where it goes, and how jobs depend on each other.
- Real-time metadata collection through an OpenLineage-compatible API endpoint that integrates with existing data orchestration tools
- Web UI displays data dependencies and lineage as a visual graph, letting you trace datasets back through pipelines and see job inputs/outputs
- Lineage API enables automation for tasks like backfills and root cause analysis by letting you query dependencies across multiple platforms
Apache Ossie is an Apache Incubator project that defines a vendor-neutral YAML spec for semantic data models. It lets teams declare metrics, dimensions and joins once and share them across BI, analytics and AI tools. This prevents metric drift, cuts integration debt and creates a single source of truth.
- Apache Ossie standardizes metric/dimension definitions in YAML so BI, analytics, and AI tools all reference one shared source of truth instead of redefining metrics per dashboard.
- Over 50 organizations, including Snowflake, Databricks, Oracle, Salesforce, dbt Labs, Qlik, and ThoughtSpot, have joined the effort.
- The spec was renamed from Open Semantic Interchange to Apache Ossie in July 2026, shortly after launching a Financial Services Semantic Working Group in June 2026.
- It embeds AI context instructions so LLMs can ground answers in official business logic, aiming to cut reconciliation costs and eliminate conflicting dashboards.