DataHub Python Builds

These prebuilt wheel files can be used to install our Python packages as of a specific commit.

Build context

Built at 2026-02-04T19:52:45.299010+00:00.

{
  "timestamp": "2026-02-04T19:52:45.299010+00:00",
  "branch": "dev/sigma-parallel-sql-parsing",
  "commit": {
    "hash": "f0c6a3c6419c5bd28901338c0603535f31db1918",
    "message": "feat(ingest/sigma): parallelize API calls and add column lineage batching\n\n- Parallelize Sigma API calls for fetching element lineage and SQL queries\n  using ThreadPoolExecutor (previously sequential, now parallel)\n- Add column_lineage_batch_size parameter to process columns in batches,\n  reducing peak memory for wide queries (100+ columns)\n- Rename sql_parsing_threads to max_workers for clarity (used for both\n  API calls and SQL parsing)\n- Add gc.collect() after each batch to reduce memory pressure\n\nConfig options:\n- max_workers: controls parallelism for API calls and SQL parsing (default: 20)\n- column_lineage_batch_size: columns per batch for lineage (default: 20)\n\nThis significantly improves ingestion performance:\n- API calls: ~10-20x faster (parallel instead of sequential)\n- Memory: reduced peak usage for wide Salesforce queries (150+ columns)"
  },
  "pr": {
    "number": 16050,
    "title": "feat(ingest/sigma): add parallel SQL parsing and default db/schema config",
    "url": "https://github.com/datahub-project/datahub/pull/16050"
  }
}

Usage

Current base URL: unknown

Package	Size	Install command
acryl-datahub	2.823 MB	uv pip install 'acryl-datahub @ <base-url>/artifacts/wheels/acryl_datahub-0.0.0.dev1-py3-none-any.whl'
acryl-datahub-actions	0.105 MB	uv pip install 'acryl-datahub-actions @ <base-url>/artifacts/wheels/acryl_datahub_actions-0.0.0.dev1-py3-none-any.whl'
acryl-datahub-airflow-plugin	0.106 MB	uv pip install 'acryl-datahub-airflow-plugin @ <base-url>/artifacts/wheels/acryl_datahub_airflow_plugin-0.0.0.dev1-py3-none-any.whl'
acryl-datahub-dagster-plugin	0.020 MB	uv pip install 'acryl-datahub-dagster-plugin @ <base-url>/artifacts/wheels/acryl_datahub_dagster_plugin-0.0.0.dev1-py3-none-any.whl'
acryl-datahub-gx-plugin	0.010 MB	uv pip install 'acryl-datahub-gx-plugin @ <base-url>/artifacts/wheels/acryl_datahub_gx_plugin-0.0.0.dev1-py3-none-any.whl'
prefect-datahub	0.011 MB	uv pip install 'prefect-datahub @ <base-url>/artifacts/wheels/prefect_datahub-0.0.0.dev1-py3-none-any.whl'