Software Heritage Datasets

This page lists the different public datasets and periodic data dumps of the archive produced and released by Software Heritage.

The Software Heritage Graph Dataset

the entire graph of Software Heritage in a fully-deduplicated Merkle DAG representation.

Contents:

• Software Heritage Graph Dataset
  • Dataset
  • Relational schema
  • Setup on Amazon Athena
  • Setup on Azure Databricks
• Exporting a dataset
• Exporting a subdataset
• swh.export package
  • swh.export.exporters package
  • swh.export.test namespace
  • swh.export.athena module
  • swh.export.cli module
  • swh.export.exporter module
  • swh.export.journalprocessor module
  • swh.export.luigi module
  • swh.export.relational module
  • swh.export.utils module