Dataset Guide

Start here

Dataset search engines and flagship repositories — the places that index everything else.

• Google Dataset Search (opens in a new tab)

  The broadest net — indexes millions of datasets across the open web by schema.org metadata.

• Kaggle Datasets (opens in a new tab)

  Community-uploaded datasets with notebooks attached — see how others actually analyzed them.

• Hugging Face Datasets (opens in a new tab)

  ML training data — text, image, audio corpora, loadable in one line of Python.

• Data.gov (opens in a new tab)

  The US federal catalog — 300k+ datasets across every agency.

• Registry of Open Data on AWS (opens in a new tab)

  Big datasets already staged in the cloud — analyze without downloading.

• Google Cloud Public Datasets (opens in a new tab)

  BigQuery-ready public data — query terabytes with SQL, no ingestion.

• data.world (opens in a new tab)

  A social network for datasets — collaborative, well-documented community catalogs.

• DataHub.io (opens in a new tab)

  Clean, versioned core datasets (country codes, indicators) ready for pipelines.

• UCI Machine Learning Repository (opens in a new tab)

  The classics — the teaching datasets behind decades of ML coursework.

• Common Crawl (opens in a new tab)

  The web itself as a dataset — petabytes of crawl data behind many LLMs.

• Zenodo (opens in a new tab)

  Research artifacts with DOIs — CERN-hosted, everything citable and permanent.

• OpenML (opens in a new tab)

  Datasets with standardized ML benchmarking baked in — compare runs across studies.

• Awesome Public Datasets (opens in a new tab)

  The community's master list — a topic-organized index maintained on GitHub.

• Our World in Data (opens in a new tab)

  Global development indicators with the charts already made — and every CSV downloadable.

• Open Data Network (Socrata) (opens in a new tab)

  Federated search across thousands of government open-data portals.

• Internet Archive (opens in a new tab)

  Datasets that outlive their hosts — dumps, snapshots, and the long tail of history.

• Academic Torrents (opens in a new tab)

  Huge research datasets over BitTorrent — no bandwidth-throttled mirrors.

• World Bank Open Data (opens in a new tab)

  Country-level economic and development indicators, decades deep.

• data.europa.eu (opens in a new tab)

  The EU's federated portal — over a million datasets from European institutions.