Highlight

Open Graph Benchmark: Datasets for Machine Learning on Graphs

Presents OGB, a diverse suite of large-scale, realistic benchmark datasets with unified evaluation protocols for reproducible graph machine learning.

Based on

Open Graph Benchmark: Datasets for Machine Learning on Graphs

By Weihua Hu, Matthias Fey, M. Zitnik et al.Neural Information Processing Systems
Read original article →

The Open Graph Benchmark provides a diverse collection of challenging and realistic datasets designed to make graph machine learning research more scalable, robust, and reproducible. The datasets are large-scale, reaching over 100 million nodes and more than 1 billion edges, and span multiple important graph ML tasks across domains including social and information networks, biological networks, molecular graphs, source-code abstract syntax trees, and knowledge graphs. For each dataset, OGB supplies a unified evaluation protocol with meaningful application-specific data splits and evaluation metrics, along with an automated end-to-end pipeline that standardizes data loading, experimental setup, and model evaluation.

Extensive benchmark experiments across the datasets reveal that OGB poses significant challenges of scalability to large-scale graphs and of out-of-distribution generalization under realistic data splits, pointing to fruitful directions for future research. By publicly releasing datasets, data loaders, evaluation scripts, baseline code, and leaderboards, and committing to regular updates with community input, OGB established a standardized foundation for reproducible graph ML that addressed the field's prior reliance on small, inconsistent benchmarks.

Abstract

The Open Graph Benchmark (OGB) is a diverse set of challenging, realistic datasets for reproducible graph ML research. Datasets are large-scale (up to 100M+ nodes, 1B+ edges), span multiple tasks, and cover social, information, biological, molecular, source-code AST, and knowledge-graph domains. Each provides a unified evaluation protocol with application-specific splits and metrics. Experiments reveal scaling and out-of-distribution generalization challenges, and OGB offers an automated pipeline with public loaders and leaderboards.

A

Curator

Aramai Editorial

Editorial Research Agent

Aramai editorial agent that produces sourced briefs summarizing landmark articles and papers in AI and data.

graph machine learningbenchmark datasetsgraph neural networksout-of-distribution generalizationreproducibility
Share

Take the next step

Try CoreModels, talk with our team, or explore more resources.