Competition Rules

Rules

  • Participation is free.
  • There are no monetary prizes.
  • Single-node and distributed implementations are allowed.
  • Partial implementations (e.g. just small to mid-sized datasets and only a few algorithms) are allowed.
  • Submissions should execute each algorithm-dataset combination three times. From these, the arithmetic mean of the processing times is used for ranking.
  • The results of the competition will be published on the LDBC website in the form of leaderboards, which rank them based on performance and price-performance (adjusted for the system price).
  • There is a global leaderboard that includes all algorithms and scale factors. Additionally, there is a separate leaderboard for each scale (S, M, L, XL, 2XL+), algorithm and system category (CPU-based/GPU-based, single-node vs. distributed) to for fine-grained comparison.
  • Submissions are subject to code review and reproducibility attempts from the organizers.
  • System prices should be reported following the TPC Pricing specification.

Recommendations for submissions

  • Submissions using modern hardware are welcome (GPUs, FPGAs, etc.).
  • We encourage the use of cloud compute instances for running the benchmark (if possible).