LDBC SNB Interactive workload

The LDBC SNB Interactive workload captures transactional graph processing scenario with complex read queries that access the neighbourhood of a given node in the graph and update operations that continuously insert new data in the graph. Its data sets are available in the CWI/SURF data repository.

The workload produces the throughput metric to characterize the performance at the given scale. The full disclosure reports (FDR) further detail the performance of the system under test by listing the data loading time and single query execution times.

Note that the system cost is the sum of the license, hardware, and maintenance costs, where maintenance means 24/7 support with a response time of less than 4 hours.

Audited results using a declarative query language

Benchmark setup	SF	Hardware	Throughput	Documents
System: GraphDB 10.1.1 Test sponsor: Ontotext Date: 2023-01-31 Query language: SPARQL Systems cost: 216,222 USD	30	AWS r6id.8xlarge, 256GiB RAM, 32×Intel Xeon Platinum 8375C vCPUs, 1 read thread, 1 write thread	3.04 ops/s	Full disclosure report Executive summary Signatures Supplementary package
	30	AWS r6id.8xlarge, 256GiB RAM, 32×Intel Xeon Platinum 8375C vCPUs, 2 read threads, 2 write threads	6.76 ops/s
	30	AWS r6id.8xlarge, 256GiB RAM, 32×Intel Xeon Platinum 8375C vCPUs, 4 read threads, 4 write threads	12.16 ops/s

Audited results using an imperative language

Benchmark setup	SF	Hardware	Throughput	Documents
System: GraphScope Flex 0.23.0 Test sponsor: Alibaba DAMO Academy Date: 2023-07-13 Queries implemented in: C++ stored procedures Systems cost: 99,236.04 USD	30	AWS r5d.12xlarge, 374GB RAM, 48×Intel Xeon Platinum 8175M vCPUs	33,180.87 ops/s	Full disclosure report Executive summary Signatures Supplementary package
	100	AWS r5d.12xlarge, 374GB RAM, 48×Intel Xeon Platinum 8175M vCPUs	33,625.36 ops/s
	300	AWS r5d.12xlarge, 374GB RAM, 48×Intel Xeon Platinum 8175M vCPUs	33,261.38 ops/s
System: TuGraph 3.3.4 Test sponsor: Ant Group Date: 2023-01-28 Queries implemented in: C++ Systems cost: 277,542 RMB	30	Alibaba Cloud ecs.g8y.16xlarge, 256GiB RAM, 64×Arm-based YiTian 710 vCPUs	16,133.08 ops/s	Full disclosure report Executive summary Signatures Supplementary package
	100	Alibaba Cloud ecs.g8y.16xlarge, 256GiB RAM, 64×Arm-based YiTian 710 vCPUs	16,966.26 ops/s
	300	Alibaba Cloud ecs.g8y.16xlarge, 256GiB RAM, 64×Arm-based YiTian 710 vCPUs	13,532.62 ops/s
System: TuGraph 3.2.0 Test sponsor: Ant Group Date: 2022-08-16 Queries implemented in: C++ Systems cost: 291,176 USD	30	AWS r5d.12xlarge, 384GiB RAM, 48×Intel Xeon Platinum 8259CL vCPUs	12,252.50 ops/s	Full disclosure report Executive summary Signatures Supplementary package
	100	AWS r5d.12xlarge, 384GiB RAM, 48×Intel Xeon Platinum 8259CL vCPUs	12,934.61 ops/s
	300	AWS r5d.12xlarge, 384GiB RAM, 48×Intel Xeon Platinum 8259CL vCPUs	12,721.24 ops/s
System: Galaxybase 3.3.0 Test sponsor: CreateLink Date: 2022-05-16 Queries implemented in: Java Systems cost: 263,282 USD	30	AWS r5d.12xlarge, 372GB RAM, 48×Intel Xeon Platinum 8259CL vCPUs	9,285.86 ops/s	Full disclosure report Executive summary Signatures Supplementary package
	100	AWS r5d.12xlarge, 372GB RAM, 48×Intel Xeon Platinum 8259CL vCPUs	8,501.21 ops/s
	300	AWS r5d.12xlarge, 372GB RAM, 48×Intel Xeon Platinum 8259CL vCPUs	8,370.52 ops/s
System: TuGraph 1.1 Test sponsor: FMA Date: 2020-07-26 Queries implemented in: C++ Systems cost: 280,650 USD	30	AWS r5d.12xlarge, 374GB RAM, 48×Intel Xeon Platinum 8175M vCPUs	5,436.47 ops/s	Full disclosure report Executive summary Signatures Supplementary package
	100	AWS r5d.12xlarge, 374GB RAM, 48×Intel Xeon Platinum 8175M vCPUs	5,010.77 ops/s
	300	AWS r5d.12xlarge, 374GB RAM, 48×Intel Xeon Platinum 8175M vCPUs	4,855.52 ops/s

LDBC-certified auditors

SNB Interactive audits can be commissioned from the following LDBC-certified auditors:

Márton Búr
Arnau Prat-Pérez
David Püroja

Legacy audited results

Social Network Benchmark Interactive, version 0.2.2

Future workloads

The LDBC SNB Interactive v2 workload is currently under development. See the TPCTC 2023 paper “The LDBC Social Network Benchmark Interactive Workload v2: A Transactional Graph Query Benchmark with Deep Delete Operations”](https://ldbcouncil.org/docs/papers/ldbc-snb-interactive-v2-tpctc2023-preprint.pdf) and its slide deck for details.