A survey and experimental comparison of distributed SPARQL engines for very large RDF data
KAUST DepartmentComputer Science Program
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Online Publication Date2017-10-19
Print Publication Date2017-09-01
Permanent link to this recordhttp://hdl.handle.net/10754/626221
MetadataShow full item record
AbstractDistributed SPARQL engines promise to support very large RDF datasets by utilizing shared-nothing computer clusters. Some are based on distributed frameworks such as MapReduce; others implement proprietary distributed processing; and some rely on expensive preprocessing for data partitioning. These systems exhibit a variety of trade-offs that are not well-understood, due to the lack of any comprehensive quantitative and qualitative evaluation. In this paper, we present a survey of 22 state-of-the-art systems that cover the entire spectrum of distributed RDF data processing and categorize them by several characteristics. Then, we select 12 representative systems and perform extensive experimental evaluation with respect to preprocessing cost, query performance, scalability and workload adaptability, using a variety of synthetic and real large datasets with up to 4.3 billion triples. Our results provide valuable insights for practitioners to understand the trade-offs for their usage scenarios. Finally, we publish online our evaluation framework, including all datasets and workloads, for researchers to compare their novel systems against the existing ones.
CitationAbdelaziz I, Harbi R, Khayyat Z, Kalnis P (2017) A survey and experimental comparison of distributed SPARQL engines for very large RDF data. Proceedings of the VLDB Endowment 10: 2049–2060. Available: http://dx.doi.org/10.14778/3151106.3151109.
Except where otherwise noted, this item's license is described as This work is licensed under the Creative Commons AttributionNonCommercialNoDerivatives 4.0 International License. To view a copy of this license, visit http://creativecommons.org/licenses/byncnd/4.0/. For any use beyond those covered by this license, obtain permission by emailing firstname.lastname@example.org.