Understanding Metadata Latency with MDWorkbench

Embargo End Date
2020-01-25

Type
Conference Paper

Authors
Kunkel, Julian Martin
Markomanolis, Georgios

KAUST Department
Supercomputing, Computational Scientists

Online Publication Date
2019-01-25

Print Publication Date
2018

Date
2019-01-25

Abstract
While parallel file systems often satisfy the need of applications with bulk synchronous I/O, they lack capabilities of dealing with metadata intense workloads. Typically, in procurements, the focus lies on the aggregated metadata throughput using the MDTest benchmark (https://www.vi4io.org/tools/benchmarks/mdtest ). However, metadata performance is crucial for interactive use. Metadata benchmarks involve even more parameters compared to I/O benchmarks. There are several aspects that are currently uncovered and, therefore, not in the focus of vendors to investigate. Particularly, response latency and interactive workloads operating on a working set of data. The lack of capabilities from file systems can be observed when looking at the IO-500 list, where metadata performance between best and worst system does not differ significantly. In this paper, we introduce a new benchmark called MDWorkbench which generates a reproducible workload emulating many concurrent users or – in an alternative view – queuing systems. This benchmark provides a detailed latency profile, overcomes caching issues, and provides a method to assess the quality of the observed throughput. We evaluate the benchmark on state-of-the-art parallel file systems with GPFS (IBM Spectrum Scale), Lustre, Cray’s Datawarp, and DDN IME, and conclude that we can reveal characteristics that could not be identified before.

Citation
Kunkel, J. M., & Markomanolis, G. S. (2018). Understanding Metadata Latency with MDWorkbench. High Performance Computing, 75–88. doi:10.1007/978-3-030-02465-9_5

Acknowledgements
Thanks for DDN providing access to their facility and the discussion with Jean-Thomas Acquaviva and Jay Lofstead. This research used resources of the KAUST Supercomputing Core Laboratory, of the Argonne Leadership Computing Facility and NERSC, which are under DOE Office of Science User Facilities supported under Contract DE-AC02-06CH11357 and DE-AC02-05CH11231 respectively.

Publisher
Springer International Publishing

Conference/Event Name
International Conference on High Performance Computing, ISC High Performance 2018

DOI
10.1007/978-3-030-02465-9_5

Additional Links
http://link.springer.com/10.1007/978-3-030-02465-9_5http://centaur.reading.ac.uk/79590/9/dlumlwmkm19-understanding_metadata_latency_with_mdworkbench (1).pdfhttp://centaur.reading.ac.uk/79590/9/dlumlwmkm19-understanding_metadata_latency_with_mdworkbench (1).pdf

Permanent link to this record