Show simple item record

dc.contributor.authorMarkomanolis, Georgios
dc.contributor.authorHadri, Bilel
dc.contributor.authorKhurram, Rooh Ul Amin
dc.contributor.authorFeki, Saber
dc.date.accessioned2017-10-24T10:54:56Z
dc.date.available2017-10-24T10:54:56Z
dc.date.issued2017-10-20
dc.identifier.citationMarkomanolis GS, Hadri B, Khurram R, Feki S (2017) Scientific Applications Performance Evaluation on Burst Buffer. High Performance Computing: 701–711. Available: http://dx.doi.org/10.1007/978-3-319-67630-2_50.
dc.identifier.issn0302-9743
dc.identifier.issn1611-3349
dc.identifier.doi10.1007/978-3-319-67630-2_50
dc.identifier.urihttp://hdl.handle.net/10754/625936
dc.description.abstractParallel I/O is an integral component of modern high performance computing, especially in storing and processing very large datasets, such as the case of seismic imaging, CFD, combustion and weather modeling. The storage hierarchy includes nowadays additional layers, the latest being the usage of SSD-based storage as a Burst Buffer for I/O acceleration. We present an in-depth analysis on how to use Burst Buffer for specific cases and how the internal MPI I/O aggregators operate according to the options that the user provides during his job submission. We analyze the performance of a range of I/O intensive scientific applications, at various scales on a large installation of Lustre parallel file system compared to an SSD-based Burst Buffer. Our results show a performance improvement over Lustre when using Burst Buffer. Moreover, we show results from a data hierarchy library which indicate that the standard I/O approaches are not enough to get the expected performance from this technology. The performance gain on the total execution time of the studied applications is between 1.16 and 3 times compared to Lustre. One of the test cases achieved an impressive I/O throughput of 900 GB/s on Burst Buffer.
dc.description.sponsorshipFor computer time, this research used the resources of the Supercomputing Core Laboratory at King Abdullah University of Science & Technology (KAUST) in Thuwal, Saudi Arabia.
dc.publisherSpringer Nature
dc.relation.urlhttps://link.springer.com/chapter/10.1007%2F978-3-319-67630-2_50
dc.rightsThe final publication is available at Springer via http://dx.doi.org/10.1007/978-3-319-67630-2_50
dc.subjectDataWarp
dc.subjectI/O
dc.subjectBurst Buffer
dc.titleScientific Applications Performance Evaluation on Burst Buffer
dc.typeBook Chapter
dc.contributor.departmentKAUST Supercomputing Laboratory (KSL)
dc.contributor.departmentSupercomputing, Computational Scientists
dc.identifier.journalLecture Notes in Computer Science
dc.eprint.versionPost-print
kaust.personMarkomanolis, Georgios
kaust.personHadri, Bilel
kaust.personKhurram, Rooh Ul Amin
kaust.personFeki, Saber
dc.date.published-online2017-10-20
dc.date.published-print2017


Files in this item

Thumbnail
Name:
wopsss_2017.pdf
Size:
825.8Kb
Format:
PDF
Description:
Accepted Manuscript

This item appears in the following Collection(s)

Show simple item record