A 1.8 trillion degrees-of-freedom, 1.24 petaflops global seismic wave simulation on the K computer

Handle URI:
http://hdl.handle.net/10754/622498
Title:
A 1.8 trillion degrees-of-freedom, 1.24 petaflops global seismic wave simulation on the K computer
Authors:
Tsuboi, Seiji; Ando, Kazuto; Miyoshi, Takayuki; Peter, Daniel ( 0000-0002-3397-5379 ) ; Komatitsch, Dimitri; Tromp, Jeroen
Abstract:
We present high-performance simulations of global seismic wave propagation with an unprecedented accuracy of 1.2 s seismic period for a realistic three-dimensional Earth model using the spectral element method on the K computer. Our seismic simulations use a total of 665.2 billion grid points and resolve 1.8 trillion degrees of freedom. To realize these large-scale computations, we optimize a widely used community software code to efficiently address all hardware parallelization, especially thread-level parallelization to solve the bottleneck of memory usage for coarse-grained parallelization. The new code exhibits excellent strong scaling for the time stepping loop, that is, parallel efficiency on 82,134 nodes relative to 36,504 nodes is 99.54%. Sustained performance of these computations on the K computer is 1.24 petaflops, which is 11.84% of its peak performance. The obtained seismograms with an accuracy of 1.2 s for the entire globe should help us to better understand rupture mechanisms of devastating earthquakes.
KAUST Department:
Extreme Computing Research Center
Citation:
Tsuboi S, Ando K, Miyoshi T, Peter D, Komatitsch D, et al. (2016) A 1.8 trillion degrees-of-freedom, 1.24 petaflops global seismic wave simulation on the K computer. International Journal of High Performance Computing Applications 30: 411–422. Available: http://dx.doi.org/10.1177/1094342016632596.
Publisher:
SAGE Publications
Journal:
International Journal of High Performance Computing Applications
Issue Date:
1-Mar-2016
DOI:
10.1177/1094342016632596
Type:
Article
ISSN:
1094-3420; 1741-2846
Appears in Collections:
Articles; Extreme Computing Research Center

Full metadata record

DC FieldValue Language
dc.contributor.authorTsuboi, Seijien
dc.contributor.authorAndo, Kazutoen
dc.contributor.authorMiyoshi, Takayukien
dc.contributor.authorPeter, Danielen
dc.contributor.authorKomatitsch, Dimitrien
dc.contributor.authorTromp, Jeroenen
dc.date.accessioned2017-01-02T09:55:26Z-
dc.date.available2017-01-02T09:55:26Z-
dc.date.issued2016-03-01en
dc.identifier.citationTsuboi S, Ando K, Miyoshi T, Peter D, Komatitsch D, et al. (2016) A 1.8 trillion degrees-of-freedom, 1.24 petaflops global seismic wave simulation on the K computer. International Journal of High Performance Computing Applications 30: 411–422. Available: http://dx.doi.org/10.1177/1094342016632596.en
dc.identifier.issn1094-3420en
dc.identifier.issn1741-2846en
dc.identifier.doi10.1177/1094342016632596en
dc.identifier.urihttp://hdl.handle.net/10754/622498-
dc.description.abstractWe present high-performance simulations of global seismic wave propagation with an unprecedented accuracy of 1.2 s seismic period for a realistic three-dimensional Earth model using the spectral element method on the K computer. Our seismic simulations use a total of 665.2 billion grid points and resolve 1.8 trillion degrees of freedom. To realize these large-scale computations, we optimize a widely used community software code to efficiently address all hardware parallelization, especially thread-level parallelization to solve the bottleneck of memory usage for coarse-grained parallelization. The new code exhibits excellent strong scaling for the time stepping loop, that is, parallel efficiency on 82,134 nodes relative to 36,504 nodes is 99.54%. Sustained performance of these computations on the K computer is 1.24 petaflops, which is 11.84% of its peak performance. The obtained seismograms with an accuracy of 1.2 s for the entire globe should help us to better understand rupture mechanisms of devastating earthquakes.en
dc.publisherSAGE Publicationsen
dc.subjectK computeren
dc.subjectnumerical seismogramsen
dc.subjectSeismic wave propagationen
dc.subjectspectral element methoden
dc.titleA 1.8 trillion degrees-of-freedom, 1.24 petaflops global seismic wave simulation on the K computeren
dc.typeArticleen
dc.contributor.departmentExtreme Computing Research Centeren
dc.identifier.journalInternational Journal of High Performance Computing Applicationsen
dc.contributor.institutionJapan Agency for Marine-Earth Science and Technology (JAMSTEC), 3173-25 Showa-machi, Kanazawa-ku, Yokohama, Japanen
dc.contributor.institutionLaboratory of Mechanics and Acoustics (LMA), CNRS UPR 7051, Aix-Marseille University, Centrale Marseille, Franceen
dc.contributor.institutionPrinceton University, Princeton, NJ, United Statesen
kaust.authorPeter, Danielen
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.