Topology-oblivious optimization of MPI broadcast algorithms on extreme-scale platforms

Handle URI:
http://hdl.handle.net/10754/600038
Title:
Topology-oblivious optimization of MPI broadcast algorithms on extreme-scale platforms
Authors:
Hasanov, Khalid; Quintin, Jean-Noël; Lastovetsky, Alexey
Abstract:
© 2015 Elsevier B.V. All rights reserved. Significant research has been conducted in collective communication operations, in particular in MPI broadcast, on distributed memory platforms. Most of the research efforts aim to optimize the collective operations for particular architectures by taking into account either their topology or platform parameters. In this work we propose a simple but general approach to optimization of the legacy MPI broadcast algorithms, which are widely used in MPICH and Open MPI. The proposed optimization technique is designed to address the challenge of extreme scale of future HPC platforms. It is based on hierarchical transformation of the traditionally flat logical arrangement of communicating processors. Theoretical analysis and experimental results on IBM BlueGene/P and a cluster of the Grid'5000 platform are presented.
Citation:
Hasanov K, Quintin J-N, Lastovetsky A (2015) Topology-oblivious optimization of MPI broadcast algorithms on extreme-scale platforms. Simulation Modelling Practice and Theory 58: 30–39. Available: http://dx.doi.org/10.1016/j.simpat.2015.03.005.
Publisher:
Elsevier BV
Journal:
Simulation Modelling Practice and Theory
Issue Date:
Nov-2015
DOI:
10.1016/j.simpat.2015.03.005
Type:
Article
ISSN:
1569-190X
Sponsors:
This work has emanated from research conducted with the financial support of IRCSET (Irish Research Council for Science, Engineering and Technology) and IBM, Grant No. EPSPG/2011/188 and Science Foundation Ireland, Grant No. 08/IN.1/I2054.Some of the experiments presented in this publication were carried out using the Grid’5000 experimental testbed, being developed under the INRIA ALADDIN development action with support from CNRS, RENATER and several Universities as well as other funding bodies (see https://www.grid5000.fr).Another part of the experiments were carried out using the resources of the Supercomputing Laboratory at King Abdullah University of Science&Technology (KAUST) in Thuwal, Saudi Arabia.
Appears in Collections:
Publications Acknowledging KAUST Support

Full metadata record

DC FieldValue Language
dc.contributor.authorHasanov, Khaliden
dc.contributor.authorQuintin, Jean-Noëlen
dc.contributor.authorLastovetsky, Alexeyen
dc.date.accessioned2016-02-28T06:34:49Zen
dc.date.available2016-02-28T06:34:49Zen
dc.date.issued2015-11en
dc.identifier.citationHasanov K, Quintin J-N, Lastovetsky A (2015) Topology-oblivious optimization of MPI broadcast algorithms on extreme-scale platforms. Simulation Modelling Practice and Theory 58: 30–39. Available: http://dx.doi.org/10.1016/j.simpat.2015.03.005.en
dc.identifier.issn1569-190Xen
dc.identifier.doi10.1016/j.simpat.2015.03.005en
dc.identifier.urihttp://hdl.handle.net/10754/600038en
dc.description.abstract© 2015 Elsevier B.V. All rights reserved. Significant research has been conducted in collective communication operations, in particular in MPI broadcast, on distributed memory platforms. Most of the research efforts aim to optimize the collective operations for particular architectures by taking into account either their topology or platform parameters. In this work we propose a simple but general approach to optimization of the legacy MPI broadcast algorithms, which are widely used in MPICH and Open MPI. The proposed optimization technique is designed to address the challenge of extreme scale of future HPC platforms. It is based on hierarchical transformation of the traditionally flat logical arrangement of communicating processors. Theoretical analysis and experimental results on IBM BlueGene/P and a cluster of the Grid'5000 platform are presented.en
dc.description.sponsorshipThis work has emanated from research conducted with the financial support of IRCSET (Irish Research Council for Science, Engineering and Technology) and IBM, Grant No. EPSPG/2011/188 and Science Foundation Ireland, Grant No. 08/IN.1/I2054.Some of the experiments presented in this publication were carried out using the Grid’5000 experimental testbed, being developed under the INRIA ALADDIN development action with support from CNRS, RENATER and several Universities as well as other funding bodies (see https://www.grid5000.fr).Another part of the experiments were carried out using the resources of the Supercomputing Laboratory at King Abdullah University of Science&Technology (KAUST) in Thuwal, Saudi Arabia.en
dc.publisherElsevier BVen
dc.subjectBlueGeneen
dc.subjectBroadcasten
dc.subjectCommunicationen
dc.subjectExtreme-scaleen
dc.subjectGrid'5000en
dc.subjectHierarchyen
dc.subjectMPIen
dc.titleTopology-oblivious optimization of MPI broadcast algorithms on extreme-scale platformsen
dc.typeArticleen
dc.identifier.journalSimulation Modelling Practice and Theoryen
dc.contributor.institutionUniversity College Dublin, Dublin, Irelanden
dc.contributor.institutionBull SA, Paris, Franceen
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.