Type
Conference PaperAuthors
Esposito, Aniello
Holst, Glendon
Date
2021-11-13Permanent link to this record
http://hdl.handle.net/10754/673905
Metadata
Show full item recordAbstract
An in situ co-processing visualization pipeline based on the Universal Data Junction (UDJ) library and Inshimtu is presented and used for processing data from Weather Research and Forecasting (WRF) simulations. For the common case of analyzing just a number of fields during simulation, UDJ transfers and redistributes the data in approximately 6 % of the time needed by WRF for a MPI-IO output of all variables upon which a previous method with Inshimtu is based. The relative cost of transport and redistribution compared to IO remains approximately constant up to the highest considered node count without obvious impediments to scale further.Citation
Esposito, A., & Holst, G. (2021). In Situ Visualization of WRF Data Using Universal Data Junction. High Performance Computing, 475–483. doi:10.1007/978-3-030-90539-2_32Sponsors
This work is part of the HPE/Cray center of excellence collaboration at KAUST. UDJ development has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No 773897. We want to thank Hari Dasari colleagues for helping with the test case as well as Tim Dykes and Utz Uwe Haus from the HPE EMEA research lab for support with UDJ.Publisher
Springer International PublishingConference/Event name
International Conference on High Performance Computing, ISC High Performance 2021ISBN
9783030905385Additional Links
https://link.springer.com/10.1007/978-3-030-90539-2_32ae974a485f413a2113503eed53cd6c53
10.1007/978-3-030-90539-2_32