Extreme-Scale Task-Based Cholesky Factorization Toward Climate and Weather Prediction Applications
Keyes, David E.
KAUST DepartmentExtreme Computing Research Center
Applied Mathematics and Computational Science Program
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Office of the President
Preprint Posting Date2019
Permanent link to this recordhttp://hdl.handle.net/10754/656453
MetadataShow full item record
AbstractClimate and weather can be predicted statistically via geospatial Maximum Likelihood Estimates (MLE), as an alternative to running large ensembles of forward models. The MLE-based iterative optimization procedure requires the solving of large-scale linear systems that performs a Cholesky factorization on a symmetric positive-definite covariance matrix—a demanding dense factorization in terms of memory footprint and computation. We propose a novel solution to this problem: at the mathematical level, we reduce the computational requirement by exploiting the data sparsity structure of the matrix off-diagonal tiles by means of low-rank approximations; and, at the programming-paradigm level, we integrate PaRSEC, a dynamic, task-based runtime to reach unparalleled levels of efficiency for solving extreme-scale linear algebra matrix operations. The resulting solution leverages fine-grained computations to facilitate asynchronous execution while providing a flexible data distribution to mitigate load imbalance. Performance results are reported using 3D synthetic datasets up to 42M geospatial locations on 130, 000 cores, which represent a cornerstone toward fast and accurate predictions of environmental applications.
CitationCao, Q., Pei, Y., Akbudak, K., Mikhalev, A., Bosilca, G., Ltaief, H., … Dongarra, J. (2020). Extreme-Scale Task-Based Cholesky Factorization Toward Climate and Weather Prediction Applications. Proceedings of the Platform for Advanced Scientific Computing Conference. doi:10.1145/3394277.3401846
Conference/Event nameThe Platform for Advanced Scientific Computing (PASC) Conference