Spatiotemporal Graph and Hypergraph Partitioning Models for Sparse Matrix-Vector Multiplication on Many-Core Architectures
KAUST DepartmentApplied Mathematics and Computational Science Program
Extreme Computing Research Center
Online Publication Date2018-08-10
Print Publication Date2018
Permanent link to this recordhttp://hdl.handle.net/10754/628848
MetadataShow full item record
AbstractThere exist graph/hypergraph partitioning-based row/column reordering methods for encoding either spatial or temporal locality separately for sparse matrix-vector multiplication (SpMV) operations. Spatial and temporal hypergraph models in these methods are extended to encapsulate both spatial and temporal localities based on cut/uncut net categorization obtained from vertex partitioning. These extensions of spatial and temporal hypergraph models encode the spatial locality primarily and the temporal locality secondarily, and vice-versa, respectively. However, the literature lacks models that simultaneously encode both spatial and temporal localities utilizing only vertex partitioning for further improving the performance of SpMV on shared-memory architectures. In order to fill this gap, we propose a novel spatiotemporal hypergraph model that leads to a one-phase spatiotemporal reordering method which encodes both types of locality simultaneously. We also propose a framework for spatiotemporal methods which encodes both types of locality in two dependent phases and two separate phases. The validity of the proposed spatiotemporal models and methods are tested on a wide range of sparse matrices and the experiments are performed on both a 60-core Intel Xeon Phi processor and a Xeon processor. Results show the validity of the methods via almost doubling the Gflop/s performance through enhancing data locality in parallel SpMV operations.
CitationAbubaker NFT, Akbudak K, Aykanat C (2018) Spatiotemporal Graph and Hypergraph Partitioning Models for Sparse Matrix-Vector Multiplication on Many-Core Architectures. IEEE Transactions on Parallel and Distributed Systems: 1–1. Available: http://dx.doi.org/10.1109/TPDS.2018.2864729.
SponsorsThis work was partially supported by the Scientific and Technological Research Council of Turkey (TUBITAK) under Grant EEEAG-115E212.
Showing items related by title, author, creator and subject.
BranchNet: Tree Modeling with Hierarchical Graph NetworksZhang, Jiayao (2021-07-04) [Thesis]
Advisor: Michels, Dominik L.
Committee members: Wonka, Peter; Elhoseiny, Mohamed H.Research on modeling trees and plants has attracted a great deal of attention in recent years. Early procedural tree modeling can be divided into four main categories: rule-based algorithms, repetitive patterns, cellular automata, and particle systems. These methods offer a very high level of realism; however, creating millions of varied tree datasets manually is not logistically possible, even for professional 3D modeling artists. Trees created using these previous methods are typically static and the controllability of these procedural tree models is low. Deep generative models are capable of generating any type of shape automatically, making it possible to create 3D models at large scale. In this paper, we introduce a novel deep generative model that generates 3D (botanical) tree models, which are not only edible, but also have diverse shapes. Our proposed network, denoted BranchNet, trains the tree branch structures on a hierarchical Variational Autoencoder (VAE) that learns new generative model structures. By directly encoding shapes into a hierarchy graph, BranchNet can generate diverse, novel, and realistic tree structures. To assist the creation of tree models, we create a domain-specific language with a GUI for modeling 3D shape structures, in which the continuous parameters can be manually edited in order to produce new tree shapes. The trees are interpretable and the GUI can be edited to capture the subset of shape variability.
DeepMOCCA: A pan-cancer prognostic model identifies personalized prognostic markers through graph attention and multi-omics data integrationAlthubaiti, Sara; Kulmanov, Maxat; Liu, Yang; Gkoutos, Georgios; Schofield, Paul N.; Hoehndorf, Robert (Cold Spring Harbor Laboratory, 2021-03-03) [Preprint]Combining multiple types of genomic, transcriptional, proteomic, and epigenetic datasets has the potential to reveal biological mechanisms across multiple scales, and may lead to more accurate models for clinical decision support. Developing efficient models that can derive clinical outcomes from high-dimensional data remains problematical; challenges include the integration of multiple types of omics data, inclusion of biological background knowledge, and developing machine learning models that are able to deal with this high dimensionality while having only few samples from which to derive a model. We developed DeepMOCCA, a framework for multi-omics cancer analysis. We combine different types of omics data using biological relations between genes, transcripts, and proteins, combine the multi-omics data with background knowledge in the form of protein-protein interaction networks, and use graph convolution neural networks to exploit this combination of multi-omics data and background knowledge. DeepMOCCA predicts survival time for individual patient samples for 33 cancer types and outperforms most existing survival prediction methods. Moreover, DeepMOCCA includes a graph attention mechanism which prioritizes driver genes and prognostic markers in a patient-specific manner; the attention mechanism can be used to identify drivers and prognostic markers within cohorts and individual patients.
Bayesian analysis for exponential random graph models using the adaptive exchange samplerJin, Ick Hoon; Liang, Faming; Yuan, Ying (Statistics and Its Interface, International Press of Boston, 2013) [Article]Exponential random graph models have been widely used in social network analysis. However, these models are extremely difficult to handle from a statistical viewpoint, because of the existence of intractable normalizing constants. In this paper, we consider a fully Bayesian analysis for exponential random graph models using the adaptive exchange sampler, which solves the issue of intractable normalizing constants encountered in Markov chain Monte Carlo (MCMC) simulations. The adaptive exchange sampler can be viewed as a MCMC extension of the exchange algorithm, and it generates auxiliary networks via an importance sampling procedure from an auxiliary Markov chain running in parallel. The convergence of this algorithm is established under mild conditions. The adaptive exchange sampler is illustrated using a few social networks, including the Florentine business network, molecule synthetic network, and dolphins network. The results indicate that the adaptive exchange algorithm can produce more accurate estimates than approximate exchange algorithms, while maintaining the same computational efficiency.