Spatiotemporal Graph and Hypergraph Partitioning Models for Sparse Matrix-Vector Multiplication on Many-Core Architectures
Type
ArticleKAUST Department
Applied Mathematics and Computational Science ProgramExtreme Computing Research Center
Date
2018-08-10Online Publication Date
2018-08-10Print Publication Date
2018Permanent link to this record
http://hdl.handle.net/10754/628848
Metadata
Show full item recordAbstract
There exist graph/hypergraph partitioning-based row/column reordering methods for encoding either spatial or temporal locality separately for sparse matrix-vector multiplication (SpMV) operations. Spatial and temporal hypergraph models in these methods are extended to encapsulate both spatial and temporal localities based on cut/uncut net categorization obtained from vertex partitioning. These extensions of spatial and temporal hypergraph models encode the spatial locality primarily and the temporal locality secondarily, and vice-versa, respectively. However, the literature lacks models that simultaneously encode both spatial and temporal localities utilizing only vertex partitioning for further improving the performance of SpMV on shared-memory architectures. In order to fill this gap, we propose a novel spatiotemporal hypergraph model that leads to a one-phase spatiotemporal reordering method which encodes both types of locality simultaneously. We also propose a framework for spatiotemporal methods which encodes both types of locality in two dependent phases and two separate phases. The validity of the proposed spatiotemporal models and methods are tested on a wide range of sparse matrices and the experiments are performed on both a 60-core Intel Xeon Phi processor and a Xeon processor. Results show the validity of the methods via almost doubling the Gflop/s performance through enhancing data locality in parallel SpMV operations.Citation
Abubaker NFT, Akbudak K, Aykanat C (2018) Spatiotemporal Graph and Hypergraph Partitioning Models for Sparse Matrix-Vector Multiplication on Many-Core Architectures. IEEE Transactions on Parallel and Distributed Systems: 1–1. Available: http://dx.doi.org/10.1109/TPDS.2018.2864729.Sponsors
This work was partially supported by the Scientific and Technological Research Council of Turkey (TUBITAK) under Grant EEEAG-115E212.Additional Links
https://ieeexplore.ieee.org/document/8432126ae974a485f413a2113503eed53cd6c53
10.1109/TPDS.2018.2864729
Scopus Count
Related items
Showing items related by title, author, creator and subject.
-
BranchNet: Tree Modeling with Hierarchical Graph NetworksZhang, Jiayao (2021-07-04) [Thesis]
Advisor: Michels, Dominik L.
Committee members: Wonka, Peter; Elhoseiny, Mohamed H.Research on modeling trees and plants has attracted a great deal of attention in recent years. Early procedural tree modeling can be divided into four main categories: rule-based algorithms, repetitive patterns, cellular automata, and particle systems. These methods offer a very high level of realism; however, creating millions of varied tree datasets manually is not logistically possible, even for professional 3D modeling artists. Trees created using these previous methods are typically static and the controllability of these procedural tree models is low. Deep generative models are capable of generating any type of shape automatically, making it possible to create 3D models at large scale. In this paper, we introduce a novel deep generative model that generates 3D (botanical) tree models, which are not only edible, but also have diverse shapes. Our proposed network, denoted BranchNet, trains the tree branch structures on a hierarchical Variational Autoencoder (VAE) that learns new generative model structures. By directly encoding shapes into a hierarchy graph, BranchNet can generate diverse, novel, and realistic tree structures. To assist the creation of tree models, we create a domain-specific language with a GUI for modeling 3D shape structures, in which the continuous parameters can be manually edited in order to produce new tree shapes. The trees are interpretable and the GUI can be edited to capture the subset of shape variability. -
Bayesian analysis for exponential random graph models using the adaptive exchange samplerJin, Ick Hoon; Liang, Faming; Yuan, Ying (Statistics and Its Interface, International Press of Boston, 2013) [Article]Exponential random graph models have been widely used in social network analysis. However, these models are extremely difficult to handle from a statistical viewpoint, because of the existence of intractable normalizing constants. In this paper, we consider a fully Bayesian analysis for exponential random graph models using the adaptive exchange sampler, which solves the issue of intractable normalizing constants encountered in Markov chain Monte Carlo (MCMC) simulations. The adaptive exchange sampler can be viewed as a MCMC extension of the exchange algorithm, and it generates auxiliary networks via an importance sampling procedure from an auxiliary Markov chain running in parallel. The convergence of this algorithm is established under mild conditions. The adaptive exchange sampler is illustrated using a few social networks, including the Florentine business network, molecule synthetic network, and dolphins network. The results indicate that the adaptive exchange algorithm can produce more accurate estimates than approximate exchange algorithms, while maintaining the same computational efficiency.
-
Multiple Interaction Attention Model for Open-World Knowledge Graph CompletionFu, Chenpeng; Li, Zhixu; Yang, Qiang; Chen, Zhigang; Fang, Junhua; Zhao, Pengpeng; Xu, Jiajie (Springer Nature, 2019-11-14) [Conference Paper]Knowledge Graph Completion (KGC) aims at complementing missing relationships between entities in a Knowledge Graph (KG). While closed-world KGC approaches utilizing the knowledge within KG could only complement very limited number of missing relations, more and more approaches tend to get knowledge from open-world resources such as online encyclopedias and newswire corpus. For instance, a recent proposed open-world KGC model called ConMask learns embeddings of the entity’s name and parts of its text-description to connect unseen entities to the KG. However, this model does not make full use of the rich feature information in the text descriptions, besides, the proposed relationship-dependent content masking method may easily miss to find the target-words. In this paper, we propose to use a Multiple Interaction Attention (MIA) mechanism to model the interactions between the head entity description, head entity name, the relationship name, and the candidate tail entity descriptions, to form the enriched representations. Our empirical study conducted on two real-world data collections shows that our approach achieves significant improvements comparing to state-of-the-art KGC methods.