Towards an HPC Service Oriented Hybrid Cloud Architecture Designed for Interactive Workflows

Kortas, Samuel; Shaikh, Mohsin Ahmed

Towards an HPC Service Oriented Hybrid Cloud Architecture Designed for Interactive Workflows

Files

Towards_an_HPC_service_oriented_hybrid_cloud_architecture_designed_for_interactive_workflows_Kortas_Shaikh.pdf (646.4 KB)

Type

Conference Paper

Authors

Kortas, Samuel
Shaikh, Mohsin Ahmed

KAUST Department

Computational Scientists
Supercomputing, Computational Scientists

Date

2020

Abstract

We detail Ludion, a service-oriented hybrid architecture, well-adapted to launch, monitor and steer interactive services running either on on-premise HPC resource, on user laptop and workstation or in the cloud. Based on AWS server-less components at virtually no cost, Ludion requires no special privileges. It consists of a catalog of services, a dashboard hosted in the cloud and a set of commands to install on the target resources. In the lifetime of a job, a user can register and publish new service on the dashboard. From this unique location, it is possible to trigger basic commands that are forwarded to the corresponding job. In this article, we expose several typical use cases Ludion was designed for and detail its implementation as well as the services already in place relying on this architecture.

Citation

Kortas, S., & Shaikh, M. A. (2020). Towards an HPC Service Oriented Hybrid Cloud Architecture Designed for Interactive Workflows. 2020 IEEE/ACM HPC for Urgent Decision Making (UrgentHPC). doi:10.1109/urgenthpc51945.2020.00010

Acknowledgements

For computer time, this research used the resources of the Supercomputing Laboratory at King Abdullah University of Science & Technology (KAUST) in Thuwal, Saudi Arabia.