Towards an HPC Service Oriented Hybrid Cloud Architecture Designed for Interactive Workflows

Abstract

We detail Ludion, a service-oriented hybrid architecture, well-adapted to launch, monitor and steer interactive services running either on on-premise HPC resource, on user laptop and workstation or in the cloud. Based on AWS server-less components at virtually no cost, Ludion requires no special privileges. It consists of a catalog of services, a dashboard hosted in the cloud and a set of commands to install on the target resources. In the lifetime of a job, a user can register and publish new service on the dashboard. From this unique location, it is possible to trigger basic commands that are forwarded to the corresponding job. In this article, we expose several typical use cases Ludion was designed for and detail its implementation as well as the services already in place relying on this architecture.