Cluster in the Cloud: Easy, Scalable and Heterogeneous

Matt Williams, University of Bristol

Cluster in the Cloud (https://cluster-in-the-cloud.readthedocs.io) is a free and open source tool to create a fully elastic and scaleable heterogeneous Slurm cluster on any of Oracle’s OCI, Google Cloud or AWS. It is able to create a fully operational compute cluster in 10 minutes, providing the user with a familiar environment to their institutional clusters. It’s been used to provide compute support to several published research papers so far. This talk will go though how the tool works and discuss the challenges faced when creating a tool to work across cloud providers.