This project demonstrates how to build a high-performance computing (HPC) cluster using Azure virtual machines and Slurm workload manager. The cluster consists of 1 head node and 2 compute nodes configured on Ubuntu.
- βοΈ Platform: Microsoft Azure
- π» Nodes:
- Head Node: 192.168.1.23
- Compute Node 1: 192.168.1.24
- Compute Node 2: 192.168.1.25
- π οΈ Technologies:
- Ubuntu 20.04 LTS
- Slurm Workload Manager
- NFS (Network File System)
- SSH key-based authentication
- Configured private IPs and internal DNS resolution
- NFS shared storage between head and compute nodes
- SSH key-based access across the cluster
- Installed and configured Slurm job scheduler
- Benchmarked with:
- β HPL
- β LAMMPS
- β MILC
- β MATLAB Optimization
- Provision VMs on Azure with static IPs
- Install Slurm and dependencies
- Configure NFS mount and exports
- Enable SSH key auth across nodes
- Submit test jobs using
sbatch
Jeffrey Nkadimeng
πΌ Cloud | HPC | Cybersecurity | ServiceNow
π LinkedIn
MIT β feel free to use or modify this setup.