Skip to content

Manabeng/azure-hpc-cluster

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

6 Commits
Β 
Β 
Β 
Β 

Repository files navigation

πŸ”· Azure HPC Cluster

This project demonstrates how to build a high-performance computing (HPC) cluster using Azure virtual machines and Slurm workload manager. The cluster consists of 1 head node and 2 compute nodes configured on Ubuntu.


βš™οΈ Architecture

  • ☁️ Platform: Microsoft Azure
  • πŸ’» Nodes:
    • Head Node: 192.168.1.23
    • Compute Node 1: 192.168.1.24
    • Compute Node 2: 192.168.1.25
  • πŸ› οΈ Technologies:
    • Ubuntu 20.04 LTS
    • Slurm Workload Manager
    • NFS (Network File System)
    • SSH key-based authentication

πŸ“¦ Features

  • Configured private IPs and internal DNS resolution
  • NFS shared storage between head and compute nodes
  • SSH key-based access across the cluster
  • Installed and configured Slurm job scheduler
  • Benchmarked with:
    • βœ… HPL
    • βœ… LAMMPS
    • βœ… MILC
    • βœ… MATLAB Optimization

πŸ§ͺ Usage

  1. Provision VMs on Azure with static IPs
  2. Install Slurm and dependencies
  3. Configure NFS mount and exports
  4. Enable SSH key auth across nodes
  5. Submit test jobs using sbatch

πŸ‘¨β€πŸ’» Author

Jeffrey Nkadimeng
πŸ’Ό Cloud | HPC | Cybersecurity | ServiceNow
πŸ”— LinkedIn


πŸ“„ License

MIT – feel free to use or modify this setup.

About

Slurm-based HPC cluster on Azure using Ubuntu VMs

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published