"The Spartan HPC Story: From Small Scale Experimental to Top500 and Beyond"

Mr. Lev Lafayette1

1University Of Melbourne, Australia

Biography:

Lev is a Senior HPC DevOps engineer and the HPC Solutions Team Leader at the University of Melbourne, where he has worked for the past eight years. Prior to that, he worked at the Victorian Partnership for Advanced Computing in a similar role. Over the past twelve years, he has taught thousands of researchers across more than twenty Australian Universities and government agencies.

An incorrigible collector of degrees and with a wide range of interests, Lev has just completed his fourth master's (in Climate Change Science and Policy) and eight degrees. His current academic post-nominal reads:

BA (Hons), GradCertPM, GradCertAdult&TertEd, GradDipAppPsych, MBA, MSc, MHEd, MCCSAP

Abstract:

Faced with a constrained but an increased need for a general purpose High Performance Computer (HPC) the University of Melbourne’s, “Spartan”, was first made available for researcher use in 2016. A needs evaluation led to the implementation of highly innovative architecture at the time, making use of RoCE and a Cloud-HPC hybrid partition structure. Whilst initially a small system, Spartan attracted a lot of attention with its design with presentations in New Zealand, Australia (eResearch), several European HPC centres (including CERN), and the OpenStack Summit in Barcelona. These early successes led Spartan to receive a substantial grant for a GPU partition for a consortium of Victorian universities that pushed the system into the same metrics as a Top500 system, although it was not until November 2023, that certification was sought and achieved (and that was just a single partition).

From a small innovative and cost-effective system designed for general needs, to a world class system, a retrospective of Spartan’s history provides insight for information systems management and operational implementation, covering architecture, hardware choices, user engagement, and training. Further, with future portents under consideration, this presentation will outline a roadmap on Spartan’s probable future as it heads toward ten years of operation which, like the fabled Ship of Theseus, engages in a process of development and regeneration.

 

Categories