Square Kilometre Array and its Software Defined Supercomputer ... and a very fast parallel file sys…

Square Kilometre Array and its Software Defined Supercomputer ... and a very fast parallel file system
by John Garbutt
At: FOSDEM 2019
video.fosdem.o...
The next generation of research infrastructure and large scale scientific instruments will face new magnitudes of data. StackHPC have been working with Cambridge University on the Square Kilometre Array (SKA) radio telescope project (in collaboration with both CERN and Cambridge University) to build a performance prototype using OpenSource tools such as OpenStack and Kubernetes. One of the biggest challenges is building storage fast enough to deal with the expected 4Tb/s Read and 0.5 Tb/s Write, yet flexible enough to deal with the expected variety of workloads being run on the system. This has involved much collaboration with CERN given the shared challenges posed by the High-Luminosity LHC upgrade.
The second aspect is making a system that keep up with the ever changing nature of the workloads running on the system. Key ideas from this project are being deployed in production on Cambridge University's Cumulus supercomputer (#87 in the Nov18 top500 www.top500.org.... We explore how this move away from a single Slurm cluster is helping meet a broader range of research computing needs.
Room: K.1.105 (La Fontaine)
Scheduled start: 2019-02-02 14:00:00+01

[@keithnolan-fns]

Why UDP and not RTP?

[@henrikwannheden7114]

RTP is a layer 7 application protocol defined upon layer 4 UDP network transport protocol and serves a completely different solution domain. It's not a tool that makes sense in the SKA context.