- Qlustar Announce - Qlustar Mailing Lists

Qlustar enters Top 100
by General announcements about Qlustar 21 Nov '25

21 Nov '25

This week at SC 25 in St. Louis, a recently implemented Qlustar 14 AI Kubernetes cluster entered the Top 500 list at rank 90 with a measured Linpack performance of *19.48 PFlop/s*. This huge success establishes Qlustar as a proven platform for even the most demanding work-loads in the AI and HPC universe. The cluster worker nodes are HGX machines each of them hosting 8 NVIDIA H100 (80GB HBM3) GPUs which are networked in a rail-optimized fat-tree NDR Infiniband fabric. Qlustar's new NVIDIA image modules support this hardware out-of-the-box with optimal performance. The *Qlustar Kubernetes stack* powering this cluster will become GA and be officially introduced in an upcoming Qlustar 14 feature release. [1] https://top500.org/system/180424/

1 0

Qlustar Feature Update 11/25
by General announcements about Qlustar 21 Nov '25

21 Nov '25

A large bunch of new features were completed and published since the Qlustar 14 release, both in QluMan as well as for Nvidia Enterprise GPU support. Please consult the comprehensive overview at https://qlustar.com/news/2025/2025-11-21-feature-update-11-25

1 0

Security/Bug fix releases 14.0.4, 13.3.4
by General announcements about Qlustar 18 Oct '25

18 Oct '25

The Qlustar releases 14.0.4 and 13.3.4 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/1017251 https://qlustar.com/qsa/2025/1017252 https://qlustar.com/qsa/2025/1017253 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.7 * Remove DB backup script and cron entry. It is now done via stuff in qluman-misc-tools package. * Slurm: Detect HA setup and restart slurmctld via HA system when writing the config. * Alerts: - Drop node_interrupts_total metric, to reduce output. - Add scrapping kubelet-cadvisor. * Power Management: Implement power status, cycle and reset for redfish. * New Hosts Widget: Fix Import MACs feature. * Remote Management: - Allow removing and reordering BIOS boot devices. - Check BIOS boot order on write and sync. - Move configured BIOS boot devices to the front of boot order if they exist. - Store settings checkmarks in DB. * Add qlumand debug options for redfish access and BIOS settings. - core module * Monitoring stack: - Further trim down node-exporter metrics. - kubernetes module * Add kubectl bash shell completion support.

1 0

Security/Bug fix releases 14.0.3, 13.3.3
by General announcements about Qlustar 28 Aug '25

28 Aug '25

The Qlustar releases 14.0.3 and 13.3.3 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0826251 https://qlustar.com/qsa/2025/0826252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.6 * qlumand - Add Depends and Provides to qlustar-module infos * New GUI feature: Implement network proxy to the managed clusters allowing firefox (embedded in singularity image now) to easily connect to a BMCs web interface via a button in the GUI. * RemoteManagement - Add filter for BIOS Settings - Improve on the display of BIOS options: Show the real BIOS text rather than cryptic option keys. - Add BootDevices to BIOS read and change writing boot order * Monitoring - Add direct proxied connections to prometheus / prometheus-alert-manager - Add interface to handle silencing of alerts * HA - Fix resources start command getting executed twice in parallel due to race condition with state updates - Catch monitoring being done on resources with an action due to update races * LDAP user-/group management - Pass ldap group name as 5th argument to add/remove user hook * NewHostWidget - Add ignored MACs feature - Increase default height so more than 1 Unknwon MAC is shown * LDAP - CreateUsersDialog + Enable Retry button for slurm account creation when done with errors + Count slurmd offline instances as errors + Color code table entries for pending / done / error + Handle errors when slurmdb is offline - Add Run / Run without Slurm / Save and Sync Node buttons - Fix exception in generating result text when deleting groups - Fix exceptions with new filtering when importing from passwd file - Sort tab order of UserManagementWidget * Slurm: - Export slurmd status in slurmd component (GUI) - Change calculation of available RAM for Slurm to make it change less often after updates due to varying kernel and image size - Add slurm daemon restart menu in slurmd LED. Allows to restart slurmctld, slurmdbd and qluman-slurmd. - Better handle situations where slurm head-node components are unavailable. * Execd: fix exception when diffing file that doesn't yet exist * Fix DHCP scanner to understand new syslog timestamps * Alerts: - Include config for prometheus scraper - Handle VirtualGL Remote Desktop nodes as separate group * Internal change: Use improved common exec_os_cmd function everywhere. - core module * Monitoring stack: - Trim down node-exporter metrics to generally needed ones - Add IPMI sensors metrics - nvidia modules * Add nvidia-570 module with 570 driver series and switch to open GPU kernel modules * Add nvidia-extra module that contains everything that doesn't depend on a specific driver version (e.g. container toolkit and kubernetes device plugin) * Images with the kubernetes or containers modules should include nvidia-extra to support Nvidia GPUs.

1 0

Security/Bug fix releases 14.0.2, 13.3.2
by General announcements about Qlustar 05 Jul '25

05 Jul '25

The Qlustar releases 14.0.2 and 13.3.2 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0703251 https://qlustar.com/qsa/2025/0703252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.4 * Add '# GPUs' HW property and /etc/qlustar/options.d/gpu-count * NewHostsWidget: Catch error looking up owner of Mac addresses * Improve AD Import Users dialog * Redesign prometheus label logic depending on host role/functionality * Fix bug where LDAP UIDs where multiply added to internal search indices * LDAP: Handle LDAP connection failing on start * LDAP ConfigWidget: Add tooltips and units for password policy settings * Set 'sudo_provider = none' in generated ssd.conf to prevent slapd errors * qluman-cli: Save user certificate in original PWD if save path is relative * Copy config files listed by image modules to compute nodes on boot rather than having them pulled into images during the build phase. * Implement binary support for file transfer to execd. Allows binary files in root-fs customizations. - core module * Activate ACL support for ZFS based /var and /scratch * Add lshw - container module * Add Nvidia CDI support for containerd/kubernetes - nvidia module * Add nvidia fabric manager to support NVSwitch systems * Add nvidia datacenter GPU manager * Add nvidia-bug-report.sh * Add firmware link so that firmware is always found by the kernel module - Kubernetes module * Update to 1.32.5 * Add helm * Add nvidia-device-plugin to support Nvidia GPU workloads - Slurm module * Add correct path for slurm dynamic loading of libpmix For Qlustar 13 and 14: - core module * Add systemd oomscore dropins to replace old mechanism for lowering oomscore of important system processes

1 0

Qlustar 12 is EOL
by General announcements about Qlustar 16 May '25

16 May '25

With the latest security release, Qlustar 12 has reached its EOL and will receive no further updates. Please upgrade to Qlustar 13 as soon as possible in case your cluster is still running Qlustar 12. See https://docs.qlustar.com/Qlustar/13/ClusterOS/release-notes.html#_update_in… for instructions.

1 0

Security/Bug fix releases 14.0.1, 13.3.1, 12.0.3.12
by General announcements about Qlustar 16 May '25

16 May '25

The Qlustar releases 14.0.1, 13.3.1 and 12.0.3.12 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0515251 https://qlustar.com/qsa/2025/0515252 https://qlustar.com/qsa/2025/0515253 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.3 * Fix AttributeError in HostnameWidget save method * RemoteManagement: - Implement clone button - Save changes in redfish CheckBox

1 0

Qlustar 14 is out with fully revamped monitoring
by General announcements about Qlustar 05 May '25

05 May '25

The Qlustar team is pleased to announce the immediate availability of Qlustar 14 for download [1]. It updates Qlustar's core platform to current Ubuntu 24.04 LTS. The AlmaLinux [2] edge platform remains based on 8.10. The highlight of this release is the new state-of-the-art Qlustar Monitoring stack. It is now based on Grafana [3] and Prometheus [4]. Both of them are tightly integrated with the other Qlustar components and can be controlled with a powerful new configuration interface [5] of the QluMan GUI. This release also includes the following individual major HPC core stack component updates: - Spack version 0.23.1 [6] - Slurm version 24.11.3 [7] - RDMA-Core version 55.0 [8] - HWloc version 2.11.2 [9] - UCX version 1.18.1 [10] Please consult the release notes [11] for more details. [1] https://qlustar.com/download/ [2] https://almalinux.org/ [3] https://grafana.com/grafana/ [4] https://prometheus.io/ [5] https://docs.qlustar.com/Qlustar/14/ClusterOS/qluman-guide/Config-Classes.h… [6] https://spack.readthedocs.io/en/latest/ [7] https://www.schedmd.com/slurm/ [8] https://github.com/linux-rdma/rdma-core [9] https://www.open-mpi.org/projects/hwloc/ [10] https://openucx.org/ [11] https://docs.qlustar.com/Qlustar/14/ClusterOS/release-notes.html

1 0

Qlustar HPC Core Stack 25.03
by General announcements about Qlustar 22 Mar '25

22 Mar '25

The Qlustar team is pleased to announce the availability of the HPC Core Stack 25.03 for Qlustar 13. It was published together with the latest security bug fix update and can be installed by updating the Qlustar 13 chroots on the cluster. The HPC CORE STACK [1] was introduced with the release of Qlustar 13 as a new component definition within Qlustar. It is related to the introduction of Spack. This release includes the following individual major HPC core stack component updates: - Spack version 0.23.1 [2] - Slurm version 24.11.3 [3] - RDMA-Core version 55.0 [4] - HWloc version 2.11.2 [5] - UCX version 1.18.1 [6] The new version of Spack allows easy and direct access to the most recent compilers, MPIs and hundreds of other applications relevant to HPC. Amongst others, it includes gcc 14.2.0 and OpenMPI 5.0.5 as new default versions. Minor version updates for other Qlustar 13 components are also included, in particular Nvidia graphics drivers (550.144.03), Lustre (2.15.6) and gdrcopy (2.4.4) for use with Nvidia GPUs. [1] https://qlustar.com/qlustar/hpc-stack/hpc-core-stack/ [2] https://spack.readthedocs.io/en/latest/ [3] https://www.schedmd.com/slurm/ [4] https://github.com/linux-rdma/rdma-core [5] https://www.open-mpi.org/projects/hwloc/ [6] https://openucx.org/

1 0

Security/Bug fix releases 13.3.0, 12.0.3.11
by General announcements about Qlustar 22 Mar '25

22 Mar '25

The Qlustar releases 13.3.0 and 12.0.3.11 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0321251 https://qlustar.com/qsa/2025/0321252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Qlustar HPC Core Stack 03/25 update (details to be announced separately)

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Qlustar Announce