- Qlustar General - Qlustar Mailing Lists

Qlustar 13 -> 14 update now supported
by no-reply-list＠qlustar.org 30 Dec '25

30 Dec '25

Support for updates of Qlustar 13 clusters to Qlustar 14 are now fully supported. Please consult the update instructions [1]. [1] https://docs.qlustar.com/Qlustar/14/ClusterOS/release-notes.html#_update_in…

1 0

Security/Bug fix releases 14.0.5, 13.3.5
by no-reply-list＠qlustar.org 22 Dec '25

22 Dec '25

The Qlustar releases 14.0.5 and 13.3.5 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/1220251 https://qlustar.com/qsa/2025/1220252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 14: - initramfs module * Up unionfs max_files to 131072 For Qlustar 14 only: - core module * Monitoring stack: - Add CPU temperature metrics extracted from Linux kernel/hwmon. - Add support for Dell IPMI temperature metrics. - Add ql_unionfs_open_files metrics to track the # of open files of the main unionfs process of the Qlustar node OS. * disk-auto-setup: Reliably wipe LVM and md-raid stuff

1 0

QluMan GUI running natively on Windows
by no-reply-list＠qlustar.org 01 Dec '25

01 Dec '25

With the release of WSL 2 [1] it has become straight-forward to run the QluMan GUI directly on Windows workstations. We have now added this constellation into our portfolio of tested, verified and supported components. This means that cluster admins working on windows can now follow the corresponding setup guide [2] and enjoy a much improved user experience when working on Qlustar clusters. [1] https://learn.microsoft.com/en-us/windows/wsl/about#what-is-wsl-2 [2] https://docs.qlustar.com/Qlustar/14/ClusterOS/qluman-guide/qluman-guide.htm…

1 0

Qlustar enters Top 100
by no-reply-list＠qlustar.org 21 Nov '25

21 Nov '25

This week at SC 25 in St. Louis, a recently implemented Qlustar 14 AI Kubernetes cluster entered the Top 500 list at rank 90 with a measured Linpack performance of *19.48 PFlop/s*. This huge success establishes Qlustar as a proven platform for even the most demanding work-loads in the AI and HPC universe. The cluster worker nodes are HGX machines each of them hosting 8 NVIDIA H100 (80GB HBM3) GPUs which are networked in a rail-optimized fat-tree NDR Infiniband fabric. Qlustar's new NVIDIA image modules support this hardware out-of-the-box with optimal performance. The *Qlustar Kubernetes stack* powering this cluster will become GA and be officially introduced in an upcoming Qlustar 14 feature release. [1] https://top500.org/system/180424/

1 0

Qlustar Feature Update 11/25
by no-reply-list＠qlustar.org 21 Nov '25

21 Nov '25

A large bunch of new features were completed and published since the Qlustar 14 release, both in QluMan as well as for Nvidia Enterprise GPU support. Please consult the comprehensive overview at https://qlustar.com/news/2025/2025-11-21-feature-update-11-25

1 0

ssh server and oom_score_adj
by Rolandas Naujikas 13 Nov '25

13 Nov '25

Hi, Recently I found that our login nodes are abused with users running heavy nodejs sessions (from visual studio code). I setup some memory limits for users and OOM is coming, but cannot kill users processes, because all of them are with oom_score_adj=-1000. It is coming from parent sshd server also with oom_score_adj=-1000. As a workaround I'm stopping traditional ssh server and starting ssh.socket at boot (via rc.boot script). Now oom_score_adj=0 as it should be. That is also important for computing nodes with ssh connection enabled. Regards Rolandas P.S. We are still on Qlustar 13, so I don't know situation on Qlustar 14, but it could be different because ssh connection in Ubuntu 24.04 LTS is activated via ssh socket already.

2 3

Add users from command line
by Rolandas Naujikas 11 Nov '25

11 Nov '25

Hi, Do there is some way to add/manage users in Qlustar 12/13/14 from command line ? Some admins have difficulties to run qluman GUI. Could it be done via Qluman router API ? Regards Rolandas

2 1

Security/Bug fix releases 14.0.4, 13.3.4
by no-reply-list＠qlustar.org 18 Oct '25

18 Oct '25

The Qlustar releases 14.0.4 and 13.3.4 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/1017251 https://qlustar.com/qsa/2025/1017252 https://qlustar.com/qsa/2025/1017253 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.7 * Remove DB backup script and cron entry. It is now done via stuff in qluman-misc-tools package. * Slurm: Detect HA setup and restart slurmctld via HA system when writing the config. * Alerts: - Drop node_interrupts_total metric, to reduce output. - Add scrapping kubelet-cadvisor. * Power Management: Implement power status, cycle and reset for redfish. * New Hosts Widget: Fix Import MACs feature. * Remote Management: - Allow removing and reordering BIOS boot devices. - Check BIOS boot order on write and sync. - Move configured BIOS boot devices to the front of boot order if they exist. - Store settings checkmarks in DB. * Add qlumand debug options for redfish access and BIOS settings. - core module * Monitoring stack: - Further trim down node-exporter metrics. - kubernetes module * Add kubectl bash shell completion support.

1 0

Security/Bug fix releases 14.0.3, 13.3.3
by no-reply-list＠qlustar.org 28 Aug '25

28 Aug '25

The Qlustar releases 14.0.3 and 13.3.3 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0826251 https://qlustar.com/qsa/2025/0826252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.6 * qlumand - Add Depends and Provides to qlustar-module infos * New GUI feature: Implement network proxy to the managed clusters allowing firefox (embedded in singularity image now) to easily connect to a BMCs web interface via a button in the GUI. * RemoteManagement - Add filter for BIOS Settings - Improve on the display of BIOS options: Show the real BIOS text rather than cryptic option keys. - Add BootDevices to BIOS read and change writing boot order * Monitoring - Add direct proxied connections to prometheus / prometheus-alert-manager - Add interface to handle silencing of alerts * HA - Fix resources start command getting executed twice in parallel due to race condition with state updates - Catch monitoring being done on resources with an action due to update races * LDAP user-/group management - Pass ldap group name as 5th argument to add/remove user hook * NewHostWidget - Add ignored MACs feature - Increase default height so more than 1 Unknwon MAC is shown * LDAP - CreateUsersDialog + Enable Retry button for slurm account creation when done with errors + Count slurmd offline instances as errors + Color code table entries for pending / done / error + Handle errors when slurmdb is offline - Add Run / Run without Slurm / Save and Sync Node buttons - Fix exception in generating result text when deleting groups - Fix exceptions with new filtering when importing from passwd file - Sort tab order of UserManagementWidget * Slurm: - Export slurmd status in slurmd component (GUI) - Change calculation of available RAM for Slurm to make it change less often after updates due to varying kernel and image size - Add slurm daemon restart menu in slurmd LED. Allows to restart slurmctld, slurmdbd and qluman-slurmd. - Better handle situations where slurm head-node components are unavailable. * Execd: fix exception when diffing file that doesn't yet exist * Fix DHCP scanner to understand new syslog timestamps * Alerts: - Include config for prometheus scraper - Handle VirtualGL Remote Desktop nodes as separate group * Internal change: Use improved common exec_os_cmd function everywhere. - core module * Monitoring stack: - Trim down node-exporter metrics to generally needed ones - Add IPMI sensors metrics - nvidia modules * Add nvidia-570 module with 570 driver series and switch to open GPU kernel modules * Add nvidia-extra module that contains everything that doesn't depend on a specific driver version (e.g. container toolkit and kubernetes device plugin) * Images with the kubernetes or containers modules should include nvidia-extra to support Nvidia GPUs.

1 0

Security/Bug fix releases 14.0.2, 13.3.2
by no-reply-list＠qlustar.org 05 Jul '25

05 Jul '25

The Qlustar releases 14.0.2 and 13.3.2 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0703251 https://qlustar.com/qsa/2025/0703252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.4 * Add '# GPUs' HW property and /etc/qlustar/options.d/gpu-count * NewHostsWidget: Catch error looking up owner of Mac addresses * Improve AD Import Users dialog * Redesign prometheus label logic depending on host role/functionality * Fix bug where LDAP UIDs where multiply added to internal search indices * LDAP: Handle LDAP connection failing on start * LDAP ConfigWidget: Add tooltips and units for password policy settings * Set 'sudo_provider = none' in generated ssd.conf to prevent slapd errors * qluman-cli: Save user certificate in original PWD if save path is relative * Copy config files listed by image modules to compute nodes on boot rather than having them pulled into images during the build phase. * Implement binary support for file transfer to execd. Allows binary files in root-fs customizations. - core module * Activate ACL support for ZFS based /var and /scratch * Add lshw - container module * Add Nvidia CDI support for containerd/kubernetes - nvidia module * Add nvidia fabric manager to support NVSwitch systems * Add nvidia datacenter GPU manager * Add nvidia-bug-report.sh * Add firmware link so that firmware is always found by the kernel module - Kubernetes module * Update to 1.32.5 * Add helm * Add nvidia-device-plugin to support Nvidia GPU workloads - Slurm module * Add correct path for slurm dynamic loading of libpmix For Qlustar 13 and 14: - core module * Add systemd oomscore dropins to replace old mechanism for lowering oomscore of important system processes

1 0

Re: Users job processes are not killable by OOM
by Rolandas Naujikas 02 Jun '25

02 Jun '25

diff -u /usr/sbin/ql-adjust-oomscore ql-adjust-oomscore --- /usr/sbin/ql-adjust-oomscore 2025-04-15 11:41:22.000000000 +0300 +++ ql-adjust-oomscore 2025-05-28 15:52:27.993037862 +0300 @@ -32,6 +32,7 @@ systemd Xorg sssd rsyslogd dbus-daemon lightdm mysqld \ qluman-execd.py qlumand.py qluman-dhcpscanner.py qluman-router.py \ slurmctld slurmd" +USERS="root,_rpc,statd,messagebus,systemd-timesync,ganglia" DEFAULTS=/etc/default/oomscore function set_oom() { @@ -42,7 +43,7 @@ SCORE="$COMPAT_SCORE" fi for proc in $procs; do - pids=$(pgrep -f $proc) + pids=$(pgrep -u $USERS -f $proc) for i in $pids; do oom_adj=/proc/$i/${target_file} if [ -f $oom_adj ]; then On 2025-05-28 14:15, rolnas(a)gmail.com wrote: > Hi, > > Finally found a source of problem. In Qlustar 13 distribution there is a periodic (hourly) script to make some processes unkillable for OOM, but pattern to choose processes by they command line is too wide and process 182580 were matching it (because of slurmd in name). > > Regards > Rolandas > > P.S. Script ql-adjust-oomscore. > > On 2025-05-28 11:29, rolnas(a)gmail.com wrote: >> Hi, >> >> We are using SLURM 24.11.5 and maintaining HPC cluster. >> Several times we had nodes stuck after user jobs. >> Investigation lead to OOM situations. >> Deeper investigation found in some strange situations users jobs oom_score_adj is left at -1000 as slurmstepd process. >> >> For e.g. (some information is changed for privacy): >> root 182565 0.0 0.0 947952 30128 ? SLl May27 0:04 slurmstepd: [177126.batch] >> hpc_user 182580 0.0 0.0 1845524 70696 ? Sl May27 0:04 \_ / scratch/lustre/home/hpc_user/miniforge-pypy3/envs/snakemake/bin/ python3.12 /var/lib/slurm-llnl/slurmd/job177126/slurm_script -p all -- use-conda --rerun-incomplete >> hpc_user 241662 99.9 7.2 30762668 28598376 ? R May27 1418:09 \_ ClonalFrameML ... >> >> cat /proc/{182565,182580,241662}/oom_score_adj >> -1000 >> -1000 >> -1000 >> >> I'm trying to replicate that situation and no luck. Every time I'm getting users jobs with oom_score_adj=0 what it should be. >> >> Regards >> Rolandas >> >> P.S. Command to launch this job was: >> sbatch -A alloc_2a21c_test -c 12 --time=100:00:00 snakemake -p all -- use-conda --rerun-incomplete

2 3

Connection error using Qluman singularity images
by Beethoven Santos 28 May '25

28 May '25

Dear All, I cannot use the Qluman singularity images to connect to a small cluster I am managing. When I try to connect, Qluman refuses to do so with the following message: non-network local connections being added to access control list qt.qpa.plugin: Could not find the Qt platform plugin "wayland" in "" QStandardPaths: XDG_RUNTIME_DIR points to non-existing path '/run/user/1000', please create it with 0700 permissions. Qt: Session management error: None of the authentication protocols specified are supported 2025-05-27 06:08:12,776 ERROR qlunet.Node router for '******' is not responding to pings: reconnecting I had to replace sensitive information with *'s. Some additional info: Qluman singularity image version: 13.7.2 Version of qluman-* pkgs in the cluster: 13.5.6 Please help me with this problem. Sincerely, Beethoven Santos

2 1

Qlustar 12 is EOL
by no-reply-list＠qlustar.org 16 May '25

16 May '25

With the latest security release, Qlustar 12 has reached its EOL and will receive no further updates. Please upgrade to Qlustar 13 as soon as possible in case your cluster is still running Qlustar 12. See https://docs.qlustar.com/Qlustar/13/ClusterOS/release-notes.html#_update_in… for instructions.

1 0

Security/Bug fix releases 14.0.1, 13.3.1, 12.0.3.12
by no-reply-list＠qlustar.org 16 May '25

16 May '25

The Qlustar releases 14.0.1, 13.3.1 and 12.0.3.12 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0515251 https://qlustar.com/qsa/2025/0515252 https://qlustar.com/qsa/2025/0515253 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 14 only: - QluMan 14.0.3 * Fix AttributeError in HostnameWidget save method * RemoteManagement: - Implement clone button - Save changes in redfish CheckBox

1 0

Qlustar 14 is out with fully revamped monitoring
by no-reply-list＠qlustar.org 07 May '25

07 May '25

The Qlustar team is pleased to announce the immediate availability of Qlustar 14 for download [1]. It updates Qlustar's core platform to current Ubuntu 24.04 LTS. The AlmaLinux [2] edge platform remains based on 8.10. The highlight of this release is the new state-of-the-art Qlustar Monitoring stack. It is now based on Grafana [3] and Prometheus [4]. Both of them are tightly integrated with the other Qlustar components and can be controlled with a powerful new configuration interface [5] of the QluMan GUI. This release also includes the following individual major HPC core stack component updates: - Spack version 0.23.1 [6] - Slurm version 24.11.3 [7] - RDMA-Core version 55.0 [8] - HWloc version 2.11.2 [9] - UCX version 1.18.1 [10] Please consult the release notes [11] for more details. [1] https://qlustar.com/download/ [2] https://almalinux.org/ [3] https://grafana.com/grafana/ [4] https://prometheus.io/ [5] https://docs.qlustar.com/Qlustar/14/ClusterOS/qluman-guide/Config-Classes.h… [6] https://spack.readthedocs.io/en/latest/ [7] https://www.schedmd.com/slurm/ [8] https://github.com/linux-rdma/rdma-core [9] https://www.open-mpi.org/projects/hwloc/ [10] https://openucx.org/ [11] https://docs.qlustar.com/Qlustar/14/ClusterOS/release-notes.html

3 2

Home File-System
by ignas.bunikis＠scilifelab.uu.se 08 Apr '25

08 Apr '25

Hej, Would you mind giving a short guide how to correctly setup Home File-System on NFS? Documentation just informs that: "If you choose Other, then no configuration for a home file-system will be done. In this case, you won’t be able to add any cluster users without further manual steps to setup a home file-system." Cheers, Iggy

2 7

Qlustar HPC Core Stack 25.03
by no-reply-list＠qlustar.org 22 Mar '25

22 Mar '25

The Qlustar team is pleased to announce the availability of the HPC Core Stack 25.03 for Qlustar 13. It was published together with the latest security bug fix update and can be installed by updating the Qlustar 13 chroots on the cluster. The HPC CORE STACK [1] was introduced with the release of Qlustar 13 as a new component definition within Qlustar. It is related to the introduction of Spack. This release includes the following individual major HPC core stack component updates: - Spack version 0.23.1 [2] - Slurm version 24.11.3 [3] - RDMA-Core version 55.0 [4] - HWloc version 2.11.2 [5] - UCX version 1.18.1 [6] The new version of Spack allows easy and direct access to the most recent compilers, MPIs and hundreds of other applications relevant to HPC. Amongst others, it includes gcc 14.2.0 and OpenMPI 5.0.5 as new default versions. Minor version updates for other Qlustar 13 components are also included, in particular Nvidia graphics drivers (550.144.03), Lustre (2.15.6) and gdrcopy (2.4.4) for use with Nvidia GPUs. [1] https://qlustar.com/qlustar/hpc-stack/hpc-core-stack/ [2] https://spack.readthedocs.io/en/latest/ [3] https://www.schedmd.com/slurm/ [4] https://github.com/linux-rdma/rdma-core [5] https://www.open-mpi.org/projects/hwloc/ [6] https://openucx.org/

1 0

Security/Bug fix releases 13.3.0, 12.0.3.11
by no-reply-list＠qlustar.org 22 Mar '25

22 Mar '25

The Qlustar releases 13.3.0 and 12.0.3.11 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0321251 https://qlustar.com/qsa/2025/0321252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Qlustar HPC Core Stack 03/25 update (details to be announced separately)

1 0

Denied permission when restoring a database in qluman-qt
by ldettmann＠web.de 25 Feb '25

25 Feb '25

Qlustar version: 13.2 Qluman version: 13.7.2 I am trying to restore a qluman database from another server using "Manage Cluster" > "Global Configs" > "Restore database" and encountered an error: Permission denied. However, I also tried it with a backup, which I created within the current session, and encountered the same error. What can I do? Best regards, Lorenz

3 4

QluMan configuration for single sign on
by João Manuel Rodrigues 19 Feb '25

19 Feb '25

Documentation says: "b) QluMan may be configured to allow for a single sign-on setup where users can be imported from and authenticated against an Active Directory (AD) server." <https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/components/ldap.…> How can I configure QluMan this way? I have configured sssd on the head node to connect to our AD (ldap + kerberos), but in QluMan, "Components > LDAP > Import Users > From AD" is disabled (gray). Thanks, João

1 0

Security/Bug fix releases 13.2.4, 12.0.3.10
by no-reply-list＠qlustar.org 05 Feb '25

05 Feb '25

The Qlustar releases 13.2.4 and 12.0.3.10 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2025/0205251 https://qlustar.com/qsa/2025/0205252 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to QluMan 13.7.2 + Slurm: void exception when User Management is opened at startup + HA: - fix exception when mail can't be send - change koton command for ipmitool syntax + LoginData: add missing imports for converting v1 safe to v2 + qluman-qt: Add support for running on wayland

1 0

BeeFGS setup help
by aninramesh＠gmail.com 25 Jan '25

25 Jan '25

Hello, I'm currently attempting to establish a BeeFGS file system on qlustar. Thus far, I've been following the qlustar documentation to assist with the setup process. However, I've encountered a problem following the step "+ Their beegfs role is assigned to the nodes in /etc/qlustar/common/image-files/softgroups. Change the node names there according to your naming scheme," that is found in the [BeeGFS on Qlustar - Quick Start] https://docs.qlustar.com/Qlustar/13/DataStack/quick-start-guide.html. Despite integrating the client and server name in accordance with my qlustar setup, the mount point does not appear on the client side. I attempted to restart the nodes, but this was unsuccessful. Is it possible for you to provide some guidance on this issue? I also want to point out that an error occurs when I input the `beegfs-ctl` command on the storage node. Even though the configuration file indicates that connDisableAuthentication is set to true, the error message states, "Unrecoverable error: No connAuthFile configured. Using BeeGFS without connection authentication is considered insecure and is not recommended. If you really want or need to run BeeGFS without connection authentication, please set connDisableAuthentication to true." I have also made an attempt to mount a drive via the 'Network FS Mounts' dialogue box in Qluman, but to no avail. I followed the instructions provided in section 7.5 - Network Filesystem Exports/Mounts. I welcome any suggestions or thoughts you may have on this issue. Additionally, I believe I have identified an error in the `https://docs.qlustar.com/Qlustar/13/DataStack/quick-start-guide.html`. Within section 1.2.1 (Create storage server instance), isn’t the command `beegfs-setup-storage -p /beegfs/stor -s ${HOSTNAME##-} -i ${HOSTNAME##*-}01 -m beosrv-c` as opposed to `beegfs-setup-storage -p /beegfs/stor -s ${HOSTNAME##*-} -i ${HOSTNAME##*-}01 -m beosrv-c`? Anin

2 1

Error in LoginData.py
by Yaroslav Boyko 10 Jan '25

10 Jan '25

Good afternoon ! After the last update I got the following error in qluman-qt: 2024-12-10 11:16:49,539 ERROR client.qt.ConnectClusterDialog loading ClusterModel failed: Traceback (most recent call last): File “/usr/lib/python3/dist-packages/qluman-13/client/qt/ConnectClusterDialog.py”, line 187, in __init__ self.undo() File “/usr/lib/python3/dist-packages/qluman-13/client/qt/ConnectClusterDialog.py”, line 232, in undo self.root = Node.from_safe(data) File “/usr/lib/python3/dist-packages/qluman-13/common/LoginData.py”, line 50, in from_safe t = ClusterInfo.from_safe(child) File “/usr/lib/python3/dist-packages/qluman-13/common/LoginData.py”, line 197, in from_safe ip=IPv4Address(data[“ip”]), NameError: name 'IPv4Address' is not defined To fix it, I inserted from ipaddress import IPv4Address in /usr/lib/python3/dist-packages/qluman-13/common/LoginData.py

2 1

Security/Bug fix releases 13.2.3, 12.0.3.9
by no-reply-list＠qlustar.org 07 Dec '24

07 Dec '24

The Qlustar releases 13.2.3 and 12.0.3.9 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2024/1206241 https://qlustar.com/qsa/2024/1206242 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to QluMan 13.7.1 + GUI: Add missing import of zmq so new keypairs can be created + Some improvements for the repair functionality of QluMan HA

1 0

MD5 and SHA256 hashes for the QluMan 12.0.7.5 Singularity image don't match those shown in the Download page
by Beethoven Santos 30 Nov '24

30 Nov '24

Hi, Whenever I download the file `qluman-12.0.7.5-singularity.sqsh` and use the `md5sum` and `sha256sum` commands to check its MD5 and SHA256 hashes, I find that they do not match the hash values shown on the [Download page](https://qlustar.com/download/) for this version (all others are ok). For this reason, I believe that using this file is not safe and I should avoid it. Is this something on Qlustar's side? Could anyone confirm this issue? Best B. Santos

2 2

How to add GrestTypes to slum.conf?
by uchida＠ulgs.jp 28 Nov '24

28 Nov '24

Hi, Now I'm using, qlustar management interface, but GPU wizard do delete the GresTypes=gpu to GresTypes=, then it caused an error as follows, ### beosrv-c ### writing /etc/qlustar/common/slurm-llnl/slurm.conf writing /etc/qlustar/common/slurm-llnl/gres.conf writing /etc/qlustar/common/slurm-llnl/cgroup.conf postcmd: service slurmctld restart; echo ' * Waiting for slurmd to be ready...'; sleep 5; scontrol reconfigure Job for slurmctld.service failed because the control process exited with error code. See "systemctl status slurmctld.service" and "journalctl -xeu slurmctld.service" for details. * Waiting for slurmd to be ready... scontrol: error: Parse error in file /etc/qlustar/common/slurm-llnl/slurm.conf line 169: "GresTypes=" scontrol: fatal: Unable to process configuration file 1 How to fix it and how to add GressTypes? Can I set as GresTypes=gpu,mps ? Regards, Morihisa

2 1

qluman-qt can't work
by uchida＠ulgs.jp 28 Nov '24

28 Nov '24

Hi, singularity image of qluman 13.7.0 and qluman-qt can't work to access at first time. It shows, File "/usr/lib/python3/dist-packages/qluman-13/client/qt/ConnectClusterDialog.py", line 846, in on_okButton_clicked cluster = ClusterInfo(alias=self.aliasLineEdit.text(), File "/usr/lib/python3/dist-packages/qluman-13/common/LoginData.py", line 169, in __init__ (self.client_pubkey, self.client_seckey) = zmq.curve_keypair() NameError: name 'zmq' is not defined Is there any workaround? Regards,

4 10

A new approach to Cluster High-Availability
by no-reply-list＠qlustar.org 20 Nov '24

20 Nov '24

The Qlustar team is pleased to announce the first public release of QluMan HA as the new driver of the Qlustar HA stack. Implemented on top of general Qlustar functionality, QluMan HA was *specifically designed for HPC, AI and Storage cluster solutions* where a scalable number of compute and storage nodes are controlled and managed by a pair of redundant head-nodes. Read the full announcement at https://qlustar.com/news/2024/2024-11-19-qluman-ha

1 0

Security/Bug fix releases 13.2.2, 12.0.3.8
by no-reply-list＠qlustar.org 19 Oct '24

19 Oct '24

The Qlustar releases 13.2.2 and 12.0.3.8 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2024/1019241 https://qlustar.com/qsa/2024/1019242 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to QluMan 13.7.0 + GUI improvement: Save open windows for each cluster tab and reopen them when reconnecting + Catch errors parsing LDAP user data and handle users without gecos field

1 0

Problem after upgrade to latest Qlustar 13
by Rolandas Naujikas 24 Aug '24

24 Aug '24

Hi, There are problem to create jammy chroot via qluman (3.6.0) GUI. As a workaround I tried to do that from cli with manage-qlustar-chroot. The problem is with version field. In qluman I can select only 13.1 or 13.2 - both don't work. Only 13.0 from cli works. I rechecked with freshly installation from 13.2-2 iso - the same problem. At least qlustar-initial-install script creates jammy chroot successfully. Regards Rolandas

2 1

Security/Bug fix releases 13.2.1, 12.0.3.7
by no-reply-list＠qlustar.org 24 Aug '24

24 Aug '24

The Qlustar releases 13.2.1 and 12.0.3.7 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2024/0822241 https://qlustar.com/qsa/2024/0822242 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to QluMan 13.6.3 + Fix jammy chroot creation + Make argument replacement in Remote Management Configs more powerful to also support IPMI addresses in networks where OS *AND* IPMI adapters are present.

1 0

Re: qlustar-general@qlustar.org post from praveen@aukcomputing.com requires approval
by Roland Fehrenbacher 31 Jul '24

31 Jul '24

On 7/24/24 14:37, Praveen Fernando wrote: > After the re-installation, I received the server, and I completed the > one-node installation, which is also operating properly. OK, very good. > How to sync with Slurm user During creating user, I can't see the > Slurm group management in the user creation page, thus I have to > enable anything or some configuration settings. Please consult the subsection 'LDAP Sync Groups' at https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/components/slurm… > I need some additional help, like installing pbs in that cluster. > Could you please give the specifics if you have? Qlustar does not support PBS. Best, Roland

1 0

Problem, and Potential Long-Term Solution, when Replacing Nodes Related to dnsmasq.leases
by hereiam＠mit.edu 30 Jul '24

30 Jul '24

Dear Qlustar Users, I'm running what I think may be the world's worst supercomputer (for fun), composed entirely of different spec laptops. This was a pandemic project gone amok, just to see what is possible. I've used the opportunity to figure out how to do some strange things, one of which includes replacing nodes quickly and frequently on a Qlustar-based system, as laptops fail fairly often when used as HPCs. The Problem: When deleting a host from Qluman (13.6.0, and many previous versions), and trying to assign a new physical machine to the exact same hostname (an attempt at drop-in replacement), it never acquired a DHCP license. Everything looked good from Qluman's side, but the new node would never get a DHCP license to start loading/booting Qlustar. It would, however, after restarting the head node. I'd rather not do that after every drop-in replacement. The Solution: I found that each host has an entry in /var/lib/misc/dnsmasq.leases which blocks Qluman and such from truly assigning it as a new hosts. If instead I first delete that entry from dnsmasq.leases, restart the dnsmasq service by typing 'service dnsmasq restart,' and also rewrite the Slurm Config file (causing the slurmctl service to also restart), it works! The Request: Could the Qlustar mods please consider a line in the "Delete Hosts" menu option in the Enclosure Vire of Qluman's scripts, which greps dnsmasq.leases for any line with that host name and deletes it, and restarts the dnsmasq service? I think that would do the trick, but I may be mistaken. Happy to discuss more if you'd all like! Sincerely, -Mike

2 1

Need a help
by Praveen Fernando 24 Jul '24

24 Jul '24

Hi team, After installation, attempting to create the key results in the following error. can you help me qluman-cli --gencert ERROR:client.cli.network:client.cli.network.Cluster.__init__(): could not connect to server Error: No such user: 'admin' ERROR:qlunet.Channel:Channel[(b'qluman-cli', 1)].do_recv(): exception in request generator Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-13/qluman-cli.py", line 1546, in gencert db.users.lookup(field="name", val=user) File "/usr/lib/python3/dist-packages/qluman-13/common/types.py", line 2216, in lookup raise KeyError("{0}={1}".format(field, val)) KeyError: 'name=admin' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qlunet/Channel.py", line 88, in do_recv args = next(self._generator) File "/usr/lib/python3/dist-packages/qluman-13/qluman-cli.py", line 1549, in gencert sys.exit(1) SystemExit: 1 how to create the User admin ? Regards DISCLAIMER: The information contained in this email is confidential and may be legally privileged. It is intended solely for the addressee and access by anyone else is unauthorized you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to our customers, any information contained in this e-mail is subject to our standard terms and conditions. The views in this email may not necessarily reflect the views of the company.

2 2

Spack 0.22.0 problem with zlib-api
by tiagomeloalmeida＠ua.pt 22 Jul '24

22 Jul '24

Dear Qlustar Team, I apologise if this isn't the appropriate channel for such report. If there's a better place to direct this question, please let me know. I believe I've encountered a bug with the recent update of Spack in the Qlustar HPC Core Stack 24.06. After upgrading my Qlustar system (both chroot and head-node, using 'apt update' followed by 'apt upgrade'), I started receiving the following error when attempting to install packages with Spack: ==> Error: Package 'spack.pkg.builtin.zlib-api' not found. Use 'spack create' to create a new package. Did you mean one of the following packages? libkcapi grib-api libcap Upon investigation, I found a relevant change in Spack itself: https://github.com/spack/spack/commit/e51748ee8f89e0d3db4e426e3d04157129a45… This change introduces a new virtual 'zlib-api', which replaces 'zlib' in most packages to allow users to switch to zlib-ng by default for better performance. However, I noticed that the /etc/spack/defaults/package.json file was missing the definition of this virtual library. I added the line "zlib-api": ["zlib", "zlib-ng+compat"] to the file, but I'm still encountering the same error. What am I missing? How can I resolve this issue? For reproducibility purposes: - Spack version: 0.22.0 (previous version before the update 0.20) - Command I'm running: spack install r Furthermore, I believe this would affect most of the installation packages in Spack, since zlib is used in alot of them. Thank you for your assistance. Best regards, Tiago Almeida

2 4

Re: qluman-cli --gencert and qlumand-apt-trigger errors
by Gaviri, Cyrus 10 Jul '24

10 Jul '24

Hi Roland, Thanks for replying. I have attached my installsettings. Best, Cyrus

3 6

qluman-cli --gencert and qlumand-apt-trigger errors
by c.gaviri＠lancaster.ac.uk 09 Jul '24

09 Jul '24

Hi, I'm trying to do a fresh install using 13.2-1 (Ubuntu) and noticed this error during the initial config; qlumand-apt-trigger: timeout the instal then finishes but when I try qluman-cli --gencert --debug All I get is; Error: Could not connect to server. I found in the logs it suggested slurmd was not running, but even after manually starting qluman-slurmd it gives the same error. Any ideas/suggestions? Thanks, Cyrus

2 1

Security/Bug fix release 13.2.0.0
by no-reply-list＠qlustar.org 01 Jul '24

01 Jul '24

The Qlustar release 13.2.0.0 is ready including a fix for the recently discovered ssh RegreSSHion bug. Please check the following web page for more details: https://qlustar.com/qsa/2024/0701241

1 0

Qlustar HPC Core Stack 24.06
by no-reply-list＠qlustar.org 29 Jun '24

29 Jun '24

The Qlustar team is pleased to announce the availability of the HPC Core Stack 24.06 for Qlustar 13. It was published together with the latest security bug fix update and can be installed by updating the Qlustar 13 chroots on the cluster. The HPC CORE STACK [1] was introduced with the release of Qlustar 13 as a new component definition within Qlustar. It is related to the introduction of Spack. This release includes the following individual major HPC core stack component updates: - Spack version 0.22.0 [2] - Slurm version 23.11.8 [3] - RDMA-Core version 52.0 [4] - HWloc version 2.10.0 [5] - UCX version 1.17.0 [6] The new version of Spack allows easy and direct access to the most recent compilers, MPIs and hundreds of other applications relevant to HPC. Note that the default OpenMPI version is now 5.0.3, a new major version. The latest 4.1.x versions were also tested to still build cleanly with this new Qlustar release. As part of this update, Qlustar AlmaLinux was moved to the 8.10 version which is now the only release supported by upstream. Minor version updates for other Qlustar 13 components are also included, in particular Lustre (2.15.5) and gdrcopy (2.4.1) for use with Nvidia GPUs. [1] https://qlustar.com/about-qlustar/hpc-core-stack [2] https://spack.readthedocs.io/en/latest/ [3] https://www.schedmd.com/slurm/ [4] https://github.com/linux-rdma/rdma-core [5] https://www.open-mpi.org/projects/hwloc/ [6] https://openucx.org/

1 0

Security/Bug fix releases 13.2.0, 12.0.3.6
by no-reply-list＠qlustar.org 29 Jun '24

29 Jun '24

The Qlustar releases 13.2.0 and 12.0.3.6 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2024/0629241 https://qlustar.com/qsa/2024/0629242 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Qlustar HPC Core Stack 06/24 update (details to be announced separately) - Update to QluMan 13.6.0 + Make qluman-qt work without qlumand to support HA GUI support at any time + Add --power options to qluman-cli + Fix file descriptor leak in qluman-execd + Add right to write NameService config for roles with LDAP User/Group rights + Store QluMan user login certs in a new file to account for incompatible format changes. Path: ~/.config/Qluman/cluster.safe.v2 + qluman-cli: add --create flag for --gencert to generate a one-time login certificate for a new user - Update to AlmaLinux 8.10

1 0

Security/Bug fix releases 13.1.6, 12.0.3.5
by no-reply-list＠qlustar.org 23 Apr '24

23 Apr '24

The Qlustar releases 13.1.6 and 12.0.3.5 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2024/0422241 https://qlustar.com/qsa/2024/0422242 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13: - Update to QluMan 13.5.9

1 0

Security/Bug fix releases 13.1.5, 12.0.3.4
by no-reply-list＠qlustar.org 13 Mar '24

13 Mar '24

The Qlustar releases 13.1.5 and 12.0.3.4 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2024/0313241 https://qlustar.com/qsa/2024/0313242 https://qlustar.com/qsa/2024/0313243 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13: - Update to QluMan 13.5.5 - Update to Nvidia graphics drivers 550.54.14 - Fix disk-auto-setup for mdRAID/LVM configurations - Fix install of qluman-qt on head-nodes

1 0

qluman-qt dependencies problem
by Hernan Olivera 09 Mar '24

09 Mar '24

Hi I'm trying a fresh install of version 13. When apt install qluman-qt: The following packages have unmet dependencies: qluman-qt-13 : depends: qluman-common-13 (= 13.5.1+13-jammy) but 13.5.3+13-jammy is to be installed E: unabe to correct problems, you have held broken packages. Ideas? thanks -- Hernan Olivera

2 4

Exception trying to save updated Info field for user in LDAP (Qluman/server 13.4.7)
by Rolandas Naujikas 29 Feb '24

29 Feb '24

Exception handling request Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-13/server/admin.py", line 2967, in on_request yield from handler(self, channel, msg) File "/usr/lib/python3/dist-packages/qluman-13/server/admin.py", line 1759, in request_DBUpdateRequest table.update(entries) File "/usr/lib/python3/dist-packages/qluman-13/server/db/Ldap.py", line 106, in update entries = self._do_update(entries) File "/usr/lib/python3/dist-packages/qluman-13/server/db/Ldap.py", line 443, in _do_update self.manage.ol_user_modify(entry.uname, entry) File "/usr/lib/python3/dist-packages/qluman-13/components/ldap/manage.py", line 741, in ol_user_modify attr = USER_DB_TO_LDAP_FIELD_NAME[field] KeyError: 'locked'

3 4

Re: Qluman GUI 13.4.7 / 13.5.1 / 13.5.2 connection issues
by Roland Fehrenbacher 26 Feb '24

26 Feb '24

On 2/26/24 08:23, Nicolai, Wouter wrote: > Yes, using 13.5.3 I`m able to connect to the cluster directly. > Thanks for resolving this issue. OK, very good. > For your information, I do get the following logging with an error: > > Qt: Session management error: None of the authentication protocols specified are supported > 2024-02-26 08:14:45,105 ERROR qlunet.Node Node[b'admin@clustername']: ZMQ error on reconnect, trying again in 10s > Traceback (most recent call last): > File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 1054, in slave_reset_keys > raise last_err > File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 1044, in slave_reset_keys > self._monitor = self._socket.get_monitor_socket() > File "/usr/lib/python3/dist-packages/zmq/sugar/socket.py", line 1008, in get_monitor_socket > self.monitor(addr, events) > File "zmq/backend/cython/socket.pyx", line 697, in zmq.backend.cython.socket.Socket.monitor > File "zmq/backend/cython/checkrc.pxd", line 28, in zmq.backend.cython.checkrc._check_rc > zmq.error.ZMQError: Address already in use This is a long-standing issue with the ZMQ library. Fortunately it is harmless, only leads to a connection delay in rare situations (e.g. when a user connects for the first time). Nevertheless, we'll make a new attempt to fix this.

1 0

Qluman GUI 13.4.7 / 13.5.1 / 13.5.2 connection issues
by Nicolai, Wouter 23 Feb '24

23 Feb '24

Hi all, When I try to connect to our head node using qluman I'm getting the following error while using using "ssh -X root@servername qluman-qt" to connect: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-13/qluman-qt.py", line 74, in <module> main() File "/usr/lib/python3/dist-packages/qluman-13/qluman-qt.py", line 70, in main w = MainWindow.make(background=not args.nobackground, app=app) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/MainWindow.py", line 204, in make w.conf(cluster_model=model, background=background, app=app) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/MainWindow.py", line 213, in conf self.restoreState() File "/usr/lib/python3/dist-packages/qluman-13/client/qt/MainWindow.py", line 320, in restoreState state = QtCore.Qt.WindowState(int(state)) TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType' Also tried to connect using apptainer with qluman-13.5.2-singularity.sqsh (or qluman-13.4.7-singularity.sqsh) and receive something similar: QStandardPaths: error creating runtime directory '/run/user/1000' (Read-only file system) QStandardPaths: error creating runtime directory '/run/user/1000' (Read-only file system) Qt: Session management error: None of the authentication protocols specified are supported Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-13/qluman-qt.py", line 74, in <module> main() File "/usr/lib/python3/dist-packages/qluman-13/qluman-qt.py", line 70, in main w = MainWindow.make(background=not args.nobackground, app=app) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/MainWindow.py", line 204, in make w.conf(cluster_model=model, background=background, app=app) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/MainWindow.py", line 213, in conf self.restoreState() File "/usr/lib/python3/dist-packages/qluman-13/client/qt/MainWindow.py", line 320, in restoreState state = QtCore.Qt.WindowState(int(state)) TypeError: int() argument must be a string, a bytes-like object or a real number, not 'NoneType' Qlustar server version is 13.5.1 (fresh install of last month). We also have an old headnode running qluman 13.2.1. I am able to connect to the new head node after connecting to the qluman server of our old headnode (running qluman server 13.2.1) using "ssh -X root@OLDservername qluman-qt" and connecting the new headnode using the Qluman GUI. While this is a nice workaround, I would like to decommission the old headnode in the near future. Am I doing something wrong while trying to connect directly to our new head node using either ssh -X or apptainer? Head node is fully up to date, ran "apt- update" & "apt dist-upgrade" Thanks, Wouter

2 2

Security/Bug fix releases 13.1.4, 12.0.3.3
by no-reply-list＠qlustar.org 30 Jan '24

30 Jan '24

The Qlustar releases 13.1.4 and 12.0.3.3 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2024/0130241 https://qlustar.com/qsa/2024/0130242 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13: - Update to QluMan 13.5.0 - Update to Lustre 2.15.4 - Update to Nvidia graphics drivers 535.154.05 - Switch to use pam_slurm_adopt for restricting ssh access to slurm nodes

1 0

Infiniband - headnode does not have ib0 interface / ip adress on infiniband interface
by wo.nicolai＠vuykrotterdam.com 30 Jan '24

30 Jan '24

Hi all, I've started with a new cluster using Qlustar 13.1 (fresh install). Hardware setup contains (currently) 3 HP DL380 machines, all hardware boxes have an infiniband interface and are connected to the same infiniband switch. 1 headnode (with openSM during installation), FE-login as VM, 2 compute nodes. I noticed that the on the head node the infiniband interface is down. Upon investigating I discovered the following: In the qlustar management interface, the network config for the headnode shows ib0 in the commandline interface on the headnode using "ip address" I do not see any ib0 interface. I do see ibo49d1 (o not zero) "9: ibo49d1: <BROADCAST,MULTICAST> mtu 2044 qdisc fq_codel state DOWN group default qlen 256 link/infiniband 80:00:02:25:fe:80:00:00:00:00:00:00:04:09:73:ff:ff:e4:f4:22 brd 00:ff:ff:ff:ff:12:40:1b:ff:ff:00:00:00:00:00:00:ff:ff:ff:ff altname ibp4s0d1" in /etc/network/interfaces interface ib0 is mentioned When I update the network config for the headnode in the qlustar management interface from ib0 to ibo49d1 and reboot after, the interface remains down without any ip address. I also noticed that for such a change in the qlustar management interface, I do not need to write files? in /etc/network/interface ib0 remains mentioned, while I expected that this would be updated to ibo49d1. Manually changing ib0 into ibo49d1 in /etc/network/interfaces did not work either. The infiniband port is active: ibv_devinfo -d mlx4_0 hca_id: mlx4_0 transport: InfiniBand (0) fw_ver: 2.42.5700 node_guid: 0409:73ff:ffe4:f420 sys_image_guid: 0409:73ff:ffe4:f423 vendor_id: 0x02c9 vendor_part_id: 4103 hw_ver: 0x0 board_id: HP_1380110017 phys_port_cnt: 2 port: 1 state: PORT_DOWN (1) max_mtu: 4096 (5) active_mtu: 1024 (3) sm_lid: 0 port_lid: 0 port_lmc: 0x00 link_layer: Ethernet port: 2 state: PORT_ACTIVE (4) max_mtu: 4096 (5) active_mtu: 4096 (5) sm_lid: 1 port_lid: 1 port_lmc: 0x00 link_layer: InfiniBand Using ibnetdiscover on the headnode, both compute nodes and the switch is listed. Obviously I'm missing something. How do I get IPoIB up and running on the headnode? The above is for the head node only. the compute nodes do have an interface ib0 and an ip adress for this interface.

3 3

node install II (forget the previous one)
by Christophe Guilbert 08 Jan '24

08 Jan '24

Scratch my previous email since I moved forward. Here my new problem. I managed to create beo-206 , I can see it in "Enclosure View" Than I select it in "Enclosure View" and open "Manage Hosts" -> "Hardware Wizard" -> "Selected" I have the following message: "Missing Hardware info: beo-206" I created specific "host template", "hardware property set" for that node (2 x 12 core, 2 thread per core), I tried all kind of properties combinations. no luck , the same message of missing hardware is coming back. I did took example on beosrv-c and set up the properties as following: "beo-206" -> "Select host template" -> "<None>" "beo-206" -> "Set Config" -> "Network Config" -> "Standard-Node" it does not work either. same error. On the node side , PXE is looping trying to get a DHCP address. rebooting the node did not changed the outcome. What I am missing here, how to complete the "Hardware Wizard" ? I tried all kind of properties for beo-206, which ones would you recommend me to try ? Thanks Chris

2 1

node install
by Christophe Guilbert 03 Jan '24

03 Jan '24

Hi guys and happy new year. I am trying to move forward with my first node install So far, my node was set to beo-206, I can see it in Enclosure View and host overview. I am now stuck , What next ? Was trying to play with "hardware Wizard" but beo-206 is not even listed there. Was playing with "manage sets" , create a new "Host Templates" but could not find any logical way to complete the node configuration BTW what is SM twin^2 1GB ? My node is 2 x 24 cores, how do I create a template ? how Do i automatically set up the hardware type for slurm or any template, how to create an image ? .... I would assume that my next step would be to list and register the node with the correct hardware, how to do that ? I would like to create a template for this node as I have about 20 of the same time. Need help , thanks Chris

1 0

Security/Bug fix releases 13.1.3, 12.0.3.2
by no-reply-list＠qlustar.org 15 Dec '23

15 Dec '23

The Qlustar releases 13.1.3 and 12.0.3.2 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/1215231 https://qlustar.com/qsa/2023/1215232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0: - Update to QluMan 13.4.7 - Update to Slurm 23.02.7

1 0

Security/Bug fix releases 13.1.2, 12.0.3.1
by no-reply-list＠qlustar.org 11 Dec '23

11 Dec '23

The Qlustar releases 13.1.2 and 12.0.3.1 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/1209231 https://qlustar.com/qsa/2023/1209232 https://qlustar.com/qsa/2023/1209233 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0: - Update to QluMan 13.4.6 - Update to Slurm 23.0.6 For Qlustar 13 only: - Update to AlmaLinux 8.9 - Update to ZFS 2.1.14 (fixes a critical bug preventing data corruption) - Update to Nvidia graphics drivers 535.113.01 - Add support for current openfoam (.com and .org) versions in spack

1 0

host add example
by Christophe Guilbert 06 Dec '23

06 Dec '23

Hi, I was wondering if anyone wrote an easy step by step tutorial to add nodes from start to finish , from booting PXE node to the integration of this node in slurm. The documentation is very dense and I am not sure about the sequence of events Booting the nodes with PXE and catching the MAC/IP is obvious but what next is not (to me at least), how to create a node template which will be use to create an image and slurm entry? . I know that all those points are discuss in the doc but its hard to glue them together. The tutorial does not have to be big , just pointing the sequence of events and menus used so we have something to start with before getting into more details and fancy . ;) Thanks for any tips Chris

2 1

qluster new user question
by Joseph John 21 Nov '23

21 Nov '23

Dear All, Good afternoon I am Joseph John, I would like to try out Qluster for HPC setup, what I have is 4 old powerfull machines, each one with 250 GB OS disk 14 TB disk extra space and 48 CPUs , 250 GB disk space Now I am planning to make use of each 14 TB disk space together using glusterfs and each machine will boot from its own hard disk (250 GB) I have My doubt is is it necessary in qluster that, we boot from PXE for nodes , can I configure the nodes using the local available harddisk other than PXE boot Like to request for the URL of the documentation on how to setup the QLustar without using PXE boot Thanks Joseph John

2 1

installation problems
by Christophe Guilbert 16 Nov '23

16 Nov '23

Hi , I am completely new with qlustar. I would need some help to start having the cluster running as I don't really understand the doc. I did install qlustar (4 times) with no problem , Since I did not find out how to run the virtual FE node (and the demo mode VM by the way ). The last install was without create a virtual FE node. Following the section "1.5.5. Spack Package Manager" , it assume that I installed the FE node which I did not . There' s no alternative. I tried in vain to switch from root to user softadm in the main terminal , the user softadm is not even in the /etc/passwd. Under root I try my luck with the spack command leading to : spack compiler find -bash: spack: command not found How to do the spack section without creating the virtual FE node ? Also I don't mind reinstalling qlustar with the FE VM node but I would appreciate how to run it. Now here is my second question , how to run the demo VM ? Here is my frustration sequences of event in case someone want to rewrite that part of the doc ;-) demo-system -a start Starting VMs in a tmux session ... Created tmux session demo-system. => Attach with 'console-demo-vms' So far so good so I ran console-demo-vms Something happened and got a nice command line in the bottom of the terminal, but it looks like I am still on the front end , not in the demo VM , not only the prompt shows the front end hostname but htop command shows the whole ram of 32GB and CPU #, according to |/etc/qlustar/vm-configs/demo.conf| |it should be : | CN_MEM=1285 HA_MEM=1024 I am really confuse now, console-demo-vms did not show the demo VM , Any reason , what am I doing wrong here ? Now from the head node under root : 0 root@jcluster ~ # dsh -a uptime beo-201: ssh: connect to host beo-201 port 22: No route to host beo-202: ssh: connect to host beo-202 port 22: No route to host beo-203: ssh: connect to host beo-203 port 22: No route to host beo-204: ssh: connect to host beo-204 port 22: No route to host beo-201 are supposed to be the demo VMs, I have many more questions but that's it for now but planing forward, I did managed to run QluMan_gui, I played over night (until 5am) trying to add a working user and add a node . etc .. The doc for me for unusable, there's no tutorial online I could find (other than the first install which is very simple). I would be really appreciate if someone could describe the full procedure to add a node from catching the MAC address of the new node, building an image for that guy and include it in slurm. something to start with . Thanks for your help . I really would love to have qclusar working ASAP for my very urgent project research involving GPU Thanks Chris

2 8

about qlustar installation problems
by 李腾腾 17 Oct '23

17 Oct '23

hi I'm trying to install qlustar, but I'm running into several problems. 1. Can I allocate disk partitions myself? The default partitioning is not suitable for us. 2. How should I start or query FE node? I don’t know how to operate it when deploying "Spack Package Manager". Also, if I don’t need FE node, what will be the impact? Regards tli(a)singleparticle.cn

2 1

回复: about qlustar installation problems
by 李腾腾 17 Oct '23

17 Oct '23

Hi When I try to connect to QluMan, it prompts that I need to create a user and token, but I can't find how to create a user. Which command should I use to create a user? tli(a)singleparticle.cn 发件人：李腾腾发送时间： 2023-10-16 17:15 收件人： qlustar-general 主题： about qlustar installation problems hi I'm trying to install qlustar, but I'm running into several problems. 1. Can I allocate disk partitions myself? The default partitioning is not suitable for us. 2. How should I start or query FE node? I don’t know how to operate it when deploying "Spack Package Manager". Also, if I don’t need FE node, what will be the impact? Regards tli(a)singleparticle.cn

2 1

Security/Bug fix release 13.1.1
by no-reply-list＠qlustar.org 05 Oct '23

05 Oct '23

The Qlustar release 13.1.1 is ready including a fix for the recently discovered Looney Tunables bug. Please check the following web page for more details: https://qlustar.com/qsa/2023/1005231

1 0

Qlustar HPC Core Stack 23.09
by no-reply-list＠qlustar.org 04 Oct '23

04 Oct '23

The Qlustar team is pleased to announce the availability of the HPC Core Stack 23.09 for Qlustar 13. It was published together with the latest security bug fix update and can be installed by updating the Qlustar 13 chroots on the cluster, The HPC CORE STACK [1] was introduced with the release of Qlustar 13 as a new component definition within Qlustar. It is related to the introduction of Spack. This release includes the following individual major HPC core stack component updates: - Spack version 0.20.1 [2] - Slurm version 23.02.5 [3] - RDMA-Core version 47.0 [4] - HWloc version 2.9.3 [5] - UCX version 1.14.1 [6] The new version of Spack allows easy and direct access to the most recent compilers, MPIs and hundreds of other applications relevant to HPC. Minor version updates for other Qlustar 13 components are also included, in particular Lustre (2.15.3), ZFS (2.1.12) and the Nvidia graphics driver (535.104.05). [1] https://qlustar.com/about-qlustar/hpc-core-stack [2] https://spack.readthedocs.io/en/latest/ [3] https://www.schedmd.com//overview.html [4] https://github.com/linux-rdma/rdma-core [5] https://www.open-mpi.org/projects/hwloc/ [6] https://openucx.org/

1 0

Security/Bug fix releases 13.1.0, 12.0.3.0
by Roland Fehrenbacher 02 Oct '23

02 Oct '23

The Qlustar releases 13.1.0 and 12.0.3.0 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0929231 https://qlustar.com/qsa/2023/0929232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0: - Update to QluMan 13.3.3 For Qlustar 13 only: - Add a new containers image module (details to be announced separately) - Qlustar HPC Core Stack 09/23 update (details to be announced separately)

1 0

Security/Bug fix releases 13.0.6, 12.0.2.6
by no-reply-list＠qlustar.org 26 Jul '23

26 Jul '23

The Qlustar releases 13.0.6 and 12.0.2.6 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0726231 https://qlustar.com/qsa/2023/0726232 On the Qlustar Ubuntu platforms, this update includes a kernel mitigation for the Zenbleed security bug found on Zen2 AMD CPUs. Please note that no such fix is available on RHEL 7/8 compatible platforms (CentOS 7 / AlmaLinux 8 on Qlustar) at this stage.

1 0

slurmctld for Qlustar 10.1.1
by Lorenz Dettmann 06 Jul '23

06 Jul '23

Dear Sir or Madam, I am writing this E-Mail to you, because I am searching for a specific .deb package for slurmctld, which should run on a Qlustar OS version 10.1.1. After executing 'apt install slurmctld', I get the following error message: Err:1 http://repo.qlustar.com/repo/ubuntu 10.1-xenial/main amd64 slurmctld amd64 17.11.9.2-ql.3+10-xenial 404 Not Found E: Failed to fetch http://repo.qlustar.com/repo/ubuntu/pool/main/s/slurm-llnl/slurmctld_17.11.… 404 Not Found E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing? Indeed, this package for slurmctld with this specific version is not in this repository anymore. Is there any chance of getting it from somewhere else? Many thanks in advance. Best regards Lorenz Dettmann -- Lorenz Dettmann Institute of Physics University of Rostock Albert-Einstein-Straße 23 D-18059 Rostock Tel.: +49 381/498-6954 E-Mail:lorenz.dettmann@uni-rostock.de

2 1

Qluman Network Configuration
by Lorenz Dettmann 03 Jul '23

03 Jul '23

Dear Sir or Madam, I am writing this E-Mail to you, because I have problems with managing the Network Configs via QluMan. When clicking on the button [ New ], nothing happens and the following error occurs in the console: 2023-06-30 10:52:58,048 ERROR qlunet.Node Channel[('zmq_version_info', 16)].do_recv(): exception in request generator Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 143, in do_recv args = next(self._generator) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/Networking/NetworkConfigsWidget.py", line 437, in new_NetConfigName dlg = NameDialog.make(title=title, label=label, table=self.cluster.db.net_config_names) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/Dialogs/NameDialog.py", line 32, in make w.conf(title=title, label=label, text=text, table=table, validator=validator) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/Dialogs/NameDialog.py", line 53, in conf table.si_deleted.connect(self.validate) AttributeError: 'DBTableType' object has no attribute 'si_deleted' The Qlustar version is 13.0.0 and the QluMan version is 13.2.0. Could you please help me with this issue? Best regards Lorenz Dettmann -- Lorenz Dettmann Institute of Physics University of Rostock Albert-Einstein-Straße 23 D-18059 Rostock Tel.: +49 381/498-6954 E-Mail:lorenz.dettmann@uni-rostock.de

2 1

Security/Bug fix releases 13.0.5, 12.0.2.5
by no-reply-list＠qlustar.org 01 Jul '23

01 Jul '23

The Qlustar releases 13.0.5 and 12.0.2.5 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0629231 https://qlustar.com/qsa/2023/0629232 https://qlustar.com/qsa/2023/0629233 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0: - Update to QluMan 13.2.1 - Fix a file descriptor leak affecting qluman-execd - Add libnvidia-container to the NVIDIA image module

1 0

End-of-Life for Qlustar 11
by no-reply-list＠qlustar.org 27 Jun '23

27 Jun '23

This is to inform you that with the latest security release, Qlustar 11 has reached its end-of-life and will receive no further updates of any kind. Please update your clusters to Qlustar 13 and be aware that you will have to move first to Qlustar 12 and then do the update to Qlustar 13. This is the only supported upgrade path. Good luck!

1 0

Qlustar Feature Update 06/23
by no-reply-list＠qlustar.org 15 Jun '23

15 Jun '23

A number of new Qlustar features were completed recently and published together with the latest security updates. Version 13.2.0 further improves QluMan with the addition of: - An informative HOST OVERVIEW TABLE [1]. It provides a tabular overview of all the hosts in a cluster split by networks. Tabs at the top allow to select the network one is interested in. In each tab, the IP ranges allocated in the chosen network are shown at the top and a list of hosts with their most important config parameters below. An on-the-fly string/regex filter can be applied to the lists restricting the view to the hosts matched. - New GUI options to fine-tune the LDAP PASSWORD POLICY [2]. This makes it easy to control user password quality and protection against brute-force attacks with appropriate settings. - The possibility to ASSIGN A LUSTRE LNET NAME [3] to the network adapters of nodes and generate a new config file to bring up LNet during boot of Lustre nodes. - The automatic creation of a new configuration file during boot that lists a node's QluMan Generic Properties and their values. This allows to use freely definable Generic Properties as a general key/value store in customization scripts on Qlustar nodes. AlmaLinux was updated to version 8.8 with this release. [1] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Adding-Hosts.htm… [2] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/components/ldap.… [3] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Cluster-Network-…

1 0

Security/Bug fix releases 13.0.4, 12.0.2.4, 11.0.1.23
by no-reply-list＠qlustar.org 14 Jun '23

14 Jun '23

The Qlustar releases 13.0.4, 12.0.2.4 and 11.0.1.23 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0614231 https://qlustar.com/qsa/2023/0614232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0 only: - Update to QluMan 13.2.0 For Qlustar 13 only: - Update to AlmaLinux 8.8

1 0

Security/Bug fix releases 13.0.3, 12.0.2.3, 11.0.1.22
by Qlustar List 24 Apr '23

24 Apr '23

The Qlustar releases 13.0.3, 12.0.2.3 and 11.0.1.22 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0424231 https://qlustar.com/qsa/2023/0424232 https://qlustar.com/qsa/2023/0424233

1 0

Re: Password sync for ldap users.
by Beethoven Santos 03 Apr '23

03 Apr '23

This is also happening to me from time to time. But in my case, I added users through Qluman, as described in the docs. These are the last lines of the /var/log/auth.log file on the FE node, right after the login attempt. ... > sshd[9118]: pam_unix(sshd:auth): authentication failure; logname= uid=0 > euid=0 tty=ssh ruser= rhost=10.0.2.159 user=********* > sshd[9118]: pam_sss(sshd:auth): authentication failure; logname= uid=0 > euid=0 tty=ssh ruser= rhost=10.0.2.159 user=********* > sshd[9118]: pam_sss(sshd:auth): received for user *********: 7 > (Authentication failure) > sshd[9118]: Failed password for ********* from 10.0.2.159 port 40398 ssh2 I've omitted the username and the timestamps and hostname columns from the lines above. Does anyone have any clue what might be going on? Do I need to show anything else? --- Qlustar Version: *12* Head-Node Kernel Version: *5.13.19-051319-generic* QluMan Server Version: *12.0.7.5* Image (FE) Kernel Version: *5.4.209-ql-generic-12.0-19* Image (FE) Version: *Qlustar 12.0.1.0-b548f1441*

2 1

Qlustar Feature Update 03/23
by Qlustar List 29 Mar '23

29 Mar '23

A number of new Qlustar features were completed recently and published together with the latest security updates. QluMan 13.1.0 highly improves on its Host Filter capabilities: - NEW FILTERS [1] for Property/Config sets, Property/Config types and Property/Config values have been added. These filters make it much easier to select correct groups of hosts for re-configurations or command execution especially on large in-homogeneous clusters. - COMMAND EXECUTION OR HOST SELECTION [2] using filters temporarily defined on-the-fly is now possible directly from the Host Filter dialog. This helps a lot in quickly checking on a group of nodes based on any configuration criteria. The Qlustar documentation has been expanded: - An HPC ADMIN MANUAL [3] has been added. It explains the recently introduced Qlustar HPC Core Stack and gives a detailed introduction to package management using SPACK [4]. - A section about WORKING WITH SPACK [5] has been added to the HPC USER MANUAL [6]. [1] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Host-Filters.htm… [2] http://docs-dev.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Host-Filters.… [3] https://docs.qlustar.com/Qlustar/13/HPCstack/hpc-admin-manual.html [4] https://spack.readthedocs.io/en/latest/ [5] https://docs.qlustar.com/Qlustar/13/HPCstack/hpc-user-manual.html#chap-hpc-… [6] https://docs.qlustar.com/Qlustar/13/HPCstack/hpc-user-manual.html

1 0

Security/Bug fix releases 13.0.2, 12.0.2.2, 11.0.1.21
by Qlustar List 27 Mar '23

27 Mar '23

The Qlustar releases 13.0.2, 12.0.2.2 and 11.0.1.21 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0325231 https://qlustar.com/qsa/2023/0325232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to MLNX OFED 5.8-2.0.3.0 For Qlustar 13 and 12.0 only: - Update to QluMan 13.1.0 - Update Nvidia drivers to 525.89.02

1 0

Security/Bug fix releases 13.0.1, 12.0.2.1, 11.0.1.20
by Qlustar List 18 Feb '23

18 Feb '23

The Qlustar releases 13.0.1, 12.0.2.1 and 11.0.1.20 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0216231 https://qlustar.com/qsa/2023/0216232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to MLNX OFED 5.8-1.1.2.1 For Qlustar 13 and 12.0 only: - Update to QluMan 13.0.4 - Update to Lustre 2.15.2 - Update to ZFS 2.1.9

1 0

One more present from Santa - Qlustar 13
by Qlustar List 29 Dec '22

29 Dec '22

The Qlustar team is pleased to announce the immediate availability of Qlustar 13 for download [1]. It updates Qlustar's core platform to current Ubuntu 22.04 LTS. The AlmaLinux [2] edge platform remains based on 8.6 while CentOS 7 [3] is still supported via Qlustar 12 images and the new cross-version compatibility. The highlights of this release are the addition of BMC hardware management via IPMI/Redfish in QluMan, the integration of Spack as the new HPC package manager and the cross-version compatibility between Qlustar releases. QluMan's new *BMC hardware management* support allows for BMC authentification management, power control of nodes via IPMI or Redfish, the display of BIOS settings as well as their validation and correction. A cumulative problem report showing an overview of cluster node misconfigurations has also been added to QluMan. Spack [4] has been introduced as the new package manager for HPC related application software beyond the so-called *Qlustar HPC core stack*. It offers a huge list of supported software packages and by design provides hardware optimized versions of them. The HPC core stack is a new component definition within Qlustar and is related to the introduction of Spack. Rather than aiming to provide as much HPC functionality as possible by OS packages (debs/rpms), the HPC core stack now makes a clear cut between Qlustar related system software which remains provided as OS packages and HPC application software. Starting with this release, *cross-version compatibility* between the current and the previous Qlustar release has been added. In practice this means, that on a cluster with a Qlustar 13 head-node you can still run nodes with Qlustar 12 images/chroots and vice versa. This new feature was added to allow even smoother release upgrades. Highlights among the various *major component updates* include Kernel 5.15.x, Slurm 22.05.x, Lustre 2.15.1, ZFS 2.1.6 and BeeGFS 7.3.2. Please read the release notes [5] for more details. [1] https://qlustar.com/download/ [2] https://almalinux.org/ [3] https://www.centos.org/ [4] https://spack.readthedocs.io/en/latest/ [5] https://docs.qlustar.com/Qlustar/13/ClusterOS/release-notes.html

1 0

Is it possible to add modules to qlustar linux kernel?
by pierre-yves.boelle＠upmc.fr 20 Dec '22

20 Dec '22

Hi all, I'm trying to set up Qlustar 12.0 with ubuntu focal on a HP machine equiped with a smart array controller P816i-a. The problem is that the smart array is not recognized after install: I can see it with lspci, but the disks are not listed in /dev. As far as I understand, this is a driver issue : the smartpqi module is required for this smart array. This module is available from "linux-modules-extra" in ubuntu focal 20.04, but this package is not part of the qlustar distribution. So questions : 1 - Is there a way I can simply add a required module (for example .ko file) in the qlustar kernel and simply recompile the qlustar kernel? 2 - failing that, should I expect trouble running qlustar with a "pure ubuntu" kernel ? If I add the focal repository in apt sources and install linux-modules-extra, I can build a new kernel OK, but it is "pure ubuntu" - not qlustar. Is qlustar kernel just a light version of the ubuntu kernel and that's ok? or does qlustar include extra components ? Any input appreciated PYB

2 4

Security/Bug fix releases 12.0.2.0-b556f1460/11.0.1.19-b549f1462
by Qlustar List 20 Dec '22

20 Dec '22

The Qlustar releases 12.0.2.0-b556f1460 and 11.0.1.19-b549f1462 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/1219221 https://qlustar.com/qsa/2022/1219222 The following non-security related updates/enhancements/bug fixes are included: For 12.0 only: - Update to QluMan 13.0.2 (check the upcoming Qlustar 13 release notes for a description of new features) - Update Nvidia drivers to 515.86.01 - Update to pmix 4.1.2 - Update to slurm 22.05.6 - Update to ucx 1.13.0 - Update to ZFS 2.1.6

1 0

apt, lost in a maze after recent update.
by Gerhard W. Recher 21 Nov '22

21 Nov '22

Hi Qlustar fellows! I recently installed update to qlustar 12, but got a problem with nvidia stuff.... i have no idea how to clean up this mess... help is apprechiated ! apt-get dist-upgrade Reading package lists... Done Building dependency tree Reading state information... Done You might want to run 'apt --fix-broken install' to correct these. The following packages have unmet dependencies: libucx0 : Depends: libcudart11 (>= 11.7.1-ql.1) but it is not installed E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution). 100 root@biocrunch2 ~ # apt --fix-broken install Reading package lists... Done Building dependency tree Reading state information... Done Correcting dependencies... Done The following packages were automatically installed and are no longer required: libcudart11.0 linux-image-5.4.134-ql-generic-12.0-10 zfs-modules-5.4.134-ql-generic-12.0-10 Use 'apt autoremove' to remove them. The following additional packages will be installed: libcudart11 The following NEW packages will be installed: libcudart11 0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded. 103 not fully installed or removed. Need to get 0 B/168 kB of archives. After this operation, 800 kB of additional disk space will be used. Do you want to continue? [Y/n] y (Reading database ... 95268 files and directories currently installed.) Preparing to unpack .../libcudart11_11.7.1-ql.1+12-focal_amd64.deb ... Unpacking libcudart11:amd64 (11.7.1-ql.1+12-focal) ... dpkg: error processing archive /var/cache/apt/archives/libcudart11_11.7.1-ql.1+12-focal_amd64.deb (--unpack): trying to overwrite '/usr/lib/x86_64-linux-gnu/libcudart.so.11.0', which is also in package libcudart11.0:amd64 11.0.3-ql.4+12-focal Errors were encountered while processing: /var/cache/apt/archives/libcudart11_11.7.1-ql.1+12-focal_amd64.deb E: Sub-process /usr/bin/dpkg returned an error code (1) -- Gerhard W. Recher net4sec UG (haftungsbeschränkt) Leitenweg 6 86929 Penzing +49 8191 4283888 +49 171 4802507

3 2

Modifyint timesyncd.conf
by garroyo＠ifimar-conicet.gob.ar 09 Nov '22

09 Nov '22

Hi! I tried to edit /etc/systemd/timesyncd.conf to add fallbackntp but always changes to the default file that only has one line for one server I tried to edit the files in nodes by using the command to edit images: qlustar-image-edit -e Standard-focal /etc/systemd/timesyncd.conf I tried also with chroot-focal Maybe someone could know how to do it, thanks!

1 0

Security/Bug fix releases 12.0.1.1-b548f1445 / 11.0.1.18-b549f1444
by Qlustar List 29 Oct '22

29 Oct '22

The Qlustar releases 12.0.1.1-b548f1445 and 11.0.1.18-b549f1444 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/1029221 https://qlustar.com/qsa/2022/1029222

1 0

Install Gaussian 16
by yohann.clement＠univ-lyon1.fr 19 Oct '22

19 Oct '22

Hello, I'm trying to install Gaussain 16 on Qlustar. I have some troubles to install it due to some right management. Indeed, Gaussian does not allow the directory on which it is installed to be accessible to others. The director should only be accessible to the owner and a group. I have created a group called gauss with Qluman in which I have added a user for a test. But the created group is not recognized in Chroot-focal. Could you tell me if you alreeady have installed G16 in Qlustar. If so could you kindly send me the procedure. Best,

2 3

Qlustar 12 and openmpi 4.0
by rolandas.naujikas＠mif.vu.lt 03 Oct '22

03 Oct '22

Hi, In my cluster I found problems running some MPI applications (for e.g. via mpi4py) and it is related to defaults in /etc/openmpi/4.0/openmpi-mca-params.conf. When I changed btl to ^openib or to vader,selft,tcp (in case tcp nodes) - it started to work, but in this case it doesn't use UCX anymore. Regards Rolandas

1 0

centos8/AlmaLinux chroot has no repos
by deroshia＠uga.edu 19 Aug '22

19 Aug '22

Hi All, Either with a fresh install of the latest Qlustar or when creating a centos8 chroot in Qluman (or with manage-qlustar-chroot), I see the following errors and no /etc/yum.repos.d directory is created: [Harmless] Failed to find download link for qlustar-12.0-base [Harmless] Failed to find download link for qlustar-12.0-repos Running post-install script /usr/lib/rinse/qlustar-12.0-centos8/post-install.sh: error: /etc/pki/rpm-gpg/RPM-GPG-KEY-AlmaLinux: import read failed(2). error: /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-8: import read failed(2). error: /etc/pki/rpm-gpg/RPM-GPG-KEY-QLUSTAR: import read failed(2). error: /etc/pki/rpm-gpg/RPM-GPG-KEY-OpenHPC-2: import read failed(2). Running dnf makecache Unable to detect release version (use '--releasever' to specify release version) post-install.sh : done. Installation complete. == Done with basic chroot. Starting to add extra packages ... == Unable to detect release version (use '--releasever' to specify release version) Error: There are no enabled repositories in "/etc/yum.repos.d", "/etc/yum/repos.d", "/etc/distro.repos.d". ========= ------- Error ------- ========= manage-qlustar-chroot: Execution in chroot "/srv/apps/chroots/centos8" failed: /usr/bin/yum -y install bash-completion git man ql-hpl-tools redhat-lsb-core singularity telnet unzip zip lmod-defaults-gnu9-openmpi4-ohpc ssmtp ==> Exiting ... Poking around in the repos site, I can see qlustar-12.0-base and qlustar-12.0-repos in an older directory, but not in the AlmaLinux repo directory. If I download and copy those older rpms into the chroot and install them, then re-run the install chroot command with the overwrite option, I can get the chroot to complete without errors: rpm -ivh qlustar-12.0-repos-12.0.0.7-1.ql.el8.noarch.rpm qlustar-12.0-base-12.0.0.7-1.ql.el8.noarch.rpm manage-qlustar-chroot -v -a create -A 'amd64' -b '/srv/apps/chroots' -d 'centos' -n centos8 -r '12.0' -s 'centos8' --openhpc --overwrite Have any of you been able to set up a centos8 chroot successfully with a new install using the qlustar-installer-12.0.1-0.iso? Thanks in advance, Jeff

2 1

Security/Bug fix releases 12.0.1.0-b548f1441 / 11.0.1.17-b549f1440
by Qlustar List 09 Aug '22

09 Aug '22

The Qlustar releases 12.0.1.0-b548f1441 and 11.0.1.17-b549f1440 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/0808221 https://qlustar.com/qsa/2022/0808222 The following non-security related enhancements/bug fixes are included: For 12.0 only: - Update to QluMan 12.0.7.5 - Update Nvidia drivers to 515.65.01 (fixes CVE-2022-31607, CVE-2022-31608, CVE-2022-31615) - Update to ZFS 2.1.5 - Added Lustre 2.15

1 0

Enabling pam_slurm and pam_slurm_adopt
by jan.kreps＠cvut.cz 04 Aug '22

04 Aug '22

Hello everyone, I want to enable pam_slurm and pam_slurm_adopt in my new cluster. In https://qlustar.com/about-qlustar/workload-management is written, that "QluMan provides an option to enable the Slurm PAM module." Unfortunately I can not find such an option in QluMan. In Qlustar documentation I did not find this information either. Can you provide information how to achieve this? Thanks Jan

2 1

Password sync for ldap users.
by saeed.s.jahromi＠gmail.com 02 Jul '22

02 Jul '22

Greetings, I have qluster 12 installed on a small HPC in our university. To create users remotely, I usually use the terminal and .ldif files to create users. I also use the following command to change users passwords from the terminal: ldappasswd -Z -D "cn=admin,dc=gavazang,dc=qlustar" -W -S "cn= saeed,ou=users,dc=gavazang,dc=qlustar" This works and the password is changed. However, the problem is that once in a while the user cant connect to the cluster and I have to reset the password again and again and this happens frequently. Should I do anything to sync the passwords after changing them? Or am I doing something wrong here? thanks in advance for your assistance

2 1

Qlustar Feature Update 06/22
by Qlustar List 28 Jun '22

28 Jun '22

A number of new Qlustar features were completed recently and published together with the latest security updates. QluMan 12.0.7.3 highly improves on its slurm management capabilities basically making the slurm component feature complete. It adds - Real SLURM QOS MANAGEMENT [1] in the GUI. QoS can now easily be added, edited, removed and assigned. The full list of QoS properties may be added/removed and manipulated including sanity checking the values entered. - SLURM ASSOCIATION AND LIMITS MANAGEMENT [2] has been added in the GUI unleashing the power of advanced slurm resource management to QluMan admins. Various visual filters have been created to achieve a comprehensive display of slurm associations. The full list of association settings may be added/removed and manipulated including sanity checking the values entered. * An 'LDAP GROUP <-> SLURM ACCOUNT' SYNC MECHANISM [3] has been designed to automate slurm user setup upon creation of the user in LDAP. Slurm accounts may be associated with LDAP groups such that depending on users primary group the corresponding slurm account will be assigned as their default. * Cron-based LDAP DB BACKUP was introduced to allow a disaster recovery in case the LDAP DB becomes corrupted. Other new features: - Update to AlmaLinux 8.6 [1] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/components/slu… [2] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/components/slu… [3] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/components/slu…

1 0

Security/Bug fix releases 12.0.0.12-b548f1436 / 11.0.1.16-b549f1437
by Qlustar List 24 Jun '22

24 Jun '22

The Qlustar releases 12.0.0.12-b548f1436 and 11.0.1.16-b549f1437 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/0624221 https://qlustar.com/qsa/2022/0624222 The following non-security related enhancements/bug fixes are included: For 12.0 only: - Update to AlmaLinux 8.6 - Update to QluMan 12.0.7.3 - Update to MLNX OFED 5.4-3.4.0.0 - Update to Lustre 2.12.9

1 0

Using external LDAP server
by jan.kreps＠cvut.cz 13 Jun '22

13 Jun '22

Hello everyone, is there a way how to configure Qlustar to use external LDAP server instead of the one included in the installation? We run our own ldap server with passthrough authentication to Kerberos and want to use existing user accounts for Qlustar cluster as we did on our old cluster. Cheers, Jan

2 2

login-c unknown hardware
by yohann.clement＠univ-lyon1.fr 25 May '22

25 May '22

Hello, When installing qlustar, I choose the option front end via kvm when I follow qluman, a message appears on login-c: unknown hardware. I can't connect to it via ssh what services should be activated/configured to connect to the front end Thank you yohann

2 1

Security/Bug fix releases 12.0.0.11-b547f1433 / 11.0.1.15-b543f1435
by Roland Fehrenbacher 25 May '22

25 May '22

The Qlustar releases 12.0.0.11-b547f1433 and 11.0.1.15-b543f1435 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/0524221 https://qlustar.com/qsa/2022/0524222 https://qlustar.com/qsa/2022/0524223 The following non-security related enhancements/bug fixes are included: For 12.0 only: - Update to QluMan 12.0.7.1 - Update to slurm 21.08.8.2

1 0

login-c unknown hardware
by yohann.clement＠univ-lyon1.fr 23 May '22

23 May '22

Good morning, When installing qlustar, I choose the option front end via kom when I follow qluman, a message appears on login-c: unknown hardware. I can't connect to it via ssh what services should be activated/configured to connect to the front end thank you yohann

1 0

Qlustar 12 installation
by Jean-Luc Pons 19 Apr '22

19 Apr '22

Hello everyone First of all, thank you very much for the development of qlustar I am trying to reinstall qlustar 12.0 on my cluster and since the last update (04/14/22 on http://repo.qlustar.com) I have the following error: /usr/sbin/qlustar-initial-config ----------------------------- Fetched 186 MB in 29s (6364 kB/s) E: Failed to fetch http://repo.qlustar.com/repo/ubuntu-12.x/pool/main/q/qluman/qluman-slurmd_1… File has unexpected size (52504 != 52540). Mirror sync in progress? [IP: 188.68.35.17 80] Hashes of expected file: - SHA256:6668c331981204ba694ade94607acaddca6184cd664dde4085b0f80ca5879d85 - SHA1:eaf05531c795390221f58d6398a321baf68589b2 [weak] - MD5Sum:38b93670dfa3a41fde8de11b80c77a12 [weak] - Filesize:52540 [weak] E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing? qlustar-initial-config: Error while upgrading packages. Please make sure that package upgrade are possible. ----------------------------------- I am using the latest version of installer (gluster-installer-12.0.1-0.iso) Do you have an idea to fix it? cordially jluc -- Jean-Luc Pons Responsable du Service Informatique Centre de Biologie Structurale (http://www.cbs.cnrs.fr) CNRS UMR5048 - UM - INSERM U1054 29 rue de Navacelles 34090 - MONTPELLIER - France -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.

2 1

Security/Bug fix releases 12.0.0.10-b547f1432 / 11.0.1.14-b543f1431
by Qlustar List 14 Apr '22

14 Apr '22

The Qlustar releases 12.0.0.10-b547f1432 and 11.0.1.14-b543f1431 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/0413221 https://qlustar.com/qsa/2022/0413222 The following non-security related enhancements/bug fixes are included: For 12.0 only: - Update to Nvidia graphics driver version 510.47.03

1 0

No Bootable Device Found during post install boot
by ignas.bunikis＠scilifelab.uu.se 07 Apr '22

07 Apr '22

Hej, I was attempting to install Qlustar using latest installer (Qlustar Installer 12.0.1-0) on a few years old SuperMicro server. Installation seemed to go smooth, but after first reboot popped up boot error message that no bootable devices were found. During another installation attempt I noticed a couple of error message: * Failed to fetch file ..postfix... Hash sum mismatch * Failed to fetch file ..python-slurm... Hash sum mismatch * Failed to fetch file ..python3-slurm... Hash sum mismatch AND *GRUB/10-setup FAILED with exit code 127 After that installer says: Good news! No errors found in log files Do you have any ideas what could be an issue and what to do? Cheers, Iggy

2 1

Adding Users via QLUMAN
by yohann.clement＠univ-lyon1.fr 18 Mar '22

18 Mar '22

Hello, I am using the latest version of Qlustar 12.0 (FOCAL) I have a question about adding users. I use the qluman interface and I add an account via the menu component > ldap During the creation of the account, I have an error message which is the following: "Error 1 running add_user_hook /etc/qlustar/common/add-user-hook on beosrv-c: ('Unable to contact slurm controller (connect failure)', 1800) ('Unable to contact slurm controller (connect failure)', 1800) Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-12/qluman-slurm-cli.py", line 66, in main slurm_acct = SlurmAcct(cf_file, dry_run=args.dryrun, reset_all_qos=args.reset_all_qos) File "/usr/lib/python3/dist-packages/qluman-12/components/slurm/cli.py", line 87, in __init__ self.get_slurm_ctl_info() File "/usr/lib/python3/dist-packages/qluman-12/components/slurm/cli.py", line 112, in get_slurm_ctl_info c = pyslurm.config() File "pyslurm/pyslurm.pyx", line 376, in pyslurm.pyslurm.config.__cinit__ File "pyslurm/pyslurm.pyx", line 432, in pyslurm.pyslurm.config.__load ValueError: ('Unable to contact slurm controller (connect failure)', 1800) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-12/qluman-slurm-cli.py", line 96, in <module> main() File "/usr/lib/python3/dist-packages/qluman-12/qluman-slurm-cli.py", line 69, in main sys.exit(1) NameError: name 'sys' is not defined Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-12/qluman-slurm-cli.py", line 66, in main slurm_acct = SlurmAcct(cf_file, dry_run=args.dryrun, reset_all_qos=args.reset_all_qos) File "/usr/lib/python3/dist-packages/qluman-12/components/slurm/cli.py", line 87, in __init__ self.get_slurm_ctl_info() File "/usr/lib/python3/dist-packages/qluman-12/components/slurm/cli.py", line 112, in get_slurm_ctl_info c = pyslurm.config() File "pyslurm/pyslurm.pyx", line 376, in pyslurm.pyslurm.config.__cinit__ File "pyslurm/pyslurm.pyx", line 432, in pyslurm.pyslurm.config.__load ValueError: ('Unable to contact slurm controller (connect failure)', 1800) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-12/qluman-slurm-cli.py", line 96, in <module> main() File "/usr/lib/python3/dist-packages/qluman-12/qluman-slurm-cli.py", line 69, in main sys.exit(1) NameError: name 'sys' is not defined" I delete the account and I recreate the same account. Qluman gives me a password and I can connect as a user. Or am I making a mistake thank you

2 1

users created with LDAP in QluMan can't connect to head node with ssh
by saeed.s.jahromi＠gmail.com 22 Feb '22

22 Feb '22

Greetings I have installed the qlustar on a small cluster with one head node and 15 compute nodes. I managed to add all nodes to the cluster and configure slurm on the cluster via QluMan. As the last step to make the cluster available to users, I started creating new groups and users with QluMan. after creating new users and syncing I tried to connect with users to the head node by ssh. However, all the users that I create can not connect to the head node because it says the user does not have premission. I also chose to create a virtual demo cluster during the installation and the demo user which is created during the installation also does not have permission to ssh login to the head node. I checked on the head node and all user's home directory is created in the /data/home/ directory but they can not connect to the cluster. I would be so thankful if you guide me on how should I resolve this issue or where in the qlustar config files should I look for the source of the problem. PS, this cluster was already using an older version of the qlustar from 6 years ago and we just updated it to the latest qlustar 12. Thanks in advance for your assistance. Saeed

3 5

AlmaLinux 8 substitutes CentOS 8
by Qlustar List 21 Feb '22

21 Feb '22

https://qlustar.com/news/2022/2022-02-21-almalinux-8

1 0

How to generate a image for tesla m2075 ?
by Gerhard W. Recher 21 Feb '22

21 Feb '22

Dear members, I just test transition from rocks cluster to qlustar. one point is our tesla m2075 nodes wont boot with nvidia driver due to not supportet by ubuntou-focal-nvidea. <snip> [ 60.417821] NVRM: The NVIDIA Tesla M2075 GPU installed in this system is NVRM: supported through the NVIDIA 390.xx Legacy drivers. Please NVRM: visit http://www.nvidia.com/object/unix.html for more NVRM: information. The 470.74 NVIDIA driver will ignore NVRM: this GPU. Continuing probe... [ 60.418062] NVRM: No NVIDIA GPU found. [ 60.418406] nvidia-nvlink: Unregistered the Nvlink Core, major device number 245 [ 65.107363] nvidia-nvlink: Nvlink Core is being initialized, major device number 245 <snap> so how can i achieve this on head-node to assemble a new boot image with older driver ? fail with this one: NVIDIA-Linux-x86_64-352.79.run nvidia-installer log file '/var/log/nvidia-installer.log' creation time: Sun Feb 20 13:33:54 2022 installer version: 352.79 PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin nvidia-installer command line: ./nvidia-installer Unable to load: nvidia-installer ncurses user interface Using built-in stream user interface -> Detected 4 CPUs online; setting concurrency level to 4. WARNING: You do not appear to have an NVIDIA GPU supported by the 352.79 NVIDIA Linux graphics driver installed in this system. For further details, please see the appendix SUPPORTED NVIDIA GRAPHICS CHIPS in the README available on the Linux driver download page at www.nvidia.com. -> License accepted. -> Installing NVIDIA driver version 352.79. -> Performing CC sanity check with CC="/usr/bin/cc". -> Kernel source path: '/lib/modules/5.4.167-ql-generic-12.0-13/build' -> Kernel output path: '/lib/modules/5.4.167-ql-generic-12.0-13/build' -> Performing rivafb check. -> Performing nvidiafb check. -> Performing Xen check. -> Performing PREEMPT_RT check. -> Cleaning kernel module build directory. executing: 'cd ./kernel; /usr/bin/make clean'... -> Building NVIDIA kernel module: executing: 'cd ./kernel; /usr/bin/make module SYSSRC=/lib/modules/5.4.167-ql-generic-12.0-13/build SYSOUT=/lib/modules/5.4.167-ql-generic-12.0-13/build -j4 NV_BUILD_MODULE_INSTANCES='... NVIDIA: calling KBUILD... make[1]: Entering directory '/usr/src/linux-headers-5.4.167-ql-generic-12.0-13' /usr/bin/make -f ./Makefile syncconfig /usr/bin/make -f ./scripts/Makefile.build obj=scripts/basic rm -f .tmp_quiet_recordmcount /usr/bin/make -f ./scripts/Makefile.build obj=scripts/kconfig syncconfig scripts/kconfig/conf --syncconfig Kconfig Kconfig:34: can't open file "Documentation/Kconfig" make[3]: *** [scripts/kconfig/Makefile:73: syncconfig] Error 1 make[2]: *** [Makefile:590: syncconfig] Error 2 make[1]: *** [Makefile:696: include/config/auto.conf.cmd] Error 2 make[1]: Leaving directory '/usr/src/linux-headers-5.4.167-ql-generic-12.0-13' NVIDIA: left KBUILD. nvidia.ko failed to build! make: *** [nvidia-modules-common.mk:245: module] Error 1 -> Error. ERROR: Unable to build the NVIDIA kernel module. ERROR: Installation has failed. Please see the file '/var/log/nvidia-installer.log' for details. You may find suggestions on fixing installation problems in the README available on the Linux driver download page at www.nvidia.com. -- Gerhard W. Recher net4sec UG (haftungsbeschränkt) Leitenweg 6 86929 Penzing +49 8191 4283888 +49 171 4802507

1 0

tcsh segfault in Ubuntu 20.04 with external LDAP
by a.gabbana＠tue.nl 17 Feb '22

17 Feb '22

Dear Roland, we observe the following reproducible problem: - A fresh installation of qlustar 12 - A chroot with Ubuntu 20.04 - An external (fresh) ldap server (connection via shared conf files under /etc/qlustar/common/image-files) Calling tcsh returns segfault. The problem seems to be connected to libgssapi_krb5.so.2. The problem does not occur with a Ubuntu 18.04 chroot. Moreover, the problem does not occur with a fresh installation of Ubuntu 20.04 (without qlustar) connected to the same ldap Do you have any clue what could be triggering the problem / or can you suggest a possible workaround? best Alessandro

2 1

Cannot create a new chroot
by a.gabbana＠tue.nl 27 Jan '22

27 Jan '22

With Qlustar V12.0.6.0 I get the following error when trying to create a new chroot (similar thing happens if I try to clone/delete chroots): 2022-01-21 12:59:43,087 ERROR qlunet.Node Channel[('zmq_version_info', 6)].do_recv(): exception in request generator Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 151, in do_recv args = self._generator.send(msg) File "/usr/lib/python3/dist-packages/qluman-12/client/qt/ManageChroots/ManageChrootsWidget.py", line 370, in create self.create_exec() File "/usr/lib/python3/dist-packages/qluman-12/client/qt/ManageChroots/ManageChrootsWidget.py", line 393, in create_exec ExecuteWidget.create_chroot(cluster=self.cluster, name=name, desc=desc, server=server, File "/usr/lib/python3/dist-packages/qluman-12/client/qt/RxEngine/ExecuteWidget.py", line 625, in create_chroot ExecuteWidget.generic_execute_request(cluster=cluster, title=title, request=request) File "/usr/lib/python3/dist-packages/qluman-12/client/qt/RxEngine/ExecuteWidget.py", line 608, in generic_execute_request t = ExecuteTabWidget.create_request_execute(cluster, request, w, hidden=hidden) File "/usr/lib/python3/dist-packages/qluman-12/client/qt/RxEngine/ExecuteTabWidget.py", line 639, in create_request_execute t = request["write_file"].hostlist KeyError: 'write_file'

4 4

Qlustar Feature Update 01/22
by Qlustar List 10 Jan '22

10 Jan '22

A number of new Qlustar features were completed recently and published together with the latest security updates. QluMan 12.0.6.0 has the following new capabilities: - QLUMAN TIMERS [1] present a new Config class assignable to nodes. They allow for time-based execution of commands on nodes and are easily configured via the GUI. - ENHANCEMENTS OF THE SLURM GUI COMPONENT [2]: * Added on-the-fly job filtering and job grouping. * Significantly improved mechanism to transfer job data. The QluMan GUI is now able to smoothly handle thousands of jobs. - HARDWARE DETECTION INFO for nodes in the GUI Enclosure view [3] now transparently highlights misconfigurations, helping admins to track down faulty settings. - FILTERS IN USER/GROUP MANAGEMENT [4] have been added, making LDAP management a lot clearer and easier to follow. Other new features: - MELLANOX OFED [5] drivers and tools have been included for optimized support of clusters with newest Infiniband (IB) technology. Qlustar now automatically detects whether IB adapters supported by the current Mellanox OFED release are present and activates its drivers if that's the case. For all other IB hardware, the in-kernel drivers are used. - GPU DIRECT RDMA [6] support has been added for nodes running Nvidia GPUs together with IB adapters supported by Mellanox OFED. It provides a significant decrease in GPU-GPU communication latency and completely offloads the CPU, removing it from all GPU-GPU communications across the network. - The VIRTUALGL image module is now production ready. When used in a node image, Qlustar can provide 3D remote visualization on nodes with the required hardware. [1] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/Config-Classes… [2] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/components/slu… [3] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/Adding-Hosts.h… [4] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/components/lda… [5] https://www.mellanox.com/products/infiniband-drivers/linux/mlnx_ofed [6] https://www.mellanox.com/products/GPUDirect-RDMA

1 0

Security/Bug fix releases 12.0.0.8-b546f1425 / 11.0.1.12-b543f1424
by Qlustar List 28 Dec '21

28 Dec '21

The Qlustar releases 12.0.0.8-b546f1425 and 11.0.1.12-b543f1424 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2021/1221211 https://qlustar.com/qsa/2021/1221212 The following non-security related enhancements/bug fixes are included: For 12.0 only: - QluMan 12.0.6.0 (GUI update to 12.0.6.0 needed as well) * Major overhaul of slurm component - Monitor slurm data only when a GUI client needs it - Remove duplicate job properties before transmitting to client - Encode run time of jobs so it doesn't need to be transmitted every 5 sec * Further improve Slurm JobManagement interface - Add better column titles for new job properties - Allow grouping of jobs by columns - Show number of jobs shown after filter / total jobs - Run time of running jobs now updates every second * Add reminder about syncing users and groups with nodes upon LDAP changes * Switch to unlimited lifetime of LDAP certs (previously expired after 1 year). Add option '--update-certs' to qluman-ldap-cli. * Set DHCP lease time to 1 hour * EnclosureView: Several fixes/improvements with enclosure handling * NetworksWidget: Allow routed networks to be master for slave networks * WriteFiles/ssh - Drop files in /etc/qlustar/common/image-files and include authorized_keys in preview - replace /etc/ssh/ssh_known_hosts + shosts.equiv symlinks with files on online nodes * Fix wrong timestamps in message viewer

1 0

Stack Smashing Detected During qlustar-image-reconfigure
by hereiam＠mit.edu 25 Nov '21

25 Nov '21

Hi everyone, I've got a new one for you all... I was updating my chroot image successfully using qlustar-image-reconfigure, and all was well. However, when I updated qlustar using apt-get upgrade as usual (I haven't done so since July), now I get this error whenever I try to reconfigure the chroot image: 0 root@geb /var/lib/qlustar/images/Standard-focal # qlustar-image-reconfigure Standard-focal Reconfiguring image Standard-focal focal/12.0 - creating squashfs for download using kernel flavour ql-generic-* *** stack smashing detected ***: terminated /usr/sbin/qlustar-image-create: line 661: 8766 Aborted DEBIAN_FRONTEND=noninteractive chroot "$IMAGE_DIR" pam-auth-update --package --force Building image Standard-focal focal/12.0 failed. Any idea what might have happened? I'm all ears, and can't seem to figure it out on my own. Thanks! -Mike

1 0

[Qlustar-General] Node Replacement Issue - Infinite DNSMasq Lease in /var/lib/misc/dnsmasq.leases
by hereiam＠mit.edu 25 Nov '21

25 Nov '21

Hi everyone, I've run into what may be an uncommon issue when replacing nodes in Qluman. Say I have a node all configured, then I completely remove that machine and replace it with a new one (may or may not be different specs). I have noticed that Qluman allows one to make the new node in the configs, but it never boots Qlustar. I also found the fix - the file /var/lib/misc/dnsmasq.leases doesn't appear to get updated *only when deleting a node.* Adding new nodes works perfectly, as does changing MAC addresses. However, I've had to go in and manually delete the corresponding entries from the file on the headnode, after which Qluman works perfectly adding a New Host with the old IP address. Can anyone else reproduce this issue, and if so, would an addition to the scripts to the tune of deleting the line matching the hostname or MAC address in /var/lib/misc/dnsmasq.leases be required for the next round of updates? It makes sense that leases should have infinite lifetime in a cluster (nodes should sit tight for years), though in this rare situation it requires a bit of extra manual tweaking. Thanks, -Mike

4 5

Security/Bug fix releases 12.0.0.7-b542f1400 / 11.0.1.11-b543f1399
by Qlustar List 19 Oct '21

19 Oct '21

The Qlustar releases 12.0.0.7-b542f1400 and 11.0.1.11-b543f1399 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about all security fixes and special update instructions: https://qlustar.com/qsa/2021/1019211 https://qlustar.com/qsa/2021/1019212 The following non-security related enhancements/bug fixes are included: For 12.0 only: - QluMan 12.0.5.0 (GUI update to 12.0.5.0 needed as well) * Improve Slurm JobManagement interface - Add quick-search filter - Make server <-> client job updates much more efficient - Improve job filters - Allow actions (e.g. kill job) on jobs with different states - Fix jobs not getting removed * Improve Slurm NodeState Management GUI dialogs - name enclosures after their hosts - filter enclosure view items to show only slurm nodes - fix exception sorting enclosures * qluman-slurmd: Avoid memory leak in pyslurm creating data classes * FilesystemExports Widget - Correct network priorities when changing servers - fix broken priorities when an entry is displayed * FilesystemMounts - select server name for exports in the network of the server with a gateway - try to match NIC types for gateways * Add GlobalProp SearchDomains by default, change seperator to " " add DNS search domains to /etc/resolv.conf - Add cleanup for stale unionfs files upon boot - Update Nvidia driver to 470.74 - slurm module * Update to 20.02.7 * Fix a memory leak in the job structure

1 0

A few Qlustar 12.0 questions
by david.whipp＠helsinki.fi 20 Sep '21

20 Sep '21

Hi, First off, many thanks Roland for your earlier help with the Qlustar 12.0 installer. We've been up and running for a few months now and have almost everything working as desired. I'm writing because I have a few questions both about some issues we have not been able to resolve and some introduced in the latest security updates (QSA-0903211 and QSA-0903212). Latest issues first: 1. Since installing the latest security updates a few days ago I have noticed that Slurm has stopped working and the qluman-qt 'Components' option is grayed out (see https://imgur.com/a/W1Ejsvn). I'm not totally sure what the issue might be, but I noticed that the slurmdbd and slurmctld services are not running on the head node, and in fact are masked, which I understand will stop them from starting, right? You can see the output from 'service --status-all' and 'systemctl list-unit-files --state=masked' below. Any suggestions about how to re-enable Slurm? service --status-all: 0 root@geo-hpcc ~ # service --status-all [ - ] apache-htcacheclean [ + ] apache2 [ - ] console-setup.sh [ + ] cpufrequtils [ + ] cron [ + ] dbus [ + ] dnsmasq [ ? ] ganglia-monitor [ ? ] gmetad [ - ] grub-common [ - ] hwclock.sh [ - ] ipmievd [ - ] jobmonarch-jobmond [ - ] keyboard-setup.sh [ + ] kmod [ + ] loadcpufreq [ - ] lvm2 [ - ] lvm2-lvmpolld [ + ] munge [ + ] mysql [ + ] nagios4 [ - ] networking [ - ] nfs-common [ + ] nfs-kernel-server [ + ] ntp [ + ] postfix [ + ] procps [ + ] qluman-dhcpscanner [ + ] qluman-execd [ + ] qluman-router [ + ] qluman-server [ - ] qluman-slurmd [ + ] resolvconf [ - ] rng-tools [ + ] rpcbind [ - ] rsync [ + ] rsyslog [ + ] saslauthd [ + ] schroot [ - ] scsitools-pre.sh [ - ] scsitools.sh [ + ] slapd [ - ] slurmctld [ - ] slurmdbd [ + ] ssh [ + ] sssd [ + ] sysstat [ + ] udev [ - ] x11-common systemctl list-unit-files --state=masked: 0 root@geo-hpcc ~ # systemctl list-unit-files --state=masked UNIT FILE STATE VENDOR PRESET cryptdisks-early.service masked enabled cryptdisks.service masked enabled hwclock.service masked enabled jobmonarch-jobmond.service masked enabled lvm2.service masked enabled nfs-common.service masked enabled qluman-slurmd.service masked enabled rc.service masked enabled rcS.service masked enabled scsitools-pre.service masked enabled scsitools.service masked enabled slurmctld.service masked enabled slurmdbd.service masked enabled sudo.service masked enabled x11-common.service masked enabled 15 unit files listed. 2. In addition to the Slurm issue, I have also not been able to create new user accounts because the 'Components' option in qluman-qt is grayed out. I have previously migrated our old NIS user accounts to LDAP, but I am lackign experience with LDAP and unsure how to explore this issue. And finally, one older issue we have not resolved: 3. How do you change user passwords for LDAP users in Qlustar 12? I had been able to generate new passwords in qluman, but have not been able to figure out how what users should do to update their passwords. It seems perhaps there is a lifetime to the autogenerated passwords, so I have manually reset passwords when users needed them. Obviously, this is not something that is good in the long run. Do you have a suggestion? And sorry for the compilation of questions above. Hopefully the fixes are obvious to you and not too much trouble. Best, Dave

3 5

Qlustar 12 install fails on dell 3640
by maximilian.freudenberg＠uni-goettingen.de 10 Sep '21

10 Sep '21

Hi everybody! Yesterday I tried to install Qlustar 12.0.1-0 on a dell 3640 using a USB stick. Secure boot is off, legacy boot not available. I was able to start the install procedure, entered all details, read through the summary, hit enter, and BANG! big wall of running text. I took a photo and could decipher “stop_fail_installation task_error task_savelog die” repeated all over, which is almost poetic, but doesn't help much. Do you have any advice? How could I encircle the problem? It occurs no matter which distro or packages I select. Two things which are probably unrelated: 1) I had to reinsert the USB stick during the pre-install procedure, as there were problems during USB device discovery (as with every linux I have ever met). 2) I don't know if the mail relay I entered is valid. Kind regards Max

3 3

Qlustar lists on new server
by roland.fehrenbacher＠q-leap.de 09 Sep '21

09 Sep '21

Hi, yesterday we migrated the Qlustar lists to a new server and the latest mailman 3 software release. Please ignore all test/unsubscribe messages you might have received. Hope you like the experience with the new setup. All the best, Roland

1 0

Qlustar stuff
by rfpr＠q-leap.de 08 Sep '21

08 Sep '21

Hi There

1 0

Security/Bug fix releases 12.0.0.6-b542f1396 / 11.0.1.10-b543f1397
by Qlustar List 04 Sep '21

04 Sep '21

The Qlustar releases 12.0.0.6-b542f1396 and 11.0.1.10-b543f1397 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about all security fixes and special update instructions: https://qlustar.com/qsa/2021/0903211 https://qlustar.com/qsa/2021/0903212 The following non-security related enhancements/bug fixes are included: For 12.0 only: - QluMan 12.0.4.8 (GUI update to 12.0.4.8 needed as well) * NameServiceConfig: remove sssd restart commands * Indicate authentification method for LDAP users in GUI * Make NFS v3 the default for NFS mounts * Fix hostname override for non-primary networks * Fix slurm account creation * Fix focus loss in wizards * Fixes for AD import * Fix broken Slurm Job FilterEditor * Fix occasional exceptions in Slurm job updates * Fix network priority management in FS mounts

1 0

Difficulties installing Qlustar 12 on HP server
by david.whipp＠helsinki.fi 03 Aug '21

03 Aug '21

Hi, I have an HP Proliant DL380p (gen8) server that has been used as our head node for a Qlustar 10 cluster for several years now. We've recently decided to upgrade to Qlustar 12 (via a clean install) and I have been having issues with the installer not being able to find a disk for the installation. When I boot from USB the installer starts as expected, but once it loads I receive the message "No disks found - The installer ha not found any unused disks, installation cannot continue.". I've done some googling and found a few similar issues, mostly related to RAID, but no solution yet. The server does have a hardware RAID disk controller (HP P420i) and the target disk is a RAID 1 logical volume. The odd thing is that dropping into a shell and using lsblk shows the target RAID volume and another on the same controller as /dev/sda1 and /dev/sdb1. The RAID partitions also appear in the output of `cat /dev/partitions`, and it appears that the hpsa module has loaded properly from the output of `lsmod | grep hpsa`. We've today updated the BIOS and RAID controller firmware on the server and are still having no luck with proceeding with the install (same error every time). I am tempted to test things with the installer for Qlustar 11, but it no longer appears to be available online. Any suggestions? Thanks! Dave p.s. I won't be able to have physical access to the cluster again until July 20, but can try to answer any questions that come up here in the meantime.

5 16

Security/Bug fix releases 12.0.0.5-b542f1391 / 11.0.1.9-b543f1392
by Qlustar List 24 Jul '21

24 Jul '21

The Qlustar releases 12.0.0.5-b542f1391 and 11.0.1.9-b543f1392 are ready including a number of security/bug fixes and improvements. In particular, they include a fix for the Sequoia local root exploit bug https://www.qualys.com/2021/07/20/cve-2021-33909/sequoia-local-privilege-es… Please check the following web pages for details about all security fixes and special update instructions: https://qlustar.com/qsa/2021/0724211 https://qlustar.com/qsa/2021/0724212 The following non-security related enhancements/bug fixes are included: For 12.0 only: - ntpd is replaced by systemd-timesyncd as the daemon to sync system time between head-node(s) and netboot nodes.

1 0

Qluman
by kb0ebg＠juno.com 19 Jul '21

19 Jul '21

Greetings; Once again I must ask for advice. I get frustrated and give up, but I find it's a chalange I must keep working at. Setting my Gateway router to Port Forwarding :80 and assigning cl-head a static IP.I have completed the initial install. First Steps made it through without errors.This helped with 'HTTP Proxy' and the http: downloads from the repo access. I have setup a laptop as user@workspace, and installed 'qluman-12.0.2.0-singularity.sqsh', singularity, go, and associated files. user@workspace:~$ $HOME/qluman-12.0.2.0-singularity.sqshQstandsrdPaths: XDG_RUNTIME_DIR points to non-existing path'/run/user/1000', please create it with 0700 permissions.Qt: Session management error: None of the authentication protocols specified are supported. What Command line would you recommend to createa Path to '/run/user/1000' with 0700 permissions ? I have tried to no avail.user@workspace:~$ chmod 0700 /run/user/1000user@workspace:~$ chmod 0700 $HOME/qluman-12.0.2.0-singularity.sqsh Carlp.s. I love the structure of Qlustar. ____________________________________________________________ Sponsored by https://www.newser.com/?utm_source=part&utm_medium=uol&utm_campaign=rss_tag… Turkish Advocacy Puts Giuliani Under Investigation http://thirdpartyoffers.juno.com/TGL3131/60db7b57f348b7b574ec1st03duc1 75 Days Before Condo Collapse, Residents Got Cautionary Letter http://thirdpartyoffers.juno.com/TGL3131/60db7b5823d647b574ec1st03duc2 Made to Testify, Durst's Brother Speaks: 'He'd Like to Murder Me' http://thirdpartyoffers.juno.com/TGL3131/60db7b584a4567b574ec1st03duc3

3 3

Relay Mail
by kb0ebg＠juno.com 16 Jul '21

16 Jul '21

My email is with juno.com. They don't use relays. Installation requires a relay, the png example uses the DNS address. That has not worked for me. What could be used to meet installation requirements ? Carl ____________________________________________________________ Choose to be safer online. Opt-in to Cyber Safety with NortonLifeLock. Plans starting as low as $6.95 per month.* https://store.netzero.net/account/showService.do?serviceId=nz-nLifeLock&utm…

2 1

how to add nodes
by praveen＠aukcomputing.com 09 Jul '21

09 Jul '21

hi all, i new this Qlustar i want to know how to add nodes into the cluster like stepes in hwwizard it's says hw info missing

2 2

Qlustar 12.0
by kshitij pathak 09 Jul '21

09 Jul '21

Dear Support Team, I would like to tell you that I am installing Qlustar 12.0 in my master node and also completed the installation. I am writing this mail to you because I am not able to connect my compute nodes to the master node. I have even created a certificate for the connection but am not able to proceed further. After putting the password for the certificate and clicking on the connect button a GUI is opened but nothing happens. I am watching the Screenshot kindly go through it once. Please do the needful for the mentioned above. -- Thanks & Regards *Kshitiz Pathak* 7710952632 Mumbai

2 1

Security/Bug fix releases 12.0.0.4-b542f1382 / 11.0.1.8-b543f1384
by Qlustar List 09 Jul '21

09 Jul '21

The Qlustar releases 12.0.0.4-b542f1382 and 11.0.1.8-b543f1384 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2021/0706211 https://qlustar.com/qsa/2021/0706212 The following non-security related enhancements/bug fixes are included: For 12.0 only: - QluMan 12.0.3.1 (GUI update to 12.0.3.1 needed as well) * Add pre-systemd node customization via new config class * Add AD user import functionality in GUI (final) * Add support for DHCP-less boot * Add PrologFlags=X11 to default slurm config * Add support for routed networks as primary boot networks and in NetworkFSMounts * Exexd now sets the correct time in pre-systemd boot phase * Don't show slurm stuff in GUI if slurm is not installed * Ignore mouse wheel events in comboboxes to prevent accidental changes * SlurmJobManagement: Simplify customizing columns * Drop obsolete torque pam support * Fix version update check - slurm module * Introduce group 'node-ssh'. Members of this group are always allowed to make a node ssh login, even without slurm job. - Added virtualGL image modules (experimental) For 11.0/12.0: - Move CentOS 8 edge platform to 8.4 + OpenHPC 2.3

1 0

i have a issue while installing
by praveen＠aukcomputing.com 08 Jul '21

08 Jul '21

i have download the qlustar 12.0 iso while installing kernel panic – not syncing: VFS: Unable to mount root fs on unknown-block(0,0) i'm getting the above error will help me to resolve

1 1

[Qlustar-General] how to add GRES resources to qluster manually
by rolnas＠gmail.com 28 May '21

28 May '21

Hi, In my cluster I have two exotic IBM Power servers with NVIDIA cards. I succeded install Ubuntu 18.04 and make slurm working qith qlustar 11 server, but for NVIDIA cards to manage I cannot find any way to add manually those resources to global slurm config (gres.conf is managed by qlustar and no way to add something manually). Regards Rolandas

3 5

[Qlustar-General] Upgrading from 10.0, still possible?
by david.whipp＠helsinki.fi 28 May '21

28 May '21

Hi all, I have a slightly neglected cluster that is still running Qlustar 10.0 without issue. I have been asked lately to install some software and noticed that apt is failing to find a number of packages when trying to update/install. This has led me to conclude I probably should finally take the steps to update the cluster over the summer. However, as I am running Qlustar 10.0 still, I am failing to find documentation about how to do this upgrade. It seems the path would be 10.1 -> 11.0.x and then 11.0.x -> 12.0. But I'm still using 10.0... So, here are my questions: 1. Is it still possible to update Qlustar from 10.0 to 10.1? If so, where can I find documentation about this update? 2. If I am stuck with 10.0, what is the best path to eventually running 12.0? Back everything up and do a clean install? And sorry if this topic has come up elsewhere. I had a quick look through the archives and didn't see anything. Thanks! Dave

2 1

[Qlustar-General] Old help dns request
by kb0ebg＠juno.com 22 May '21

22 May '21

I may have found the dns solution I wrote about.I started the Installation on 2 usb drivesa 256gb & a 32gb with lots of errors.The dns now works.The next problem is "Proxy Hostname/IP".I do not understand what is being needed.If it is my router 10.0.0.1 & username/passwordor something else help is needed.Google has not been a help.- Ignored:Carl T. KnoxUSA, Minnesota, Twin Cities ____________________________________________________________ Sponsored by https://www.newser.com/?utm_source=part&utm_medium=uol&utm_campaign=rss_tag… New York, LA Investigate Attacks as Hate Crimes http://thirdpartyoffers.juno.com/TGL3131/60a833349097f33345d75st02duc1 Ted Cruz Courts Controversy With Tweet About 'Woke' Army http://thirdpartyoffers.juno.com/TGL3131/60a83334b3dc533345d75st02duc2 California Prepares for a Post-COVID World http://thirdpartyoffers.juno.com/TGL3131/60a83334d867d33345d75st02duc3

1 0

[Qlustar-General] restart vFE
by ignas.bunikis＠scilifelab.uu.se 20 May '21

20 May '21

Hej, Basic question: can one restart vFE without rebooting whole headnode? Cheers, Iggy

2 2

[Qlustar-General] Qluman Writes Incorrect Permissions to /etc/sssd.conf on Diskless Compute Nodes
by hereiam＠mit.edu 30 Apr '21

30 Apr '21

Hi everyone, This is my first post, and so far I love Qlustar! Just what I've been looking for, you've done amazing work here. I noticed that my physical compute nodes, which are all diskless, fail when Qluman tries to write the Namespace Configurations. Upon trying lots of things, I found that the file /etc/sssd.conf is written with '644' permissions, causing the sssd.service to not start. However, when I manually change these with 'chmod 600 /etc/sssd.conf' and restart the service with 'service restart sssd' when SSH'ed into a compute node, it works perfectly. So my question is, how can I change the permissions of a config file which Qluman writes to all nodes? I think this is my last barrier to a properly provisioned cluster. Thanks, -Mike

4 8

[Qlustar-General] Security/Bug fix releases 12.0.0.2-b531f1351 / 11.0.1.6-b533f1350
by Roland Fehrenbacher 28 Apr '21

28 Apr '21

The Qlustar releases 12.0.0.2-b531f1351 and 11.0.1.6-b533f1350 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-0320211-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0320212-security-update-bundle The following non-security related enhancements/bug fixes are included: For 12.0 only: - QluMan 12.0.1.0 * Add support for home directories on servers other than the head-node * Network FS mounts: respect Network Override * Improve saving of window geometries * Allow cluster commands to execute on headnodes and show correct execute-on in ExecuteWidget * Fix exception when importing a newly generated auth token * NetworkConfigWidget: Adjust column sizes * Nameservices: add group membership to passwd-sync method * Nameservices: fix permission of sssd.conf on updates * RxEngine: Fix kill/redo button in tabs - Set Infiniband node_desc to the node's hostname on nodes with IB adapters. This allows for better IB fabric analysis. - Prevent motd to display twice upon login on CentOS 8.

2 2

[Qlustar-General] Security/Bug fix releases 12.0.0.3-b536f1363 / 11.0.1.7-b533f1362
by Roland Fehrenbacher 28 Apr '21

28 Apr '21

The Qlustar releases 12.0.0.3-b536f1363 and 11.0.1.7-b533f1362 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-0427211-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0427212-security-update-bundle The following non-security related enhancements/bug fixes are included: For 12.0 only: - QluMan 12.0.2.0 (GUI update to 12.0.2.0 needed as well) * remove ipv4/ipv6/mac columns from Hosts table on update * LDAP user creation: don't run add_user_hook when homedir already exists * LDAP ConfigWidget: check nextuid/gid for being in use already * Nameservices: Add right to write the Nameservice config class. * RxEngine: Allow execution on head-nodes but only for pre-defined commands with "Execute On" set to "HEADNODE(S)" * Rights Management: Fix permissions for write files * Lustre mount configs: Properly name lnets * Nameservices: Restore passwd/group files when turning off nameservices * Fix wrong routing for CentOS 8 nodes when a non-default gateway is configured - Make OpenSM respect QluMan configured options when running on netboot nodes For 11.0 and 12.0: - Update to Nvidia graphics driver version 460.73.01

1 0

[Qlustar-General] Error trying to install Qlustar
by juancarlos.armas＠russula.com 17 Feb '21

17 Feb '21

Hello, While trying to install Qlustar 12 on one node of the server appears the next error: "The installer has not found any unused disks, installation cannot continue". ISO is directly connected though KVM to the server, so install media shouldn't be the problem. Opening a shell and executing "mdadm --detail-platform" appears this error: "imsm capabilities not found for controller..." and doesent show the existing volume. I have a RAID0 configured with 2 SSDs on a Intel RSTe RAID controller. Model of the server is SYS-6028TP-HTFR. Other SOs can install flawless. Thank you for your help in advice.

3 10

[Qlustar-General] Physical front-end
by shoup.31＠osu.edu 08 Feb '21

08 Feb '21

Hi, I am new to this list. I have a small cluster (3 physical compute nodes, (8 cores/16 threads/64GB ram each) head node & VM-FE) with qlustar 12.0 installed. I am using it to run the Einstein Toolkit (numerical general relativity package). I would like to setup a physical front-end node for my system. My questions are: 1. Does the physical front-end node have to be net-bootable (via the head node)? 2. What qlustar software do I need on it? Is there an automated method for installing it? 3. Do I have to manually install slurm on it to submit jobs to the cluster from the physical front end node? 4. Do I need to register the physical front end node in qluman-qt? Thanks for any help you can provide. Tony...

2 3

[Qlustar-General] Attribute 'filter_group' is not allowed in section 'nss'
by rolnas＠gmail.com 04 Feb '21

04 Feb '21

Hi, In Qlustar 12 sssd.conf file contains filter_group attribute, when by manual it should be filter_groups. Nothing very bad happens, only warning in log file and this setting is ignored. Regards Rolandas

2 1

[Qlustar-General] Critical sudo vulnerability
by Roland Fehrenbacher 29 Jan '21

29 Jan '21

A critical sudo vulnerability has been discovered. You are advised to update as soon as possible. See https://qlustar.com/news/qsa-0128211-sudo-vulnerabilities for details

1 0

[Qlustar-General] After fresh qlustar 12 install no way to generate access token
by rolnas＠gmail.com 26 Jan '21

26 Jan '21

Hi, root@lxibm000 ~ # qluman-cli --gencert Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-12/qluman-cli.py", line 1549, in <module> main() File "/usr/lib/python3/dist-packages/qluman-12/qluman-cli.py", line 1542, in main cluster = Cluster(config=config) File "/usr/lib/python3/dist-packages/qluman-12/client/cli/network.py", line 76, in __init__ self._node = Node(config=config, on_db_update=self._on_db_update) File "/usr/lib/python3/dist-packages/qluman-12/client/cli/network.py", line 53, in __init__ super().__init__(*args, socket_path=socket_path, TypeError: __init__() missing 1 required keyword-only argument: 'name' The same with qluman-cli --gencert -u admin -o token or qluman-cli --gencert -u admin qlustar-initial-config was done already and server rebooted. Regards Rolandas Naujikas P.S. Can newer version of qluman be used for older version of headnode ? Or it is better to use the same major version ?

3 4

[Qlustar-General] Security/Bug fix releases 12.0.0.1-b528f1339 / 11.0.1.5-b527f1338/40
by Roland Fehrenbacher 20 Jan '21

20 Jan '21

The Qlustar releases 12.0.0.1-b528f1339 and 11.0.1.5-b527f1338/40 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-0118211-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0118212-security-update-bundle https://qlustar.com/news/qsa-0118213-security-update-bundle The following non-security related enhancements/bug fixes are included: Both 11.0 and 12.0 update to - The latest Nvidia graphics drivers 460.32.03 supporting recently introduced Nvidia hardware. - The latest ZFS 0.8.6 fixing a memory management bug. Fixes for 12.0 only: - QluMan 12.0.0.39 * Detect IB nics with names other than ib[0-9] * Fix preserving minimized/maximized state for windows * Fix cloning of "Network FS Mounts" configs * Fix kernel options editor for "Network FS Mounts" configs

1 0

[Qlustar-General] Happy new year with Qlustar 12
by Roland Fehrenbacher 09 Jan '21

09 Jan '21

The Qlustar team wishes you all the best for the new year and is pleased to announce the immediate availability of Qlustar 12.0.0 for download [1]. It updates Qlustar's core platform to current Ubuntu 20.04 LTS. The CentOS [2] edge platforms remain based on 7.9 (with integrated OpenHPC [3] 1.3.9) and 8.3 (OpenHPC 2). The highlight of this release is the move to LDAP as the user and group name service, replacing the NIS setup used earlier. A fully configured LDAP instance is created at installation time. Net-boot nodes may directly authenticate users against this instance or use conveniently synced flat passwd/group files when scalability is critical. QluMan has a new optional component [4] to manage the Qlustar LDAP instance. It consists of a User and Group Management interface, as well as a powerful tool to import users/groups from passwd-like flat files. The second major new QluMan feature is the ability for easy and clean integration of external LDAP or Active Directory services with the new Nameservice Providers [5] and Nameservice Configs [6] dialogs. Finally, the QluMan GUI has been ported to the current QT 5 toolkit. This was a huge 'under the hood' effort that ensures the long-term maintainability of QluMan and also improves its stability. Highlights among the various major component updates include Kernel 5.4.x, Slurm 20.02.x, CUDA 11.0, ZFS 0.8.5 and BeeGFS 7.2. Please read the release notes [7] for more details. [1] https://www.qlustar.com/download [2] https://www.centos.org/ [3] https://openhpc.community/ [4] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/components/lda… [5] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/Cluster-Networ… [6] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/qluman-guide/Config-Classes… [7] https://docs.qlustar.com/Qlustar/12.0/ClusterOS/release-notes.html

1 0

[Qlustar-General] Qlustar 12 (Ubuntu 20.04)
by randomtasks＠gmail.com 04 Jan '21

04 Jan '21

Hello. Back in June 2020, one of the news posts seemed to indicate that Qlustar 12 (with Ubuntu 20.04 support) was expected sometime in 2020. I've been eagerly awaiting this for months. Any word on when Ubuntu 20.04 will be supported? > This is the last feature addition to Qlustar 11. We now work at full steam on the > Qlustar 12 release based on Ubuntu 20.04 and scheduled for some time later this year. Thanks for any update! ~Rodney

2 1

[Qlustar-General] OpenHPC 2.0/CentOS 8.3 on Qlustar 11
by Roland Fehrenbacher 04 Jan '21

04 Jan '21

The Qlustar team is pleased to announce the immediate availability of OpenHPC 2.0 [1] on top of CentOS 8.3 as an update to Qlustar 11. You can migrate your existing images and chroots to this new release in the usual way [1]. New ones can be generated via QluMan. Note that the disappearance of CentOS [3] as we knew it in the past, will not have a negative impact on Qlustar users running CentOS based nodes. There will be a simple migration path to whatever new RHEL compatible distribution will turn out to be the best choice at the end of 2021. Migration will involve nothing more than a usual Qlustar security update. [1] https://openhpc.community/openhpc-2-0-released/ [2] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/Administ… [3] https://blog.centos.org/2020/12/future-is-centos-stream/

2 1

[Qlustar-General] update the invidia driver in chroot
by a.gabbana＠tue.nl 19 Dec '20

19 Dec '20

Hi, I would like to install cuda11 in a cluster. In order to do so, I would need to first install the latest nvidia driver 450. In bionic the default is the 440 version; is there any way to update to the latest nvidia driver? with best regards A.

2 1

[Qlustar-General] Mounting an existing LV
by Ansgar Esztermann-Kirchner 07 Dec '20

07 Dec '20

Hello List, I'm wondering if anyone is mounting pre-existing (local) storage on a Qlustar node, and if so, how you go about it? My initial guess was to re-define the setup (xfs on LVM on mdraid) in the Disk Config assigned to the node, and mark it with preserve_always, but then the node refuses to boot correctly because setup-storage complains it cannot preserve my LV as it doesn't exist. I guess I could create per-node fstab stubs containing just the necessary lines, push them to the nodes using common/image-files with softgroups, and then add a common/rc.boot script to look for such stubs and mount them, but maybe there's a more integrated way? Thanks, A. -- Ansgar Esztermann Sysadmin Dep. Theoretical and Computational Biophysics http://www.mpibpc.mpg.de/grubmueller/esztermann

2 2

[Qlustar-General] Security/Bug fix releases 11.0.1.4-b522f1319/21 / 10.1.1.17-b521f1318
by Roland Fehrenbacher 30 Nov '20

30 Nov '20

The Qlustar releases 11.0.1.4-b522f1319/21 and 10.1.1.17-b521f1318 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-1126201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-1126202-security-update-bundle This release also includes the following version updates: - Centos 7 version is now 7.9 - ZFS version is now 0.8.5

1 0

[Qlustar-General] Security/Bug fix releases 11.0.1.3-b522f1314 / 10.1.1.16-b521f1313
by Roland Fehrenbacher 10 Oct '20

10 Oct '20

The Qlustar releases 11.0.1.3-b522f1314 and 10.1.1.16-b521f1313 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-1009201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-1009202-security-update-bundle

1 0

[Qlustar-General] I subscribed to the mailing list, and posting, but not getting posted
by linux2cloud.consultant 11 Sep '20

11 Sep '20

Hi Admin, I have subscribed to the mailing list, I posted one introduction mail about me and what I am planning to with HPC but my mails are not seeing in the mailing list Can you please check Linux-AWS Consultant Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0

[Qlustar-General] Hi, introduction new comer
by linux2cloud.consultant 10 Sep '20

10 Sep '20

Hi All, I am Saji. Just joined the mailing group. thought about say a HI, and a introduction about me. I have good Linux exposure and now working on AWS cloud based solutions. Very less experience in python programming, but picking it up. Very less knowledge or experience in HPC, have installed and configured OpenHPC, rockcluster, and now going to do Qlustar Recently me had idea to work on write up on comparing opensource HPC [OpenHPC, RockCluster, Qlustar] . I am waiting for my monster PC to be ready, so that I try out all three and do a comparison study . By this month end I will be assempling the required PC and working on it. Will be updating to the mailing lis tthe progress Thanks Saji Linux-AWS Consultant Sent with [ProtonMail](https://protonmail.com) Secure Email.

1 0

[Qlustar-General] NFS boot scripts do not run
by stephanie.kerckhof＠ec.europa.eu 25 Aug '20

25 Aug '20

Hello, We are encountering problems with the NFS boot scripts. We already used this on another installation of Qlustar. It was working fine, but on our new install, it seems that the scripts are not executing at boot anymore. Here is the procedure we followed: 1. We created a script in /etc/qlustar/common/rc.boot 2. We made the script executable using chmod +x If I look on the node, the script is visible in the NFS folder /etc/qlustar/common/rc.boot. If I execute it manually, it has the behaviour I'm expecting from it. Do you have any idea of why the NFS scripts could have some problems in executing at boot time? I was also wondering if there would be a way to start a service automatically at boot on a node? Thanks already for your help.

2 5

[Qlustar-General] Security/Bug fix releases 11.0.1.2-b522f1305 / 10.1.1.15-b521f1304
by Roland Fehrenbacher 22 Aug '20

22 Aug '20

The Qlustar releases 11.0.1.2-b522f1305 and 10.1.1.15-b521f1304 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-0821201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0821202-security-update-bundle The following non-security related enhancements/bug fixes are included: + Fixes - The package openmpi-bin was not installable. This is fixed in an updated version.

1 0

[Qlustar-General] Compute nodes do not boot
by Alexey Yaremchuk 12 Aug '20

12 Aug '20

Dear experts, I am trying to install a Qlustar OS on several Ethernet-linked machines and still compute nodes do not boot. The installer reports that there have been no errors, head and FE VM nodes do start, Qluman sees them and I could not find any error messages from dmesg except insignificant note that firmware load for regulatory.db failed. I installed a Debian system on one of compute nodes and upon configuring the network interface with a static address, established an ssh connection both with the head and VM-FE nodes. At least this ensures that cables are OK. If I configure it as dhcp, it does not discover dhcp server. If I force BIOS boot from the network, I receive either PXE-E51: No DHCP or proxyDHCP offers were received from Intel Boot Agent, if I make BIOS use only Legacy OpROM, or Media Present ... Start PXE Boot over IPv4 ... with a silent subsequent fall back into BIOS Setup, if I choose to use UEFI driver. I tried different combinations of Boot Device Control {UEFI_and_Legacy_OpROM|UEFI_only|Legacy_OpROM_only}, Boot from Network Devices {Legacy_OpROM_first|UEFI_driver_first}, OS TYPE {Other_OS|Windows_UEFI_mode} in BIOS Setup, and none of them worked. Qluman confirms that Boot network is configured as dhcp, and systemctl says that there are no failed services. Since I am the only one on the forum with such a problem, probably it can be fixed easily. However, I have no idea what to check and look forward for help. Thanks, Alexei

2 3

[Qlustar-General] openmpi-bin
by marra＠irc.cnr.it 12 Aug '20

12 Aug '20

Dear Qlustar experts, I am facing a problem with the installation of software on the bionic chroot. I need to install a software called OpenFOAM (CFD simulations). It requires as a dependency the package openmpi-bin, but when I try to install it with the following commands: # chroot-bionic # apt install openmpi-bin I get the following diagnostic messages: Reading package lists... Done Building dependency tree Reading state information... Done Some packages could not be installed. This may mean that you have requested an impossible situation or if you are using the unstable distribution that some required packages have not yet been created or been moved out of Incoming. The following information may help to resolve the situation: The following packages have unmet dependencies: openmpi-bin : Depends: openmpi-common (= 2.1.1-ql.1) but it is not going to be installed E: Unable to correct problems, you have held broken packages. I have so tried to uninstall the already installed mpi packages (openmpi-common-4.0, openmpi-gcc, openmpi-gcc-4.0) hoping to fix the broken packages, but the result is exactly the same, I continue to get this error. The strange for me is that in the output of command: # apt list the openmpi-bin package is listed as: openmpi-bin/11.0-bionic 2.1.1-ql.1+11-bionic amd64 Then, after having removed all openmpi* packages already installed, I was sure that by using the command: # apt install openmpi-bin would have rebuild the correct dependencies and installed aligned openmpi packages. Instead I got always the same error. I think this could be a common issue so I decided to share my experience with the other Qlustar users. I would be very grateful to receive your hints. Best regards, Franco

2 1

[Qlustar-General] nfs fails on compute nodes
by marra＠irc.cnr.it 12 Aug '20

12 Aug '20

Dear Qlustar experts, after a successful installation of the latest version of Qlustar (ver 11.0.1), I am facing a problem with the setup of computing nodes: they do not mount the nfs directories for apps and home. To me, everything looks correctly set up (checking with the qluman-qt application), Filesystem Exports and Network FS Mounts look correctly defined and assigned to the configs of the nodes. The only signal that something in the configuration of nodes is maybe not correct is an empty /etc/fstab, but probably the mount mechanism is different from standard mounts. What happens is that doing ssh to a compute node nor the apps nor the home directories are found. With the previous version 10.0 I did not have (on a different older cluster without IB) this issue. Please, can you give me some hints about what I have to check to fix this issue? Thank you in advance. Best regards, Franco

2 5

[Qlustar-General] OpenMPI failure
by Kim Peterson 07 Aug '20

07 Aug '20

Qlustar Kim here again; new Qlustar user, local university CS student. I have installed Qlustar on a Master node with 2 compute nodes attached, and I have installed the QluMan GUI Singularity container on a stand alone Front End computer. All seems to be working well. I get to Section 1.8 near the end of the First Steps Guide, and follow the instruction to log into the User account I have set up on the Head Node (Section 1.7), and run a test to verify the installation of MPI. I get no response to the instruction mpicc.openmpi-gcc -o hello-world-c hello-world.c I note that I get a response of: "no such instruction found" when I try: mpirun --version Anyone have an idea of what I might be doing wrong or what I might do to get OpenMPI working? Kim

2 5

[Qlustar-General] install qluman-qt fails
by Kim Peterson 22 Jul '20

22 Jul '20

I have set up a small cluster with a Master and 2 compute nodes. The Master has public and private Ethernet interfaces. The public interface is the connection to the internet. The private interface is the connection with the compute nodes. I installed Qlustar 11.0.1-0 on the Master, which completed with no issue. I had to restart the network services with systemctl restart systemd-resolved.service after the second re-boot during installation, and then proceeded with the First Steps checklist. I did not configure a Demo Cluster (Step 1.3) and I did not install additional software (Step 1.5). First Steps went fine up until step 1.6 "Running the Cluster Manager QluMan". Using the Head Node, I obtained a one-time token and saved it to /media/token (Step 1.6.1). When I attempted to install QluMan (Step 1.6.2), the review of packages that appeared on the monitor was normal looking, but the installation of each package failed. Failure indication was the same for each package to be installed; There was a notice that started with "Failed to fetch http://repo.qlustar.com/repo/ubuntu/pool/ ..." and ended with "... temporary failure resolving "repo.qlustar.com". I did a little communication check of the public network: ping www.google.com produced "Temporary failure in name resolution" ping 8.8.8.8 produced a steady stream of reports of "64 bytes from 8.8.8.8: icmp_seq=<n> tt1=116 time = 78.2 ms", with <n> incrementing each time. I also note that when I power up the 2 compute nodes after the successful Qlustar installation on the Master, there is no booting going on, which I presume may be related to whatever has made the Master unable to resolve network ip addresses and names. I am a CS student working a project that required a small cluster computer, so I have no particular skill with the technology here. I spent the better part of the day trying to figure out what I'm doing wrong, but I have failed. The issue is reproducible. I have done multiple installs from scratch and always get the same result. I note that the Qlustar OS installation and the early First Steps require access to the Qlustar.com repo, and that the "Final Reboot" at Step 1.2 appears to be when the Master node loses its ability to resolve network addresses and names and becomes unable to access the Qlustar.com repo. Do any of the kind listeners recognize my error or perhaps could recommend some sequence of steps I might take to isolate the problem? Kim

2 11

[Qlustar-General] Security/Bug fix releases 11.0.1.1-b519f1302 / 10.1.1.14-b521f1301
by Roland Fehrenbacher 16 Jul '20

16 Jul '20

The Qlustar releases 11.0.1.1-b519f1302 and 10.1.1.14-b521f1301 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-0715201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0715202-security-update-bundle The following non-security related enhancements/bug fixes are included: Qlustar 11.0.1.1-b519f1302 updates to/adds + the latest Lustre LTS release 2.12.5 + the latest Nvidia graphics drivers 440.100 supporting recently introduced Nvidia hardware + Several Nvidia GPU metrics (temperature, load, fan) were added to Ganglia + Fixes - QluMan * Improve slurm job information updates on busy head-nodes * Allow multiple networks for external hosts in Filesystem Mounts * Fix exceptions when editing properties - GPU detection (possibly missing /dev/nvidia-uvm on hardware with many GPUs) - NIS was failing in certain situations due to wrong /etc/hosts

1 0

[Qlustar-General] PXE problems since update
by stephanie.kerckhof＠ec.europa.eu 09 Jun '20

09 Jun '20

Hi, We recently tried to update qlustar to the 11.0.1 version adding UEFI support and CentOS 7.8. Since then, we got several problems with dnsmasq. First, the directory /var/lib/tftpboot/ was missing so we created it manually and added symbolic links to the files specified in the administration manual section ⁠4.1.2. It solved part of the problems we had, but now, while running systemctl status dnsmasq, we get the following error: dnsmasq-tftp[1758]: file /var/lib/tftpboot/grubnet.i386-pc not found Could you tell us where we could find this file? Thanks in advance for your help.

2 3

[Qlustar-General] login-c and beo nodes do NOT start
by mauro.delossantos＠udc.es 04 Jun '20

04 Jun '20

I´m deploying a head-node in a Virtualbox VM with a FE VM and 2 demo nodes (beo-01/2). After follow the doc guide's instructions, i have the head node up with perfect state but login-c and beo nodes couldn't get started. Anybody knows the reason and how to fix that? Thanks.

3 3

[Qlustar-General] 11.0.1 adds UEFI support and CentOS 7.8
by Roland Fehrenbacher 03 Jun '20

03 Jun '20

The Qlustar team is happy to announce the immediate availability of Qlustar 11.0.1 for download [1]. This minor release has two new features: a) Full UEFI support for the Qlustar installer and PXE booting of nodes. b) The move to CentOS 7.8 as the new supported minor CentOS 7 version. The Qlustar installer now transparently supports installation on legacy PC BIOS hardware as well as machines running under UEFI. If you have the choice, we recommend using the UEFI mode on your hardware. Our PXE booting mechanism has been doubly revamped: Firstly, we use GRUB as the boot loader now per default and secondly, we fully support UEFI based hardware transparently. So it will not matter whether your hardware runs under UEFI or PC BIOS, it should just boot fine, once registered correctly under QluMan. Reverting to booting with PXELINUX on PC BIOS machines is supported if needed/desired. Please follow the special update instructions [2] of the latest security announcements when updating and if you use QluMan singularity images, make sure you download [3] the latest version. This is the last feature addition to Qlustar 11. We now work at full steam on the Qlustar 12 release based on Ubuntu 20.04 and scheduled for some time later this year. [1] https://www.qlustar.com/download [2] https://www.qlustar.com/news/qsa-0527201-linux-kernel-vulnerabilities [3] https://www.qlustar.com/download

1 0

[Qlustar-General] Security/Bug fix releases 11.0.1.0-b519f1296 / 10.1.1.13-b521f1295
by Roland Fehrenbacher 30 May '20

30 May '20

The Qlustar releases 11.0.1.0-b519f1296 and 10.1.1.13-b521f1295 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-0527201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0527202-security-update-bundle

1 0

[Qlustar-General] CentOS 8 support has arrived
by Roland Fehrenbacher 20 Apr '20

20 Apr '20

CentOS 8 support is now available as a third Qlustar edge-platform and was published together with the latest security updates. It comes with the same functionality as our CentOS 7 port which includes out of the box OpenHPC 1.3.9 integration, Slurm 18.10.x, up-to-date Nvidia 340.x drivers, Lustre client and BeeGFS client. Making your compute nodes switch to CentOS 8 on an existing Qlustar cluster installation is extremely simple: First create a CentOS 8 chroot [1] optionally adding OpenHPC base support, then generate a CentOS 8 OS image [2] selecting the modules you require and finally a boot config [3] using the just generated image. After assigning [4] this boot config to the nodes you want to run it on, you just need to reboot them and voilà your CentOS 8 nodes are ready to be used. Note that OpenHPC 1.3.9 was originally built for CentOS 7.7. We had to make a few adjustments to make the OpenHPC parts relevant to Qlustar (compilers, MPIs, library packages and applications) work for CentOS 8. The OpenHPC test-suite was run successfully against these components. Once OpenHPC 2.0 will be out, we'll publish instructions to update to it. This will be straightforward. Additional improvements with this release: Updates to the latest Lustre 2.12.4 LTS release and the newest Nvidia graphics drivers 340.64 adding support for the latest Nvidia GPUs. These two updates apply to all Qlustar 11.0 platforms (Ubuntu 18.04 and CentOS 7/8). [1] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [2] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [3] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [4] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G…

2 2

[Qlustar-General] Trying to sort network interfaces: can I shell out in the installer?
by jarett＠bioteam.net 15 Apr '20

15 Apr '20

There are six relevant network interfaces on my head node, some of which are relevant and linked and some of which are not, and I can't tell which is which from the network interface names and am not on site to plug and unplug things. Is there some way to shell out, bring all the interfaces up and puzzle it out that way? TIA.

2 1

[Qlustar-General] Security/Bug fix releases 11.0.0.8-b518f1287 / 10.1.1.12-b521f1292
by Roland Fehrenbacher 14 Apr '20

14 Apr '20

The Qlustar releases 11.0.0.8-b518f1287 and 10.1.1.12-b521f1292 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes: https://qlustar.com/news/qsa-0406201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0406202-security-update-bundle The following non-security related enhancements/bug fixes are included: * Qlustar 11.0.0.8-b518f1287 updates to + the latest Lustre LTS release 2.12.4 + the latest Nvidia graphics drivers 440.64 supporting recently introduced Nvidia hardware

1 0

[Qlustar-General] Cannot add nodes from DHCP detect / how to authenticate users via Active Directory? / how to add my "scratch" NAS?
by Jarett DeAngelis 19 Feb '20

19 Feb '20

Hi folks, I was able to get my head node installed and can now boot it via the YUMI Linux installer USB. (I still don’t know why this is necessary, but hey, it works.) Now I have two issues: How do I add nodes to the cluster? I tried doing this with qluman-qt. I go to Manage Hosts and New Hosts, where it sees the MAC from one of my nodes. If I try to add it to the cluster I get a SQL error from Python about how it cannot insert a new record without the “status” field. Like so: If I click either “Add Selected” or “Add Host” here, I get this: Which seems to be generated from this SQL insert: The procedure for adding hosts actually doesn’t seem to be documented anywhere. I thought maybe I could try it from the command line, but there also doesn’t seem to be any documentation for the qluman-cli utility. I’m not entirely sure how the host abstraction works in Qlustar. My front-end/head node’s hostname is “argo,” yet the only thing in the host database visible in qluman-qt that seems to map to this is “beosrv-c.” Where did that name come from? The next steps I would like to get to are as follows: Add my two compute nodes to the cluster Add the NFS NAS I built to be a “scratch” filesystem available across all nodes Install some bioinformatics software (a good resource for this in Qlustar would be a big help) Make the cluster able to authenticate users via an Active Directory instance — I have a hard time understanding users in Qlustar. There is a very brief blurb in the administration guide about sssd.conf being replicated to each machine in the cluster, but the hostname in SSSD would have to be different for each node, so I don’t think that works for AD unless Qlustar is doing some kind of templating with the names. The other issue here is that when you join Linux machines to Active Directory and users log in, no entry is created in /etc/passwd, so if user process work is being kept track of with those, it won’t work. Unless the typical method for authenticating users is to use “plain” LDAP somehow without actually performing an AD join and just manually creating users that are then only authenticated against LDAP, and replicated between hosts normally because they’re “regular” UNIX users? That would also be fine; the problem here is that I can’t figure out how users are supposed to work. I added a user via qluman-qt and it appears not to have been added to /etc/passwd either, and since I have not yet configured SSSD I can’t figure out what those users are for. I can’t log in to SSH with them. I know that’s a lot at once; TIA. Jarett

2 1

[Qlustar-General] Re: Can't install
by Roland Fehrenbacher 19 Feb '20

19 Feb '20

>>>>> "J" == Jarett DeAngelis <jarett(a)bioteam.net> writes: J> I mean it just isn't an option. The attached is what I get if I J> turn UEFI options off entirely. It doesn't recognize the drive as J> bootable. If I turn UEFI options on, the USB drive is there, but J> of course doesn't work. Have you turned 'secure boot' off? If not please try that.

4 11

[Qlustar-General] Qlustar Feature Update 02/20
by Roland Fehrenbacher 13 Feb '20

13 Feb '20

A number of new Qlustar features were completed recently and published together with the latest security updates ([1], [2]). QluMan 11.0.3.1 has the following new capabilities: * The 'Write Files' dialog [3] got a complete revamp: + The configuration files/links belonging to different QluMan 'Config Classes' are now neatly arranged in a single collapsible tree-view. + Colored LEDs have been introduced to indicate whether pending changes of the config files are waiting to be written and which files are affected. + It is now straightforward to cycle through the list of changed files exclusively, allowing for a fast overview of pending changes in diff format. + Selecting individual Config Classes to be written has become a lot simpler by providing checkboxes in the tree-view. + Overall, the new dialog greatly enhances the clarity of the cluster configuration space. It provides way better control and confidence when performing configuration changes. * Messages for config file writing have been added to the QluMan Log Viewer [4]. * The so-called QluMan 'save-button interface' was improved and implemented for the editing of command names in the Command Editor. Now name labels turn green when changed and black after being saved, improving transparency. If you use QluMan singularity images, make sure you download [5] the latest version. [1] https://www.qlustar.com/news/qsa-0210201-linux-kernel-vulnerabilities [2] https://www.qlustar.com/news/qsa-0210202-security-update-bundle [3] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [4] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [5] https://qlustar.com/download

1 0

[Qlustar-General] 2nd stage configuration failed at the first step.
by mohd.farid.ismail＠yandex.com 20 Jan '20

20 Jan '20

Hi, I'm having trouble getting pass the 1 boot process, which is to run /usr/sbin/qlustar-initial-config. After entering a name for the cluster, I always get the error HTTP access to the Qlustar repository is not possible Please check your curent network settings (received from DHCP): enp9s0: ..... Kernel IP routing table . . . Once you have made the required modifications, restart /usr/sbin/qlustar-initial-config! I can access the network (sshing to another machine), but cannot ping. It seems the DNS cannot be resolved (ping www.google.com results in the error "Temporary failure in name resolution.") Any hint on what I did wrong?

2 2

[Qlustar-General] Security/Bug fix releases 11.0.0.6-b515f1278 / 10.1.1.10-b509f1277
by Roland Fehrenbacher 09 Jan '20

09 Jan '20

The Qlustar releases 11.0.0.6-b515f1278 and 10.1.1.10-b509f1277 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes: https://qlustar.com/news/qsa-0109201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0109202-security-update-bundle The following non-security related enhancements/bug fixes are included: * Qlustar 11.0.0.6-b515f1278 fixes a bug in disk setup configurations for netboot nodes using XFS on LVM

1 0

[Qlustar-General] upgrading qlustar from 10.1.1 to 11.0
by Tobias Moehle 08 Jan '20

08 Jan '20

Dear all, First of all I'd like to wish all developers/maintainers and users a happy new year and all the best. I know I am quite late with this topic, but other things distracted me so-far: I'd like to finally upgrade our cluster to 11.0. According to the upgrade instructions (https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/Release_…) it is more or less an apt distupgrade; but since there are a lot of changes and I have very bad experience trying to upgrade merely ubuntu-versions (which usually breaks), I can't believe it is so simple? So I'd like to ask whether it is really as simple and what your experiences are? Any caveats, things to keep in mind? Can I do it while calculations are running or should I rather wait for all of them to finish (we have run-times of months, therefore this is a thing in my case). Any advice/comment is very welcome. Best regards, Tobias

3 3

[Qlustar-General] HDD requirements
by mohd.farid.ismail＠yandex.com 07 Jan '20

07 Jan '20

Hi, I was looking at the hardware requirement, and am wondering how strict is the hard disc 160GB or bigger in size requirement. What I mean is, lets say if I use a smaller than 160GB disc, will the installation stop itself, or will it install anyway but with problems later down the road? --farid

2 3

[Qlustar-General] Can't install
by Jarett DeAngelis 17 Dec '19

17 Dec '19

Hi, I have a small collection of Skylake HP desktops I'm deploying Qlustar onto as a lab environment. I cannot get the system to boot correctly. I'm using the Windows utility "Rufus" to image the USB stick. If I use "dd" mode, when I try to boot it skips right over it as though it weren't bootable. If I use "iso" mode, it gets about six seconds into the boot process, loading modules, before it complains it can't load the vfat module. It is indeed not in /lib! I feel like I must be doing something wrong here, but damned if I can figure it out solo. I have also tried this on a Mac and on a Linux machine with BalenaEtcher; same results as "iso" mode on Rufus. Hope everyone is having a good weekend! Jarett

2 5

[Qlustar-General] QluMan bugfix update 11.0.2.10
by Roland Fehrenbacher 17 Dec '19

17 Dec '19

A bug was discovered in the recently uploaded QluMan GUI version 11.0.2.8 that prevents the addition of new hosts. The bug is fixed in the most recent version 11.0.2.10. Please download the updated QluMan GUI singularity image 11.0.2 at https://qlustar.com/download that includes the fixed version.

1 0

[Qlustar-General] Re: Error: No such user: 'admin'
by Roland Fehrenbacher 13 Dec '19

13 Dec '19

>>>>> "TM" == Tobias Moehle <tobias.moehle(a)uni-rostock.de> writes: TM> Hi Roland, yes, with the newest version everything worked TM> without any problems. Great, thanks for the confirmation. Best, Roland

1 0

[Qlustar-General] Qlustar Feature Update 12/19
by Roland Fehrenbacher 09 Dec '19

09 Dec '19

A number of new Qlustar features were completed recently and published together with the latest security updates. QluMan has the following new capabilities: * RXEngine command output is searchable now [1], making the analysis of command results a lot easier. * RXEngine Command History management [2] has been improved to allow for fine-grained control during removal of unwanted entries. * Cluster logging as displayed in the QluMan Log Viewer [3] has been vastly enhanced: + New message categories have been added for managing chroots, start/stopping of slurmd and RXEngine executions in general. + Messages originating from node reboots have been merged into single summary entries to hugely reduce the number of messages and better track cluster state changes. * The QluMan GUI now checks for version updates when starting up [4]. If you use QluMan singularity images, make sure you download [5] the latest version. In addition, we have integrated the latest OpenHPC 1.3.9 release, so a big pile of updated packages are available for those of you running CentOS/OpenHPC. [1] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [2] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [3] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [4] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [5] https://qlustar.com/download

1 0

[Qlustar-General] Error: No such user: 'admin'
by Tobias Moehle 05 Dec '19

05 Dec '19

Dear all, I am trying to setup a new cluster using the current 11.0.0-3-image. I have tried already several times (also with updated image) and usually the setup works fine. However, when trying to create the token, I keep getting the error qluman-cli --gencert ERROR:client.cli.network:client.cli.network.Cluster.__init__(): could not connect to server Error: No such user: 'admin' ERROR:qlunet.Node:Channel[('zmq_version_info', 1)].do_recv(): exception in request generator Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-11/qluman-cli.py", line 1331, in gencert db.users.lookup(field="name", val=user) File "/usr/lib/python3/dist-packages/qluman-11/common/types.py", line 1866, in lookup raise KeyError KeyError During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 141, in do_recv args = next(self._generator) File "/usr/lib/python3/dist-packages/qluman-11/qluman-cli.py", line 1334, in gencert sys.exit(1) SystemExit: 1 ' /var/log/qlustar-initial-config.log ' does not contain any errors or suspiciously-looking parts and everything went through on the first trial. Thus I went out of own ideas about what could cause the problem. Many thanks in advance, Tobias Moehle

3 8

[Qlustar-General] failed to install lustre server
by Rajendra Adhikari 15 Nov '19

15 Nov '19

Dear All, Again greetings from Kathmandu University Supercomputer Center, Nepal. Please help me on installing the lustre server. Error message including my try are as below: I am not sure why there is dependency error. Sincerely, Rajendra Adhikari (mds) root@cl-head:~ # apt-cache search lustre | grep 'lustre-2.12-server-modules' lustre-2.12-server-modules-4.19.17-ql-generic-11.0-3 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-4.19.31-ql-generic-11.0-4 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-4.19.36-ql-generic-11.0-5 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-4.19.42-ql-generic-11.0-6 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-4.19.46-ql-generic-11.0-7 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-ql-generic - Qlustar Lustre 2.12.x server kernel modules (Metapackage) lustre-2.12-server-modules-4.19.53-ql-generic-11.0-8 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-4.19.60-ql-generic-11.0-9 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-4.19.73-ql-generic-11.0-10 - Qlustar Lustre 2.12.x server kernel modules lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 - Qlustar Lustre 2.12.x server kernel modules I choose the last one: (mds) root@cl-head:~ # apt install lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 Reading package lists... Done Building dependency tree Reading state information... Done The following additional packages will be installed: lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 The following NEW packages will be installed: lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 0 upgraded, 2 newly installed, 0 to remove and 0 not upgraded. 1 not fully installed or removed. Need to get 1,556 kB/2,884 kB of archives. After this operation, 20.3 MB of additional disk space will be used. Do you want to continue? [Y/n] Get:1 http://repo.qlustar.com/repo/ubuntu 11.0-bionic-proposed-updates/main amd64 lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 amd64 2.12.2+ds.1-ql.1+11.0-11 [1,556 kB] Fetched 1,556 kB in 2s (656 kB/s) debconf: delaying package configuration, since apt-utils is not installed (Reading database ... 20741 files and directories currently installed.) Preparing to unpack .../lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11_2.12.2+ds.1-ql.1+11.0-11_amd64.deb ... Unpacking lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 (2.12.2+ds.1-ql.1+11.0-11) ... Preparing to unpack .../lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11_2.12.2+ds.1-ql.1+11.0-11_amd64.deb ... Unpacking lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 (2.12.2+ds.1-ql.1+11.0-11) ... Setting up linux-image-4.19.80-ql-generic-11.0-11 (4.19-11.0-11) ... Running depmod. Failed to run depmod dpkg: error processing package linux-image-4.19.80-ql-generic-11.0-11 (--configure): installed linux-image-4.19.80-ql-generic-11.0-11 package post-installation script subprocess returned error exit status 1 dpkg: dependency problems prevent configuration of lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11: lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 depends on linux-image-4.19.80-ql-generic-11.0-11; however: Package linux-image-4.19.80-ql-generic-11.0-11 is not configured yet. dpkg: error processing package lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 (--configure): dependency problems - leaving unconfigured dpkg: dependency problems prevent configuration of lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11: lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 depends on linux-image-4.19.80-ql-generic-11.0-11; however: Package linux-image-4.19.80-ql-generic-11.0-11 is not configured yet. lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 depends on lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11; however: Package lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 is not configured yet. dpkg: error processing package lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 (--configure): dependency problems - leaving unconfigured Errors were encountered while processing: linux-image-4.19.80-ql-generic-11.0-11 lustre-2.12-common-modules-4.19.80-ql-generic-11.0-11 lustre-2.12-server-modules-4.19.80-ql-generic-11.0-11 E: Sub-process /usr/bin/dpkg returned an error code (1) (mds) root@cl-head:~ # The output of uname -a is as follow: uname -a Linux cl-head 4.19.80-ql-generic-11.0-11 #1 SMP Mon Oct 21 09:49:44 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux

2 3

[Qlustar-General] First time authentication
by Alain EMPAIN 13 Nov '19

13 Nov '19

Hello, I installed the new qlustar version 11.0.2 and tried to start qluman-qt : I cannot pass the first admin authentication step. 2019-11-13 11:35:17,207 DEBUG client.qt.ClusterWindow ClusterWindow.on_qlumand_online(True) 2019-11-13 11:35:17,208 DEBUG client.qt.ClusterWindow ClusterWindow.authenticate(): checking authentication 2019-11-13 11:35:17,208 DEBUG client.qt.ClusterWindow one time token 2019-11-13 11:35:17,208 DEBUG client.qt.MainWindow ServerWidget[b'Qlumand'].online_changed(True) 2019-11-13 11:35:17,213 DEBUG client.qt.ClusterWindow msg = error { text: "Authentication failed" } 2019-11-13 11:35:55,552 DEBUG client.qt.ClusterWindow one time token failed 2019-11-13 11:35:55,552 DEBUG client.qt.ClusterWindow ClusterWindow.closeEvent() 2019-11-13 11:35:55,576 DEBUG client.qt.ClusterWindow ClusterWindow.count_messages(force=True) 2019-11-13 11:35:55,576 DEBUG client.qt.ClusterWindow ClusterWindow._count_messages(force=True) 2019-11-13 11:35:55,576 DEBUG client.qt.ClusterWindow check_components(): components = [] 2019-11-13 11:35:55,576 DEBUG client.qt.MainWindow ServersWidget.cluster_activated(<client.qt.ClusterWindow.ClusterWindow object at 0x7fcdf8e4bfc8>) 2019-11-13 11:35:55,577 DEBUG client.qt.MainWindow no change 2019-11-13 11:35:55,582 DEBUG client.qt.ClusterWindow ClusterWindow.closeEvent(): all closed 2019-11-13 11:35:56,585 DEBUG client.qt.ClusterWindow ClusterWindow.closeEvent(): done I found the token files created at '/usr/lib/python3/dist-packages/qluman-11'. I erased them, to restart from a fresh state, but it does not help, I circle around the problem . When I installed the 10.x version, it worked immediately, but perhaps by chance ;-) Is it possible to reverse the 'first try procedure' to a sane state ? I suppose that my various attemps left some scories to be removed for a correct procedure. By the way, I copied the new 11.0.3 iso version on a USB key drive, with the classical command 'dd if=the.ISO of=/dev/sdb bs=...' but the server BIOS do not detect it as a bootable device. (I do this kind of operation routinely, nromally without any problem) Thanks for any advice, Alain --- Dr Alain EMPAIN, Bioinformatics University of Liège CHU, GIGA-R (B34, +1), alain.empain(a)uliege.be Rue des Martyrs, 11 B-4550 Nandrin Mobile: +32 497 701764 HOME:+32 85 512341

2 2

[Qlustar-General] qluman-cli --gencert error
by rajendra.adhikari＠ku.edu.np 11 Nov '19

11 Nov '19

Dear All, Please help me the problem with not able to generate qluman --gencert. The output is as below: Sincerely, Rajendra Adhikari qluman-cli --gencert ERROR:qlunet.Node:router is not responding to pings: reconnecting ERROR:qlunet.Node:Node.run(): exiting after exception Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 333, in run timeout = self._queue.next() File "/usr/lib/python3/dist-packages/qlunet/Timeout.py", line 143, in next item.expired(self) File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 79, in expired self._node.slave_reset_keys() File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 994, in slave_reset_keys self._monitor.setsockopt(zmq.LINGER, 0) AttributeError: 'NoneType' object has no attribute 'setsockopt' ERROR:qlunet.Node:Network thread is quiting on us

2 2

[Qlustar-General] Re: Problem to start qluman-qt : sqlite3 vs mysql
by Roland Fehrenbacher 05 Nov '19

05 Nov '19

>>>>> "A" == Alain EMPAIN <alain.empain(a)ulg.ac.be> writes: A> Hello Roland, thanks for the fast answer.. Indeed, just this A> command allows to start qlustar-qt Great, thanks for the confirmation. Fixed packages + singularity container are already uploaded. Please update your head-node as well, since another bug in the RXengine has been fixed. A> Have a nice day, Thanks, same to you. A> PS: I am very interested into Qlustar : it brings a fresh view on A> cluster management with respect to ROCKS. Before ROCKS, I was A> handling everything by hand (cluster itself, Condor, SGE, Torque A> engines...), so it was already a nice step towards ! Always great to hear positive statements. A> Here at the Liège University, and at the CECI consortium (Walloon A> Region), every clusters run SLURM and the official clusters are A> dealt with the commercial offer BRIGHT. I am building a fresh new A> cluster with Qlustar and old nodes, retired because we do not A> have maintenance contracts anymore for them ! I do not want to A> discard yet working machines, so I profit to experiment and to A> deploy Qlustar on a prototyping cluster, in the back of the deep A> basement of our Univ. Hospital ;-) Thanks for sharing your approach. I fully understand that one needs to follow a very conservative approach when trying to replace an existing working setup. Good luck with this. I'd be happy to hear more about your progress in the future here. Best, Roland A> From: "Roland Fehrenbacher" <rf(a)q-leap.de> To: "QLUSTAR A> General" <qlustar-general(a)qlustar.org> Sent: Tuesday, 5 A> November, 2019 09:46:15 Subject: [Qlustar-General] Re: A> Problem to start qluman-qt : sqlite3 vs mysql >>>>>> "A" == Alain EMPAIN <alain.empain(a)ulg.ac.be> writes: A> Hi Alain, A> Hello, I am discovering Qlustar (being a ROCKS admin since a long A> time). My first test with Qlustar 10.x was sucessful; qluman-qt A> started correctly, I browsed the windows with no problem. A> happy to see you trying Qlustar. A> I reinstalled everything from scratch to run Qlustar 11, A> installed qluman-qt with apt install and using the singularity A> image : both version give the error A> (...) File A> "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", A> line 393, in connect return self.dbapi.connect(*cargs, **cparams) A> sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) A> unable to open database file A> I wonder why SQLITE3 is invoqued because during the installation, A> there was a prompt for mysql root's password. A> The sqlite DB is a new feature we introduced with the latest A> updates to store user commands executed via the RXengine A> in. We assume that you discovered a small bug that we will A> fix shortly. As a work around you can try to execute A> $ mkdir $HOME/.config/Qluman A> This is where the sqlite DB should be stored and if the dir A> doesn't exist it will fail. Can you please let us know A> whether this fixes your problem? A> Best, A> Roland _______________________________________________ A> Qlustar-General mailing list -- qlustar-general(a)qlustar.org A> To unsubscribe send an email to A> qlustar-general-leave(a)qlustar.org --

1 0

[Qlustar-General] Problem to start qluman-qt : sqlite3 vs mysql
by Alain EMPAIN 05 Nov '19

05 Nov '19

Hello, I am discovering Qlustar (being a ROCKS admin since a long time). My first test with Qlustar 10.x was sucessful; qluman-qt started correctly, I browsed the windows with no problem. I reinstalled everything from scratch to run Qlustar 11, installed qluman-qt with apt install and using the singularity image : both version give the error (...) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 393, in connect return self.dbapi.connect(*cargs, **cparams) sqlalchemy.exc.OperationalError: (sqlite3. OperationalError) unable to open database file I wonder why SQLITE3 is invoqued because during the installation, there was a prompt for mysql root's password. MariaDB is running, and a Qlustar Database exists and populated : mysql -p Enter password: Welcome to the MariaDB monitor. Commands end with ; or \g. Your MariaDB connection id is 48 Server version: 10.1.41-MariaDB-0ubuntu0.18.04.1 Ubuntu 18.04 Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. MariaDB [(none)]> use Qlustar; Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Database changed MariaDB [Qlustar]> select * from Users; +----+-------+--------+---------------+----------------+------------------------------------------------+---------------------+ | id | name | passwd | real_name | email | info | last_changed | +----+-------+--------+---------------+----------------+------------------------------------------------+---------------------+ | 1 | admin | $......| Admin account | root@localhost | Admin user | 2019-11-05 08:49:36 | | 2 | root | $......| cli user | root@beosrv-c | user used by the qluman command line interface | 2019-10-30 10:57:10 | +----+-------+--------+---------------+----------------+------------------------------------------------+---------------------+ 2 rows in set (0.00 sec) Any clue will be welcome ! Thanks Alain --- Dr Alain EMPAIN, Bioinformatics University of Liège CHU, GIGA-R (B34, +1), alain.empain(a)uliege.be Rue des Martyrs, 11 B-4550 Nandrin Mobile: +32 497 701764 HOME:+32 85 512341

2 1

[Qlustar-General] Feature Update 10/19 - QluMan RXEngine 2.0 / CentOS 7.7
by Roland Fehrenbacher 01 Nov '19

01 Nov '19

A large number of new exciting Qlustar features were completed recently and published as ** Feature Update 10/19 **. Most prominent is RXengine 2.0, a complete redesign of the QluMan Remote Execution engine. Non-QluMan related major new stuff includes the move to CentOS 7.7. Check out all the details at https://www.qlustar.com/news/qluman-rxengine-20-feature-update-1019

1 0

[Qlustar-General] Security/Bug fix releases 11.0.0.4-b515f1270 / 10.1.1.8-b509f1268
by Roland Fehrenbacher 30 Oct '19

30 Oct '19

The Qlustar releases 11.0.0.4-b515f1270 and 10.1.1.8-b509f1268 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes: https://qlustar.com/news/qsa-1024191-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-1024192-security-update-bundle A number of non-security related enhancements were also part of this update and will be introduced in a separate announcement.

1 0

[Qlustar-General] run command after boot as specific user
by ignas.bunikis＠scilifelab.uu.se 15 Jul '19

15 Jul '19

Hej, What would be the best way to execute command after boot, as a specific user, only on VFend? Cheers, iggy

2 2

[Qlustar-General] how to use roles to limit rights for some admins
by Rolandas 01 Jul '19

01 Jul '19

Hi, I want to limit rights for admins in qluman. I tried to create operator role and define minimal rights. I created user in qluman with such role and after connecting with him, I found it could do all admin tasks, even those denied by role rules. What I'm doing wrong ? Regards Rolandas

3 3

[Qlustar-General] cannot run updated qluman gui
by Rolandas 27 Jun '19

27 Jun '19

Hi, ERROR : Unknown image format/type: qluman-10.1.1.23-singularity.sqsh ABORT : Retval = 255 singularity-container package is from ubuntu 19.04 repository: 2.6.1-2 Previous version qluman-10.1.1.19-singularity.sqsh works. MD5/SHA256 were verified and are the same as in qlustar dowanload page. Regards, Rolandas

3 6

[Qlustar-General] Support for Intel MIC Xeon Phi
by Roberto Rey Expósito 27 Jun '19

27 Jun '19

Hi, I wonder if it is possible to have Xeon Phi hardware on a Qlustar-based cluster. I cannot see any module related with Xeon Phi during head node installation as it is the case for GPU or InfiniBand hardware, so the resulting CentOS image for compute nodes does not recognize the cards. Thanks, -- Roberto R. Expósito Grupo de Arquitectura de Computadores (GAC) Depto. Ingeniería de Computadores Universidade da Coruña (UDC)

2 3

[Qlustar-General] Qlustar server in HA mode
by darkhalf78＠gmail.com 25 Jun '19

25 Jun '19

Hello, sorry if the question has been already discussed in previous threads, but i was wondering if there is a guide on how to configure two physical servers in HA mode as stated in the Administration Manual "In case of a HA head-node setup, the second head-node becomes a NIS slave server. " I configured the second server as NIS slave, but i'm more interested into a redundant configuration with drbd for the whole server. I'm trying to configure drbd to mirror all the partitions/LV on the second server using LCMC but with no success. Any guide or hint is very welcome :) Thanks a lot !

2 1

[Qlustar-General] Qlustar 11 is out
by Roland Fehrenbacher 14 Jun '19

14 Jun '19

Check out the release notes at https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/Release_… Enjoy, Roland

1 0

[Qlustar-General] cannot start MPI jobs
by Rolandas 13 Jun '19

13 Jun '19

Hi, In fresh qlustar installation without infiniband we cannot start MPI jobs. Error message is long, but essential part is: [beo-01:19012] pmix_mca_base_component_repository_open: "mca_bfrops_v21" does not appear to be a valid bfrops MCA dynamic component (ignored): /usr/lib/openmpi/3.1.2/gcc/lib/openmpi/mca_pmix_ext2x.so: undefined symbol: mca_bfrops_v21_component. ret -1 Qlustar image for nodes have modules: core, slurm, ofed, lustre-client. UnionFS Chroot (xenial/10.1) is freshly installed without additional packages installed (dist-upgrade was executed). Regards, Rolandas

2 2

[Qlustar-General] Slurm srun & MPI
by Ansgar Esztermann-Kirchner 12 Jun '19

12 Jun '19

Hello List, according to https://slurm.schedmd.com/mpi_guide.html#intel_srun, srun should be able to lauch MPI jobs on its own. However, my test jobs fail with errors like these: Fatal error in PMPI_Init_thread: Other MPI error, error stack: MPIR_Init_thread(805).....: fail failed MPID_Init(1832)...........: channel initialization failed ... Prior to the above errors, I see: mdrun_mpi_AVX_256: /usr/lib/x86_64-linux-gnu/slurm/auth_munge.so: Incompatible Slurm plugin version (17.11.9) mdrun_mpi_AVX_256: /usr/lib/x86_64-linux-gnu/slurm/auth_munge.so: Incompatible Slurm plugin version (17.11.9) mdrun_mpi_AVX_256: error: Couldn't load specified plugin name for auth/munge: Incompatible plugin version mdrun_mpi_AVX_256: error: cannot create auth context for auth/munge Where mdrun_mpi_AVX_256 is my executable. I've regenerated qlustar images and rebooted the nodes, but to no avail. I've also checked that md5sums for auth_munge.so and slurmstepd match the ones given in /usr/lib/qlustar/modules/xenial-amd64/10.1.1/slurm.contents, and now I'm out of ideas. I gues it would be nice to know what slurm thinks the correct version is, but unfortunately, only the offending version is printed... Any ideas what I should try next? Thanks, A. -- Ansgar Esztermann Sysadmin Dep. Theoretical and Computational Biophysics http://www.mpibpc.mpg.de/grubmueller/esztermann

2 4

[Qlustar-General] Qlustar BoF at ISC 2019
by Roland Fehrenbacher 12 Jun '19

12 Jun '19

Hi, we are organizing a Birds of a feather session [1] at this years ISC (Wednesday, June 19th 2:45pm - 3:45pm, Room Kontrast). So if you're in Frankfurt next week, take the chance to join us. Best, Roland [1] https://2019.isc-program.com/?post_type=page&p=11&id=bof125&sess=sess237

1 0

[Qlustar-General] https://www.qlustar.com site problems with certificate chain
by Rolandas 04 Jun '19

04 Jun '19

Hi, On new installation of Firefox we cannot connect to https://www.qlustar.com. The cause is missing intermediate certificate in server certificate chain response. By using openssl s_client -connect www.qlustar.com:443 we can see very strange chain: Certificate chain 0 s:CN = www.qlustar.com i:C = US, O = Let's Encrypt, CN = Let's Encrypt Authority X3 1 s:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Domain Validation Secure Server CA i:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Certification Authority 2 s:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Certification Authority i:C = SE, O = AddTrust AB, OU = AddTrust External TTP Network, CN = AddTrust External CA Root Let's Encrypt have different intermediate certificate. Regards, Rolandas P.S. It also caused problems with wget/curl to download files from your site.

2 3

[Qlustar-General] Re: multipath in qlustar storage nodes
by Roland Fehrenbacher 24 May '19

24 May '19

>>>>> "R" == Rolandas <rolnas(a)gmail.com> writes: R> So we need to use /etc/qlustar/common/rc.boot and R> /etc/qlustar/common/image-files to configure nodes ? But I have R> already problem with rc.boot scripts, they run too late (for R> e.g. ZFS pool import for lustre I have to run hostid > R> /etc/hostid) or copy-files is run in parallel to lustre startup. You can apply the patch below to the generated image (use 'qlustar-image-edit -s <image name>' and type 'exit' when done). This will make spl use a hostid that doesn't change if the hardware of the machine doesn't change. The patch will be part of future releases. ----------------------------------------------------------------------------- diff --git a/sbin/init.qlustar b/sbin/init.qlustar --- a/core/image/common/sbin/init.qlustar +++ b/core/image/common/sbin/init.qlustar @@ -91,8 +91,13 @@ echo FIXME echo -e "### Starting Qlustar pre-systemd boot script /sbin/init.qlustar ###" -# generate the systemd machine id here +# generate the systemd machine id here ... systemd-machine-id-setup +# ... and also the hostid ... +hostid > /etc/hostid +# ... and generate a unique spl_host_id from it +echo "options spl spl_hostid=$(( 16#$(cat /etc/hostid) ))" >> \ + /etc/modprobe.d/spl.conf ----------------------------------------------------------------------------- R> But qlustar defines only one MAC address per host, but in the R> case if first link is down, PXE booting will run on second link R> with different MAC address. Adapter redundancy upon boot is unfortunately not supported.

2 1

[Qlustar-General] Trouble installing
by Ian Kaufman 23 May '19

23 May '19

Hi all, I have a server that already has Ubuntu 16.04 installed on a RAID 1 device (two SSDs, software RAID). When I try to run the latest installer (Qlustar 10.1.1-3) from a live dvd, it fails to boot with the following error: No supported filesystem images found at /live Looking in the boot.log, I see error reading /lib/udev/hwdb.bin: No such file or directory Do think that is a result of the drives being md devices? The initramfs kernel sees /dev/md* and /dev/md12[67] Thanks, Ian -- Ian Kaufman Research Systems Administrator UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu

3 14

[Qlustar-General] multipath in qlustar storage nodes
by Rolandas 22 May '19

22 May '19

Hi, What is recommended way to run multipath in qlustar headnode and qlustar storage nodes ? Regards, Rolandas

2 3

[Qlustar-General] bug in slurm-config
by Tobias Moehle 14 May '19

14 May '19

Dear all, I ran into two problems with the configuration of slurm: a) Among others, I have the nodes 'compute-0-0' and 'compute-1-0'; if I put them into a common partition, qluman writes 'compute-[0-1]-0'; but this format seems not readable for slurm. I am not sure if this is a bug of slurm or of qluman; but it requires manual reconfiguration. b) When I try to assign some new properties to the 'Node Groups', the fields 'Delete' and 'New Node Property' are grayed out; I can only add values to existing properties. Can you probably tell me, what is going on? Is it maybe an issue with my configuration somewhere? Many thanks in advance, Tobias Moehle

1 0

[Qlustar-General] Re: setup infiniband fails
by Tobias Moehle 13 May '19

13 May '19

Hello Roland, great; after the upgrade ib works perfectly. Thank you very much! Best regards > On 11.05.19 09:42, Roland Fehrenbacher wrote: >>>>>>> "T" == Tobias Moehle <tobias.moehle(a)uni-rostock.de> writes: >> Hi Tobias, >> >> please upgrade to the just released 10.1.1.4-b509f1240. Support for the >> IBA7322 was missing and has been readded. >> >> T> Dear all, On our cluster, we have some nodes with infiniband >> T> which I am trying to set up at the moment. >> >> T> After some time of struggeling, I finally understand: >> T> 1) The hardware is found: >> >> T> #lspci | grep fini 04:00.0 InfiniBand: QLogic >> T> Corp. IBA7322 QDR InfiniBand HCA (rev 02) >> T> 2) The kernel-modules(?) seem to be loaded: .................. >> >> T> Also, "the pre-defined hardware property IB Adapter with a value >> T> of true must be assigned to a host, to explicitly enable IB for >> T> it" >> >> This is not necessary anymore. Needs to be fixed in the docs. >> >> T> But in my hardware properties no "IB Adapter" is available (only >> T> #CPU cores, #CPU sockets, HW Type, Size of RAM and Chassis >> T> Color). I expect this to be the issue; but what is wrong there? >> >> This HW property is obsolete. Just follow >> >> https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/10.1/html-single/QluMan_G… >> >> >> to configure the IB network. >> >> Best, >> >> Roland >> _______________________________________________ >> Qlustar-General mailing list -- qlustar-general(a)qlustar.org >> To unsubscribe send an email to qlustar-general-leave(a)qlustar.org

1 0

[Qlustar-General] setup infiniband fails
by Tobias Moehle 11 May '19

11 May '19

Dear all, On our cluster, we have some nodes with infiniband which I am trying to set up at the moment. After some time of struggeling, I finally understand: 1) The hardware is found: #lspci | grep fini 04:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02) 2) The kernel-modules(?) seem to be loaded: #lsmod | grep ib_ ib_ipoib 122880 0 ib_cm 53248 2 rdma_cm,ib_ipoib ib_uverbs 90112 1 rdma_ucm ib_umad 28672 0 ib_core 217088 7 rdma_cm,ib_ipoib,iw_cm,ib_umad,rdma_ucm,ib_uverbs,ib_cm ipv6 405504 59 rdma_cm,ib_ipoib,ib_core #lsmod | grep verbs ib_uverbs 90112 1 rdma_ucm ib_core 217088 7 rdma_cm,ib_ipoib,iw_cm,ib_umad,rdma_ucm,ib_uverbs,ib_cm 3) but 'ibv_devices' gives an empty list, as well as ibstat etc. maybe helpful: #ibnodes ibwarn: [3220] mad_rpc_open_port: can't open UMAD port ((null):0) src/ibnetdisc.c:784; can't open MAD port ((null):0) /usr/sbin/ibnetdiscover: iberror: failed: discover failed ibwarn: [3225] mad_rpc_open_port: can't open UMAD port ((null):0) src/ibnetdisc.c:784; can't open MAD port ((null):0) /usr/sbin/ibnetdiscover: iberror: failed: discover failed From the qlustar-documentation ( https://qlustar.com/book/docs/qluman-guide#Configuring-IB) I know that I need to setup nodes that run OpenSM (Set Generic Property->OpenSM Ports->ALL); this I have, the service is running. Also, "the pre-defined hardware property IB Adapter with a value of true must be assigned to a host, to explicitly enable IB for it" But in my hardware properties no "IB Adapter" is available (only #CPU cores, #CPU sockets, HW Type, Size of RAM and Chassis Color). I expect this to be the issue; but what is wrong there? Any help is highly appreciated. Best regards, Tobias Moehle

2 1

[Qlustar-General] qlustar-initial-config fails on qluman db bootstrap
by rolnas＠gmail.com 06 May '19

06 May '19

Hi, In ~50% cases qlustar-initial-config failing in qluman bootstrap step with duplicate table errors, like "Table 'Nets' already exists". I'm using qlustar-installer-10.1.1-2 version. Regards, Rolandas

5 8

[Qlustar-General] Missing swap after qlustar installation
by rolnas＠gmail.com 03 May '19

03 May '19

Hi, I just installed from qlustar-installer-10.1.1-2.iso and installed head node is missing swap. By looking into FaiConfig.py inside of installer it doesn't define swap for FAI to create. swapSize is defined and calculated, but not used anywhere. Best regards, Rolandas

3 2

[Qlustar-General] node-configuration
by Tobias Moehle 02 May '19

02 May '19

Dear all, I'd like to report some trouble I had with the node configuration (qlustar v. 10.1.1-2): I tried to add some nfs-mount as described here: https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/10.1/html-single/Administ… However, the script was not executed. It took me quite a while to figure out that these scripts are run with 'run-parts' (see /lib/qlustar/nfs-rc for those who are interested) and this does not accepct stripts with '.sh' (see e.g. the first answer here: https://superuser.com/questions/719424/how-do-you-use-the-run-parts-command for some explanation). Probably it would be great to either use the '--regex'-option to circumvent this behaviour or at least to tell users about it? Moreover, I wondered if there is way to adjust the scripts in '/lib/qlustar/'? Unfortunately, I didn't find their place on the headnode. Best regards, Tobias Moehle

2 1

[Qlustar-General] Renaming slurm gres gpu type
by Bryan Hill 24 Apr '19

24 Apr '19

Hi All: Is there a preferred way to change the name of a GPU gres type in Qluman? For example, we have to use --gres=gpu:geforce-rtx-2080-ti:2 to request that specific model of GPU. I would like to simplify that to something like: --gres=gpu:2080ti:2 When I attempt to change the names from what the GPU Wizard had originally set up, it makes things go badly, in that the the gres resource is no longer recognized. Is there a clean way to do this? Thanks, Bryan

3 11

[Qlustar-General] QluMan containerization
by Hernán Morales Durand 01 Apr '19

01 Apr '19

Hello, I have a node where I've installed QluMan 10.1.1 so I can configure the Cluster using the GUI. Now this node is NOT added to the cluster (i.e. not currently booting any OS image) so it's somewhat "wasted". As far as I understood the OS images are executed in the nodes in RAM memory. So theoretically I could boot this node with an OS image and later mount the fs to try qluman-10.1.1.19-singularity.sqsh however I don't see how that could work because of lib compatibility. Is that correct/feasible? And I wonder if there is a container image already built specifically to run the qluman.sqsh application. I couldn't find none so far and I wanted to ask before starting to explore this path. What do you recommend? Cheers, Hernán

2 1

[Qlustar-General] HP Proliant DL360 G5 issues
by bscook999＠gmail.com 21 Mar '19

21 Mar '19

Hello. I'm having a lot of trouble getting the Qlustar 10.0 installer to recognize the the hard drives. During the installation process an error message comes up that there are no available hard drives and the FAI stops. HP Proliant DL360 G5 Smart Array P400i is working. I did a standard Ubuntu 18.04.2 Server LTS installation and the hard drives were recognized just fine. I'm not sure how to get the Qlustar to recognize it. Is it possible to install Qlustar from within ubuntu? I would prefer the automated installation process if possible to avoid errors, but if I can't get it to work. Please advise, thanks.

4 15

[Qlustar-General] Nodes won't boot
by Ansgar Esztermann-Kirchner 15 Mar '19

15 Mar '19

Hello List, recently, I've moved /apps to its own device. This invalidates NFS handles on the nodes, of course, so I started to reboot them. To my surprise, they don't come up again. The nodes complain about a time-out, "Failed to request QluMan node config in time", and ask me to check qlumand and qluman-route on the head. These two processes are indeed running. I've checked the logs, but couldn't fine anything helpful (to me) in there. qlumand seems to see the node briefly: 2019-03-05 11:45:06,615 [29219] INFO server.admin - Identifying node from '00-25-90-d9-08-86' 2019-03-05 11:45:06,617 [29219] INFO server.admin - Registering Execd 'node31-35' 2019-03-05 11:45:39,645 [29219] INFO server.admin - Execd '00-25-90-d9-08-86' disconnected I've attached the router log. There's one thing that's conspicuous, but it doesn't seem to be correlated with the nodes booting: a stack trace when accessing the database. I'll be grateful for any pointers. Thanks, A. -- Ansgar Esztermann Sysadmin Dep. Theoretical and Computational Biophysics http://www.mpibpc.mpg.de/grubmueller/esztermann

3 5

[Qlustar-General] NVidia driver
by Bryan Hill 13 Mar '19

13 Mar '19

Hello All! Is there a way to get a newer nvidia driver working with the current Qlustar 10.1.1? The nvidia module in the Qlustar repo is 390, and we just received some nodes with RTX2080 Ti cards, which require >= 410 I've tried installing inside of a chroot, but it doesn't want to work. Thanks, Bryan

3 9

[Qlustar-General] IPMI Power
by Ansgar Esztermann-Kirchner 01 Mar '19

01 Mar '19

Hello List, what is the preferred way to power control nodes? IPMI setup is done by qluman, but there does not seem to be a way to control nodes from the GUI. I've found ql-remote-control, but it complains about a missing config file, and I did not find an example file to explain its syntax. Thanks, A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

2 5

[Qlustar-General] Qlustar installation on HP Gen6 servers
by jorma.ojala＠iki.fi 15 Feb '19

15 Feb '19

Hi, Qlustar 10.1 installation failed on HP DL320 G6 server. The server has got 4 x 1TB disks, but the installer reported 'no unused disks'. I recall that the server has got the P410 RAID-controller on-board. I tried with different RAID configurations but with no luck. Maybe this is 'too old' hardware for Qlustar ? Cheers, Jorma

3 16

[Qlustar-General] Failed to run qluman-cli -bootstrap during second phase installation
by clavila＠gmail.com 25 Jan '19

25 Jan '19

Dear all, I am trying to install the latest version of Qlustar (10.1) in a server. During the first phase everything runs smoothly. During this stage I opted to run the front end on a VM. I have also setup manual network configurations for both cl-head and cl-fe. When I start the second phase after reboot by running qlustar-initial-config I get an error during qluman setup. To try to isolate the error, i ran the qlustar-initial-config -i -d (interactive and debug flags enabled). The output that I get is attached below. Any ideas on how to fix this? Cheers, Cesar run "qluman-cli --bootstrap" [n] Yes -- Starting Qluman bootstrap ... Base MAC for VMs: 02:00:99:99:99:00 -- Registering VM for frontend node ... Assigning MAC 02:00:99:99:99:fd to internal FrontEnd Node interface. Assigning MAC 02:01:99:99:9c:52 to external FrontEnd Node interface. -- Registering VMs for demo cluster ... Adding VM node beo-201: IP = 192.168.52.201, MAC = 02:00:99:99:99:c9 ###### Create some Enclosures ###### Create all Host/EnclosureSlots ###### Create some SpecPropNames ###### Create some spec Host Props ###### Create some GenPropNames ###### Create some GenProps ###### Create some GenPropSetNames ###### Create some GenPropSets ###### Create some HwPropNames ###### Create some HwProps Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 1470, in <module> main() File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 1461, in main bootstrap(config, db_data, cfg_gen) File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 1154, in bootstrap create_hw_props(d, ini_vals) File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 222, in create_hw_props db_data.insert(CT.TABLES.HwProp, prop_list) File "/usr/lib/python3/dist-packages/qluman-10/common/types.py", line 1760, in insert return table.insert(entries) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 96, in insert return self.insert(orig_entries, count = count + 1) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 96, in insert return self.insert(orig_entries, count = count + 1) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 96, in insert return self.insert(orig_entries, count = count + 1) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 98, in insert raise exn File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}]

5 4