- Qlustar General - Qlustar Mailing Lists

回复: about qlustar installation problems
by 李腾腾 17 Oct '23

17 Oct '23

Hi When I try to connect to QluMan, it prompts that I need to create a user and token, but I can't find how to create a user. Which command should I use to create a user? tli(a)singleparticle.cn 发件人：李腾腾发送时间： 2023-10-16 17:15 收件人： qlustar-general 主题： about qlustar installation problems hi I'm trying to install qlustar, but I'm running into several problems. 1. Can I allocate disk partitions myself? The default partitioning is not suitable for us. 2. How should I start or query FE node? I don’t know how to operate it when deploying "Spack Package Manager". Also, if I don’t need FE node, what will be the impact? Regards tli(a)singleparticle.cn

2 1

Security/Bug fix release 13.1.1
by no-reply-list＠qlustar.org 05 Oct '23

05 Oct '23

The Qlustar release 13.1.1 is ready including a fix for the recently discovered Looney Tunables bug. Please check the following web page for more details: https://qlustar.com/qsa/2023/1005231

1 0

Qlustar HPC Core Stack 23.09
by no-reply-list＠qlustar.org 04 Oct '23

04 Oct '23

The Qlustar team is pleased to announce the availability of the HPC Core Stack 23.09 for Qlustar 13. It was published together with the latest security bug fix update and can be installed by updating the Qlustar 13 chroots on the cluster, The HPC CORE STACK [1] was introduced with the release of Qlustar 13 as a new component definition within Qlustar. It is related to the introduction of Spack. This release includes the following individual major HPC core stack component updates: - Spack version 0.20.1 [2] - Slurm version 23.02.5 [3] - RDMA-Core version 47.0 [4] - HWloc version 2.9.3 [5] - UCX version 1.14.1 [6] The new version of Spack allows easy and direct access to the most recent compilers, MPIs and hundreds of other applications relevant to HPC. Minor version updates for other Qlustar 13 components are also included, in particular Lustre (2.15.3), ZFS (2.1.12) and the Nvidia graphics driver (535.104.05). [1] https://qlustar.com/about-qlustar/hpc-core-stack [2] https://spack.readthedocs.io/en/latest/ [3] https://www.schedmd.com//overview.html [4] https://github.com/linux-rdma/rdma-core [5] https://www.open-mpi.org/projects/hwloc/ [6] https://openucx.org/

1 0

Security/Bug fix releases 13.1.0, 12.0.3.0
by Roland Fehrenbacher 02 Oct '23

02 Oct '23

The Qlustar releases 13.1.0 and 12.0.3.0 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0929231 https://qlustar.com/qsa/2023/0929232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0: - Update to QluMan 13.3.3 For Qlustar 13 only: - Add a new containers image module (details to be announced separately) - Qlustar HPC Core Stack 09/23 update (details to be announced separately)

1 0

Security/Bug fix releases 13.0.6, 12.0.2.6
by no-reply-list＠qlustar.org 26 Jul '23

26 Jul '23

The Qlustar releases 13.0.6 and 12.0.2.6 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0726231 https://qlustar.com/qsa/2023/0726232 On the Qlustar Ubuntu platforms, this update includes a kernel mitigation for the Zenbleed security bug found on Zen2 AMD CPUs. Please note that no such fix is available on RHEL 7/8 compatible platforms (CentOS 7 / AlmaLinux 8 on Qlustar) at this stage.

1 0

slurmctld for Qlustar 10.1.1
by Lorenz Dettmann 06 Jul '23

06 Jul '23

Dear Sir or Madam, I am writing this E-Mail to you, because I am searching for a specific .deb package for slurmctld, which should run on a Qlustar OS version 10.1.1. After executing 'apt install slurmctld', I get the following error message: Err:1 http://repo.qlustar.com/repo/ubuntu 10.1-xenial/main amd64 slurmctld amd64 17.11.9.2-ql.3+10-xenial 404 Not Found E: Failed to fetch http://repo.qlustar.com/repo/ubuntu/pool/main/s/slurm-llnl/slurmctld_17.11.… 404 Not Found E: Unable to fetch some archives, maybe run apt-get update or try with --fix-missing? Indeed, this package for slurmctld with this specific version is not in this repository anymore. Is there any chance of getting it from somewhere else? Many thanks in advance. Best regards Lorenz Dettmann -- Lorenz Dettmann Institute of Physics University of Rostock Albert-Einstein-Straße 23 D-18059 Rostock Tel.: +49 381/498-6954 E-Mail:lorenz.dettmann@uni-rostock.de

2 1

Qluman Network Configuration
by Lorenz Dettmann 03 Jul '23

03 Jul '23

Dear Sir or Madam, I am writing this E-Mail to you, because I have problems with managing the Network Configs via QluMan. When clicking on the button [ New ], nothing happens and the following error occurs in the console: 2023-06-30 10:52:58,048 ERROR qlunet.Node Channel[('zmq_version_info', 16)].do_recv(): exception in request generator Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qlunet/Node.py", line 143, in do_recv args = next(self._generator) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/Networking/NetworkConfigsWidget.py", line 437, in new_NetConfigName dlg = NameDialog.make(title=title, label=label, table=self.cluster.db.net_config_names) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/Dialogs/NameDialog.py", line 32, in make w.conf(title=title, label=label, text=text, table=table, validator=validator) File "/usr/lib/python3/dist-packages/qluman-13/client/qt/Dialogs/NameDialog.py", line 53, in conf table.si_deleted.connect(self.validate) AttributeError: 'DBTableType' object has no attribute 'si_deleted' The Qlustar version is 13.0.0 and the QluMan version is 13.2.0. Could you please help me with this issue? Best regards Lorenz Dettmann -- Lorenz Dettmann Institute of Physics University of Rostock Albert-Einstein-Straße 23 D-18059 Rostock Tel.: +49 381/498-6954 E-Mail:lorenz.dettmann@uni-rostock.de

2 1

Security/Bug fix releases 13.0.5, 12.0.2.5
by no-reply-list＠qlustar.org 01 Jul '23

01 Jul '23

The Qlustar releases 13.0.5 and 12.0.2.5 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0629231 https://qlustar.com/qsa/2023/0629232 https://qlustar.com/qsa/2023/0629233 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0: - Update to QluMan 13.2.1 - Fix a file descriptor leak affecting qluman-execd - Add libnvidia-container to the NVIDIA image module

1 0

End-of-Life for Qlustar 11
by no-reply-list＠qlustar.org 27 Jun '23

27 Jun '23

This is to inform you that with the latest security release, Qlustar 11 has reached its end-of-life and will receive no further updates of any kind. Please update your clusters to Qlustar 13 and be aware that you will have to move first to Qlustar 12 and then do the update to Qlustar 13. This is the only supported upgrade path. Good luck!

1 0

Qlustar Feature Update 06/23
by no-reply-list＠qlustar.org 15 Jun '23

15 Jun '23

A number of new Qlustar features were completed recently and published together with the latest security updates. Version 13.2.0 further improves QluMan with the addition of: - An informative HOST OVERVIEW TABLE [1]. It provides a tabular overview of all the hosts in a cluster split by networks. Tabs at the top allow to select the network one is interested in. In each tab, the IP ranges allocated in the chosen network are shown at the top and a list of hosts with their most important config parameters below. An on-the-fly string/regex filter can be applied to the lists restricting the view to the hosts matched. - New GUI options to fine-tune the LDAP PASSWORD POLICY [2]. This makes it easy to control user password quality and protection against brute-force attacks with appropriate settings. - The possibility to ASSIGN A LUSTRE LNET NAME [3] to the network adapters of nodes and generate a new config file to bring up LNet during boot of Lustre nodes. - The automatic creation of a new configuration file during boot that lists a node's QluMan Generic Properties and their values. This allows to use freely definable Generic Properties as a general key/value store in customization scripts on Qlustar nodes. AlmaLinux was updated to version 8.8 with this release. [1] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Adding-Hosts.htm… [2] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/components/ldap.… [3] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Cluster-Network-…

1 0

Security/Bug fix releases 13.0.4, 12.0.2.4, 11.0.1.23
by no-reply-list＠qlustar.org 14 Jun '23

14 Jun '23

The Qlustar releases 13.0.4, 12.0.2.4 and 11.0.1.23 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0614231 https://qlustar.com/qsa/2023/0614232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 and 12.0 only: - Update to QluMan 13.2.0 For Qlustar 13 only: - Update to AlmaLinux 8.8

1 0

Security/Bug fix releases 13.0.3, 12.0.2.3, 11.0.1.22
by Qlustar List 24 Apr '23

24 Apr '23

The Qlustar releases 13.0.3, 12.0.2.3 and 11.0.1.22 are ready including a number of security/bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0424231 https://qlustar.com/qsa/2023/0424232 https://qlustar.com/qsa/2023/0424233

1 0

Re: Password sync for ldap users.
by Beethoven Santos 03 Apr '23

03 Apr '23

This is also happening to me from time to time. But in my case, I added users through Qluman, as described in the docs. These are the last lines of the /var/log/auth.log file on the FE node, right after the login attempt. ... > sshd[9118]: pam_unix(sshd:auth): authentication failure; logname= uid=0 > euid=0 tty=ssh ruser= rhost=10.0.2.159 user=********* > sshd[9118]: pam_sss(sshd:auth): authentication failure; logname= uid=0 > euid=0 tty=ssh ruser= rhost=10.0.2.159 user=********* > sshd[9118]: pam_sss(sshd:auth): received for user *********: 7 > (Authentication failure) > sshd[9118]: Failed password for ********* from 10.0.2.159 port 40398 ssh2 I've omitted the username and the timestamps and hostname columns from the lines above. Does anyone have any clue what might be going on? Do I need to show anything else? --- Qlustar Version: *12* Head-Node Kernel Version: *5.13.19-051319-generic* QluMan Server Version: *12.0.7.5* Image (FE) Kernel Version: *5.4.209-ql-generic-12.0-19* Image (FE) Version: *Qlustar 12.0.1.0-b548f1441*

2 1

Qlustar Feature Update 03/23
by Qlustar List 29 Mar '23

29 Mar '23

A number of new Qlustar features were completed recently and published together with the latest security updates. QluMan 13.1.0 highly improves on its Host Filter capabilities: - NEW FILTERS [1] for Property/Config sets, Property/Config types and Property/Config values have been added. These filters make it much easier to select correct groups of hosts for re-configurations or command execution especially on large in-homogeneous clusters. - COMMAND EXECUTION OR HOST SELECTION [2] using filters temporarily defined on-the-fly is now possible directly from the Host Filter dialog. This helps a lot in quickly checking on a group of nodes based on any configuration criteria. The Qlustar documentation has been expanded: - An HPC ADMIN MANUAL [3] has been added. It explains the recently introduced Qlustar HPC Core Stack and gives a detailed introduction to package management using SPACK [4]. - A section about WORKING WITH SPACK [5] has been added to the HPC USER MANUAL [6]. [1] https://docs.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Host-Filters.htm… [2] http://docs-dev.qlustar.com/Qlustar/13/ClusterOS/qluman-guide/Host-Filters.… [3] https://docs.qlustar.com/Qlustar/13/HPCstack/hpc-admin-manual.html [4] https://spack.readthedocs.io/en/latest/ [5] https://docs.qlustar.com/Qlustar/13/HPCstack/hpc-user-manual.html#chap-hpc-… [6] https://docs.qlustar.com/Qlustar/13/HPCstack/hpc-user-manual.html

1 0

Security/Bug fix releases 13.0.2, 12.0.2.2, 11.0.1.21
by Qlustar List 27 Mar '23

27 Mar '23

The Qlustar releases 13.0.2, 12.0.2.2 and 11.0.1.21 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0325231 https://qlustar.com/qsa/2023/0325232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to MLNX OFED 5.8-2.0.3.0 For Qlustar 13 and 12.0 only: - Update to QluMan 13.1.0 - Update Nvidia drivers to 525.89.02

1 0

Security/Bug fix releases 13.0.1, 12.0.2.1, 11.0.1.20
by Qlustar List 18 Feb '23

18 Feb '23

The Qlustar releases 13.0.1, 12.0.2.1 and 11.0.1.20 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2023/0216231 https://qlustar.com/qsa/2023/0216232 The following non-security related updates/enhancements/bug fixes are included: For Qlustar 13 only: - Update to MLNX OFED 5.8-1.1.2.1 For Qlustar 13 and 12.0 only: - Update to QluMan 13.0.4 - Update to Lustre 2.15.2 - Update to ZFS 2.1.9

1 0

One more present from Santa - Qlustar 13
by Qlustar List 29 Dec '22

29 Dec '22

The Qlustar team is pleased to announce the immediate availability of Qlustar 13 for download [1]. It updates Qlustar's core platform to current Ubuntu 22.04 LTS. The AlmaLinux [2] edge platform remains based on 8.6 while CentOS 7 [3] is still supported via Qlustar 12 images and the new cross-version compatibility. The highlights of this release are the addition of BMC hardware management via IPMI/Redfish in QluMan, the integration of Spack as the new HPC package manager and the cross-version compatibility between Qlustar releases. QluMan's new *BMC hardware management* support allows for BMC authentification management, power control of nodes via IPMI or Redfish, the display of BIOS settings as well as their validation and correction. A cumulative problem report showing an overview of cluster node misconfigurations has also been added to QluMan. Spack [4] has been introduced as the new package manager for HPC related application software beyond the so-called *Qlustar HPC core stack*. It offers a huge list of supported software packages and by design provides hardware optimized versions of them. The HPC core stack is a new component definition within Qlustar and is related to the introduction of Spack. Rather than aiming to provide as much HPC functionality as possible by OS packages (debs/rpms), the HPC core stack now makes a clear cut between Qlustar related system software which remains provided as OS packages and HPC application software. Starting with this release, *cross-version compatibility* between the current and the previous Qlustar release has been added. In practice this means, that on a cluster with a Qlustar 13 head-node you can still run nodes with Qlustar 12 images/chroots and vice versa. This new feature was added to allow even smoother release upgrades. Highlights among the various *major component updates* include Kernel 5.15.x, Slurm 22.05.x, Lustre 2.15.1, ZFS 2.1.6 and BeeGFS 7.3.2. Please read the release notes [5] for more details. [1] https://qlustar.com/download/ [2] https://almalinux.org/ [3] https://www.centos.org/ [4] https://spack.readthedocs.io/en/latest/ [5] https://docs.qlustar.com/Qlustar/13/ClusterOS/release-notes.html

1 0

Is it possible to add modules to qlustar linux kernel?
by pierre-yves.boelle＠upmc.fr 20 Dec '22

20 Dec '22

Hi all, I'm trying to set up Qlustar 12.0 with ubuntu focal on a HP machine equiped with a smart array controller P816i-a. The problem is that the smart array is not recognized after install: I can see it with lspci, but the disks are not listed in /dev. As far as I understand, this is a driver issue : the smartpqi module is required for this smart array. This module is available from "linux-modules-extra" in ubuntu focal 20.04, but this package is not part of the qlustar distribution. So questions : 1 - Is there a way I can simply add a required module (for example .ko file) in the qlustar kernel and simply recompile the qlustar kernel? 2 - failing that, should I expect trouble running qlustar with a "pure ubuntu" kernel ? If I add the focal repository in apt sources and install linux-modules-extra, I can build a new kernel OK, but it is "pure ubuntu" - not qlustar. Is qlustar kernel just a light version of the ubuntu kernel and that's ok? or does qlustar include extra components ? Any input appreciated PYB

2 4

Security/Bug fix releases 12.0.2.0-b556f1460/11.0.1.19-b549f1462
by Qlustar List 20 Dec '22

20 Dec '22

The Qlustar releases 12.0.2.0-b556f1460 and 11.0.1.19-b549f1462 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/1219221 https://qlustar.com/qsa/2022/1219222 The following non-security related updates/enhancements/bug fixes are included: For 12.0 only: - Update to QluMan 13.0.2 (check the upcoming Qlustar 13 release notes for a description of new features) - Update Nvidia drivers to 515.86.01 - Update to pmix 4.1.2 - Update to slurm 22.05.6 - Update to ucx 1.13.0 - Update to ZFS 2.1.6

1 0

apt, lost in a maze after recent update.
by Gerhard W. Recher 21 Nov '22

21 Nov '22

Hi Qlustar fellows! I recently installed update to qlustar 12, but got a problem with nvidia stuff.... i have no idea how to clean up this mess... help is apprechiated ! apt-get dist-upgrade Reading package lists... Done Building dependency tree Reading state information... Done You might want to run 'apt --fix-broken install' to correct these. The following packages have unmet dependencies: libucx0 : Depends: libcudart11 (>= 11.7.1-ql.1) but it is not installed E: Unmet dependencies. Try 'apt --fix-broken install' with no packages (or specify a solution). 100 root@biocrunch2 ~ # apt --fix-broken install Reading package lists... Done Building dependency tree Reading state information... Done Correcting dependencies... Done The following packages were automatically installed and are no longer required: libcudart11.0 linux-image-5.4.134-ql-generic-12.0-10 zfs-modules-5.4.134-ql-generic-12.0-10 Use 'apt autoremove' to remove them. The following additional packages will be installed: libcudart11 The following NEW packages will be installed: libcudart11 0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded. 103 not fully installed or removed. Need to get 0 B/168 kB of archives. After this operation, 800 kB of additional disk space will be used. Do you want to continue? [Y/n] y (Reading database ... 95268 files and directories currently installed.) Preparing to unpack .../libcudart11_11.7.1-ql.1+12-focal_amd64.deb ... Unpacking libcudart11:amd64 (11.7.1-ql.1+12-focal) ... dpkg: error processing archive /var/cache/apt/archives/libcudart11_11.7.1-ql.1+12-focal_amd64.deb (--unpack): trying to overwrite '/usr/lib/x86_64-linux-gnu/libcudart.so.11.0', which is also in package libcudart11.0:amd64 11.0.3-ql.4+12-focal Errors were encountered while processing: /var/cache/apt/archives/libcudart11_11.7.1-ql.1+12-focal_amd64.deb E: Sub-process /usr/bin/dpkg returned an error code (1) -- Gerhard W. Recher net4sec UG (haftungsbeschränkt) Leitenweg 6 86929 Penzing +49 8191 4283888 +49 171 4802507

3 2

Modifyint timesyncd.conf
by garroyo＠ifimar-conicet.gob.ar 09 Nov '22

09 Nov '22

Hi! I tried to edit /etc/systemd/timesyncd.conf to add fallbackntp but always changes to the default file that only has one line for one server I tried to edit the files in nodes by using the command to edit images: qlustar-image-edit -e Standard-focal /etc/systemd/timesyncd.conf I tried also with chroot-focal Maybe someone could know how to do it, thanks!

1 0

Security/Bug fix releases 12.0.1.1-b548f1445 / 11.0.1.18-b549f1444
by Qlustar List 29 Oct '22

29 Oct '22

The Qlustar releases 12.0.1.1-b548f1445 and 11.0.1.18-b549f1444 are ready including a number of security/bug fixes and improvements. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/qsa/2022/1029221 https://qlustar.com/qsa/2022/1029222

1 0

Install Gaussian 16
by yohann.clement＠univ-lyon1.fr 19 Oct '22

19 Oct '22

Hello, I'm trying to install Gaussain 16 on Qlustar. I have some troubles to install it due to some right management. Indeed, Gaussian does not allow the directory on which it is installed to be accessible to others. The director should only be accessible to the owner and a group. I have created a group called gauss with Qluman in which I have added a user for a test. But the created group is not recognized in Chroot-focal. Could you tell me if you alreeady have installed G16 in Qlustar. If so could you kindly send me the procedure. Best,

2 3

Qlustar 12 and openmpi 4.0
by rolandas.naujikas＠mif.vu.lt 03 Oct '22

03 Oct '22

Hi, In my cluster I found problems running some MPI applications (for e.g. via mpi4py) and it is related to defaults in /etc/openmpi/4.0/openmpi-mca-params.conf. When I changed btl to ^openib or to vader,selft,tcp (in case tcp nodes) - it started to work, but in this case it doesn't use UCX anymore. Regards Rolandas

1 0

centos8/AlmaLinux chroot has no repos
by deroshia＠uga.edu 19 Aug '22

19 Aug '22

Hi All, Either with a fresh install of the latest Qlustar or when creating a centos8 chroot in Qluman (or with manage-qlustar-chroot), I see the following errors and no /etc/yum.repos.d directory is created: [Harmless] Failed to find download link for qlustar-12.0-base [Harmless] Failed to find download link for qlustar-12.0-repos Running post-install script /usr/lib/rinse/qlustar-12.0-centos8/post-install.sh: error: /etc/pki/rpm-gpg/RPM-GPG-KEY-AlmaLinux: import read failed(2). error: /etc/pki/rpm-gpg/RPM-GPG-KEY-EPEL-8: import read failed(2). error: /etc/pki/rpm-gpg/RPM-GPG-KEY-QLUSTAR: import read failed(2). error: /etc/pki/rpm-gpg/RPM-GPG-KEY-OpenHPC-2: import read failed(2). Running dnf makecache Unable to detect release version (use '--releasever' to specify release version) post-install.sh : done. Installation complete. == Done with basic chroot. Starting to add extra packages ... == Unable to detect release version (use '--releasever' to specify release version) Error: There are no enabled repositories in "/etc/yum.repos.d", "/etc/yum/repos.d", "/etc/distro.repos.d". ========= ------- Error ------- ========= manage-qlustar-chroot: Execution in chroot "/srv/apps/chroots/centos8" failed: /usr/bin/yum -y install bash-completion git man ql-hpl-tools redhat-lsb-core singularity telnet unzip zip lmod-defaults-gnu9-openmpi4-ohpc ssmtp ==> Exiting ... Poking around in the repos site, I can see qlustar-12.0-base and qlustar-12.0-repos in an older directory, but not in the AlmaLinux repo directory. If I download and copy those older rpms into the chroot and install them, then re-run the install chroot command with the overwrite option, I can get the chroot to complete without errors: rpm -ivh qlustar-12.0-repos-12.0.0.7-1.ql.el8.noarch.rpm qlustar-12.0-base-12.0.0.7-1.ql.el8.noarch.rpm manage-qlustar-chroot -v -a create -A 'amd64' -b '/srv/apps/chroots' -d 'centos' -n centos8 -r '12.0' -s 'centos8' --openhpc --overwrite Have any of you been able to set up a centos8 chroot successfully with a new install using the qlustar-installer-12.0.1-0.iso? Thanks in advance, Jeff

2 1

2025

2024

2023

2022

2021

2020

2019

2018

Qlustar General