- Qlustar General - Qlustar Mailing Lists

[Qlustar-General] Security/Bug fix releases 11.0.1.0-b519f1296 / 10.1.1.13-b521f1295
by Roland Fehrenbacher 30 May '20

30 May '20

The Qlustar releases 11.0.1.0-b519f1296 and 10.1.1.13-b521f1295 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes and special update instructions: https://qlustar.com/news/qsa-0527201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0527202-security-update-bundle

1 0

[Qlustar-General] CentOS 8 support has arrived
by Roland Fehrenbacher 20 Apr '20

20 Apr '20

CentOS 8 support is now available as a third Qlustar edge-platform and was published together with the latest security updates. It comes with the same functionality as our CentOS 7 port which includes out of the box OpenHPC 1.3.9 integration, Slurm 18.10.x, up-to-date Nvidia 340.x drivers, Lustre client and BeeGFS client. Making your compute nodes switch to CentOS 8 on an existing Qlustar cluster installation is extremely simple: First create a CentOS 8 chroot [1] optionally adding OpenHPC base support, then generate a CentOS 8 OS image [2] selecting the modules you require and finally a boot config [3] using the just generated image. After assigning [4] this boot config to the nodes you want to run it on, you just need to reboot them and voilà your CentOS 8 nodes are ready to be used. Note that OpenHPC 1.3.9 was originally built for CentOS 7.7. We had to make a few adjustments to make the OpenHPC parts relevant to Qlustar (compilers, MPIs, library packages and applications) work for CentOS 8. The OpenHPC test-suite was run successfully against these components. Once OpenHPC 2.0 will be out, we'll publish instructions to update to it. This will be straightforward. Additional improvements with this release: Updates to the latest Lustre 2.12.4 LTS release and the newest Nvidia graphics drivers 340.64 adding support for the latest Nvidia GPUs. These two updates apply to all Qlustar 11.0 platforms (Ubuntu 18.04 and CentOS 7/8). [1] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [2] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [3] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [4] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G…

2 2

[Qlustar-General] Trying to sort network interfaces: can I shell out in the installer?
by jarett＠bioteam.net 15 Apr '20

15 Apr '20

There are six relevant network interfaces on my head node, some of which are relevant and linked and some of which are not, and I can't tell which is which from the network interface names and am not on site to plug and unplug things. Is there some way to shell out, bring all the interfaces up and puzzle it out that way? TIA.

2 1

[Qlustar-General] Security/Bug fix releases 11.0.0.8-b518f1287 / 10.1.1.12-b521f1292
by Roland Fehrenbacher 14 Apr '20

14 Apr '20

The Qlustar releases 11.0.0.8-b518f1287 and 10.1.1.12-b521f1292 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes: https://qlustar.com/news/qsa-0406201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0406202-security-update-bundle The following non-security related enhancements/bug fixes are included: * Qlustar 11.0.0.8-b518f1287 updates to + the latest Lustre LTS release 2.12.4 + the latest Nvidia graphics drivers 440.64 supporting recently introduced Nvidia hardware

1 0

[Qlustar-General] Cannot add nodes from DHCP detect / how to authenticate users via Active Directory? / how to add my "scratch" NAS?
by Jarett DeAngelis 19 Feb '20

19 Feb '20

Hi folks, I was able to get my head node installed and can now boot it via the YUMI Linux installer USB. (I still don’t know why this is necessary, but hey, it works.) Now I have two issues: How do I add nodes to the cluster? I tried doing this with qluman-qt. I go to Manage Hosts and New Hosts, where it sees the MAC from one of my nodes. If I try to add it to the cluster I get a SQL error from Python about how it cannot insert a new record without the “status” field. Like so: If I click either “Add Selected” or “Add Host” here, I get this: Which seems to be generated from this SQL insert: The procedure for adding hosts actually doesn’t seem to be documented anywhere. I thought maybe I could try it from the command line, but there also doesn’t seem to be any documentation for the qluman-cli utility. I’m not entirely sure how the host abstraction works in Qlustar. My front-end/head node’s hostname is “argo,” yet the only thing in the host database visible in qluman-qt that seems to map to this is “beosrv-c.” Where did that name come from? The next steps I would like to get to are as follows: Add my two compute nodes to the cluster Add the NFS NAS I built to be a “scratch” filesystem available across all nodes Install some bioinformatics software (a good resource for this in Qlustar would be a big help) Make the cluster able to authenticate users via an Active Directory instance — I have a hard time understanding users in Qlustar. There is a very brief blurb in the administration guide about sssd.conf being replicated to each machine in the cluster, but the hostname in SSSD would have to be different for each node, so I don’t think that works for AD unless Qlustar is doing some kind of templating with the names. The other issue here is that when you join Linux machines to Active Directory and users log in, no entry is created in /etc/passwd, so if user process work is being kept track of with those, it won’t work. Unless the typical method for authenticating users is to use “plain” LDAP somehow without actually performing an AD join and just manually creating users that are then only authenticated against LDAP, and replicated between hosts normally because they’re “regular” UNIX users? That would also be fine; the problem here is that I can’t figure out how users are supposed to work. I added a user via qluman-qt and it appears not to have been added to /etc/passwd either, and since I have not yet configured SSSD I can’t figure out what those users are for. I can’t log in to SSH with them. I know that’s a lot at once; TIA. Jarett

2 1

[Qlustar-General] Re: Can't install
by Roland Fehrenbacher 19 Feb '20

19 Feb '20

>>>>> "J" == Jarett DeAngelis <jarett(a)bioteam.net> writes: J> I mean it just isn't an option. The attached is what I get if I J> turn UEFI options off entirely. It doesn't recognize the drive as J> bootable. If I turn UEFI options on, the USB drive is there, but J> of course doesn't work. Have you turned 'secure boot' off? If not please try that.

4 11

[Qlustar-General] Qlustar Feature Update 02/20
by Roland Fehrenbacher 13 Feb '20

13 Feb '20

A number of new Qlustar features were completed recently and published together with the latest security updates ([1], [2]). QluMan 11.0.3.1 has the following new capabilities: * The 'Write Files' dialog [3] got a complete revamp: + The configuration files/links belonging to different QluMan 'Config Classes' are now neatly arranged in a single collapsible tree-view. + Colored LEDs have been introduced to indicate whether pending changes of the config files are waiting to be written and which files are affected. + It is now straightforward to cycle through the list of changed files exclusively, allowing for a fast overview of pending changes in diff format. + Selecting individual Config Classes to be written has become a lot simpler by providing checkboxes in the tree-view. + Overall, the new dialog greatly enhances the clarity of the cluster configuration space. It provides way better control and confidence when performing configuration changes. * Messages for config file writing have been added to the QluMan Log Viewer [4]. * The so-called QluMan 'save-button interface' was improved and implemented for the editing of command names in the Command Editor. Now name labels turn green when changed and black after being saved, improving transparency. If you use QluMan singularity images, make sure you download [5] the latest version. [1] https://www.qlustar.com/news/qsa-0210201-linux-kernel-vulnerabilities [2] https://www.qlustar.com/news/qsa-0210202-security-update-bundle [3] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [4] https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/QluMan_G… [5] https://qlustar.com/download

1 0

[Qlustar-General] 2nd stage configuration failed at the first step.
by mohd.farid.ismail＠yandex.com 20 Jan '20

20 Jan '20

Hi, I'm having trouble getting pass the 1 boot process, which is to run /usr/sbin/qlustar-initial-config. After entering a name for the cluster, I always get the error HTTP access to the Qlustar repository is not possible Please check your curent network settings (received from DHCP): enp9s0: ..... Kernel IP routing table . . . Once you have made the required modifications, restart /usr/sbin/qlustar-initial-config! I can access the network (sshing to another machine), but cannot ping. It seems the DNS cannot be resolved (ping www.google.com results in the error "Temporary failure in name resolution.") Any hint on what I did wrong?

2 2

[Qlustar-General] Security/Bug fix releases 11.0.0.6-b515f1278 / 10.1.1.10-b509f1277
by Roland Fehrenbacher 09 Jan '20

09 Jan '20

The Qlustar releases 11.0.0.6-b515f1278 and 10.1.1.10-b509f1277 are ready including a number of security and bug fixes. Please check the following web pages for details about security fixes: https://qlustar.com/news/qsa-0109201-linux-kernel-vulnerabilities https://qlustar.com/news/qsa-0109202-security-update-bundle The following non-security related enhancements/bug fixes are included: * Qlustar 11.0.0.6-b515f1278 fixes a bug in disk setup configurations for netboot nodes using XFS on LVM

1 0

[Qlustar-General] upgrading qlustar from 10.1.1 to 11.0
by Tobias Moehle 08 Jan '20

08 Jan '20

Dear all, First of all I'd like to wish all developers/maintainers and users a happy new year and all the best. I know I am quite late with this topic, but other things distracted me so-far: I'd like to finally upgrade our cluster to 11.0. According to the upgrade instructions (https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/Release_…) it is more or less an apt distupgrade; but since there are a lot of changes and I have very bad experience trying to upgrade merely ubuntu-versions (which usually breaks), I can't believe it is so simple? So I'd like to ask whether it is really as simple and what your experiences are? Any caveats, things to keep in mind? Can I do it while calculations are running or should I rather wait for all of them to finish (we have run-times of months, therefore this is a thing in my case). Any advice/comment is very welcome. Best regards, Tobias

3 3

2025

2024

2023

2022

2021

2020

2019

2018

Qlustar General