- Qlustar General - Qlustar Mailing Lists

[Qlustar-General] Trouble installing
by Ian Kaufman 23 May '19

23 May '19

Hi all, I have a server that already has Ubuntu 16.04 installed on a RAID 1 device (two SSDs, software RAID). When I try to run the latest installer (Qlustar 10.1.1-3) from a live dvd, it fails to boot with the following error: No supported filesystem images found at /live Looking in the boot.log, I see error reading /lib/udev/hwdb.bin: No such file or directory Do think that is a result of the drives being md devices? The initramfs kernel sees /dev/md* and /dev/md12[67] Thanks, Ian -- Ian Kaufman Research Systems Administrator UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu

3 14

[Qlustar-General] multipath in qlustar storage nodes
by Rolandas 22 May '19

22 May '19

Hi, What is recommended way to run multipath in qlustar headnode and qlustar storage nodes ? Regards, Rolandas

2 3

[Qlustar-General] bug in slurm-config
by Tobias Moehle 14 May '19

14 May '19

Dear all, I ran into two problems with the configuration of slurm: a) Among others, I have the nodes 'compute-0-0' and 'compute-1-0'; if I put them into a common partition, qluman writes 'compute-[0-1]-0'; but this format seems not readable for slurm. I am not sure if this is a bug of slurm or of qluman; but it requires manual reconfiguration. b) When I try to assign some new properties to the 'Node Groups', the fields 'Delete' and 'New Node Property' are grayed out; I can only add values to existing properties. Can you probably tell me, what is going on? Is it maybe an issue with my configuration somewhere? Many thanks in advance, Tobias Moehle

1 0

[Qlustar-General] Re: setup infiniband fails
by Tobias Moehle 13 May '19

13 May '19

Hello Roland, great; after the upgrade ib works perfectly. Thank you very much! Best regards > On 11.05.19 09:42, Roland Fehrenbacher wrote: >>>>>>> "T" == Tobias Moehle <tobias.moehle(a)uni-rostock.de> writes: >> Hi Tobias, >> >> please upgrade to the just released 10.1.1.4-b509f1240. Support for the >> IBA7322 was missing and has been readded. >> >> T> Dear all, On our cluster, we have some nodes with infiniband >> T> which I am trying to set up at the moment. >> >> T> After some time of struggeling, I finally understand: >> T> 1) The hardware is found: >> >> T> #lspci | grep fini 04:00.0 InfiniBand: QLogic >> T> Corp. IBA7322 QDR InfiniBand HCA (rev 02) >> T> 2) The kernel-modules(?) seem to be loaded: .................. >> >> T> Also, "the pre-defined hardware property IB Adapter with a value >> T> of true must be assigned to a host, to explicitly enable IB for >> T> it" >> >> This is not necessary anymore. Needs to be fixed in the docs. >> >> T> But in my hardware properties no "IB Adapter" is available (only >> T> #CPU cores, #CPU sockets, HW Type, Size of RAM and Chassis >> T> Color). I expect this to be the issue; but what is wrong there? >> >> This HW property is obsolete. Just follow >> >> https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/10.1/html-single/QluMan_G… >> >> >> to configure the IB network. >> >> Best, >> >> Roland >> _______________________________________________ >> Qlustar-General mailing list -- qlustar-general(a)qlustar.org >> To unsubscribe send an email to qlustar-general-leave(a)qlustar.org

1 0

[Qlustar-General] setup infiniband fails
by Tobias Moehle 11 May '19

11 May '19

Dear all, On our cluster, we have some nodes with infiniband which I am trying to set up at the moment. After some time of struggeling, I finally understand: 1) The hardware is found: #lspci | grep fini 04:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02) 2) The kernel-modules(?) seem to be loaded: #lsmod | grep ib_ ib_ipoib 122880 0 ib_cm 53248 2 rdma_cm,ib_ipoib ib_uverbs 90112 1 rdma_ucm ib_umad 28672 0 ib_core 217088 7 rdma_cm,ib_ipoib,iw_cm,ib_umad,rdma_ucm,ib_uverbs,ib_cm ipv6 405504 59 rdma_cm,ib_ipoib,ib_core #lsmod | grep verbs ib_uverbs 90112 1 rdma_ucm ib_core 217088 7 rdma_cm,ib_ipoib,iw_cm,ib_umad,rdma_ucm,ib_uverbs,ib_cm 3) but 'ibv_devices' gives an empty list, as well as ibstat etc. maybe helpful: #ibnodes ibwarn: [3220] mad_rpc_open_port: can't open UMAD port ((null):0) src/ibnetdisc.c:784; can't open MAD port ((null):0) /usr/sbin/ibnetdiscover: iberror: failed: discover failed ibwarn: [3225] mad_rpc_open_port: can't open UMAD port ((null):0) src/ibnetdisc.c:784; can't open MAD port ((null):0) /usr/sbin/ibnetdiscover: iberror: failed: discover failed From the qlustar-documentation ( https://qlustar.com/book/docs/qluman-guide#Configuring-IB) I know that I need to setup nodes that run OpenSM (Set Generic Property->OpenSM Ports->ALL); this I have, the service is running. Also, "the pre-defined hardware property IB Adapter with a value of true must be assigned to a host, to explicitly enable IB for it" But in my hardware properties no "IB Adapter" is available (only #CPU cores, #CPU sockets, HW Type, Size of RAM and Chassis Color). I expect this to be the issue; but what is wrong there? Any help is highly appreciated. Best regards, Tobias Moehle

2 1

[Qlustar-General] qlustar-initial-config fails on qluman db bootstrap
by rolnas＠gmail.com 06 May '19

06 May '19

Hi, In ~50% cases qlustar-initial-config failing in qluman bootstrap step with duplicate table errors, like "Table 'Nets' already exists". I'm using qlustar-installer-10.1.1-2 version. Regards, Rolandas

5 8

[Qlustar-General] Missing swap after qlustar installation
by rolnas＠gmail.com 03 May '19

03 May '19

Hi, I just installed from qlustar-installer-10.1.1-2.iso and installed head node is missing swap. By looking into FaiConfig.py inside of installer it doesn't define swap for FAI to create. swapSize is defined and calculated, but not used anywhere. Best regards, Rolandas

3 2

[Qlustar-General] node-configuration
by Tobias Moehle 02 May '19

02 May '19

Dear all, I'd like to report some trouble I had with the node configuration (qlustar v. 10.1.1-2): I tried to add some nfs-mount as described here: https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/10.1/html-single/Administ… However, the script was not executed. It took me quite a while to figure out that these scripts are run with 'run-parts' (see /lib/qlustar/nfs-rc for those who are interested) and this does not accepct stripts with '.sh' (see e.g. the first answer here: https://superuser.com/questions/719424/how-do-you-use-the-run-parts-command for some explanation). Probably it would be great to either use the '--regex'-option to circumvent this behaviour or at least to tell users about it? Moreover, I wondered if there is way to adjust the scripts in '/lib/qlustar/'? Unfortunately, I didn't find their place on the headnode. Best regards, Tobias Moehle

2 1

[Qlustar-General] Renaming slurm gres gpu type
by Bryan Hill 24 Apr '19

24 Apr '19

Hi All: Is there a preferred way to change the name of a GPU gres type in Qluman? For example, we have to use --gres=gpu:geforce-rtx-2080-ti:2 to request that specific model of GPU. I would like to simplify that to something like: --gres=gpu:2080ti:2 When I attempt to change the names from what the GPU Wizard had originally set up, it makes things go badly, in that the the gres resource is no longer recognized. Is there a clean way to do this? Thanks, Bryan

3 11

[Qlustar-General] QluMan containerization
by Hernán Morales Durand 01 Apr '19

01 Apr '19

Hello, I have a node where I've installed QluMan 10.1.1 so I can configure the Cluster using the GUI. Now this node is NOT added to the cluster (i.e. not currently booting any OS image) so it's somewhat "wasted". As far as I understood the OS images are executed in the nodes in RAM memory. So theoretically I could boot this node with an OS image and later mount the fs to try qluman-10.1.1.19-singularity.sqsh however I don't see how that could work because of lib compatibility. Is that correct/feasible? And I wonder if there is a container image already built specifically to run the qluman.sqsh application. I couldn't find none so far and I wanted to ask before starting to explore this path. What do you recommend? Cheers, Hernán

2 1

2025

2024

2023

2022

2021

2020

2019

2018

Qlustar General