- Qlustar General - Qlustar Mailing Lists

[Qlustar-General] Qlustar 11 is out
by Roland Fehrenbacher 14 Jun '19

14 Jun '19

Check out the release notes at https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/11.0/html-single/Release_… Enjoy, Roland

1 0

[Qlustar-General] cannot start MPI jobs
by Rolandas 13 Jun '19

13 Jun '19

Hi, In fresh qlustar installation without infiniband we cannot start MPI jobs. Error message is long, but essential part is: [beo-01:19012] pmix_mca_base_component_repository_open: "mca_bfrops_v21" does not appear to be a valid bfrops MCA dynamic component (ignored): /usr/lib/openmpi/3.1.2/gcc/lib/openmpi/mca_pmix_ext2x.so: undefined symbol: mca_bfrops_v21_component. ret -1 Qlustar image for nodes have modules: core, slurm, ofed, lustre-client. UnionFS Chroot (xenial/10.1) is freshly installed without additional packages installed (dist-upgrade was executed). Regards, Rolandas

2 2

[Qlustar-General] Slurm srun & MPI
by Ansgar Esztermann-Kirchner 12 Jun '19

12 Jun '19

Hello List, according to https://slurm.schedmd.com/mpi_guide.html#intel_srun, srun should be able to lauch MPI jobs on its own. However, my test jobs fail with errors like these: Fatal error in PMPI_Init_thread: Other MPI error, error stack: MPIR_Init_thread(805).....: fail failed MPID_Init(1832)...........: channel initialization failed ... Prior to the above errors, I see: mdrun_mpi_AVX_256: /usr/lib/x86_64-linux-gnu/slurm/auth_munge.so: Incompatible Slurm plugin version (17.11.9) mdrun_mpi_AVX_256: /usr/lib/x86_64-linux-gnu/slurm/auth_munge.so: Incompatible Slurm plugin version (17.11.9) mdrun_mpi_AVX_256: error: Couldn't load specified plugin name for auth/munge: Incompatible plugin version mdrun_mpi_AVX_256: error: cannot create auth context for auth/munge Where mdrun_mpi_AVX_256 is my executable. I've regenerated qlustar images and rebooted the nodes, but to no avail. I've also checked that md5sums for auth_munge.so and slurmstepd match the ones given in /usr/lib/qlustar/modules/xenial-amd64/10.1.1/slurm.contents, and now I'm out of ideas. I gues it would be nice to know what slurm thinks the correct version is, but unfortunately, only the offending version is printed... Any ideas what I should try next? Thanks, A. -- Ansgar Esztermann Sysadmin Dep. Theoretical and Computational Biophysics http://www.mpibpc.mpg.de/grubmueller/esztermann

2 4

[Qlustar-General] Qlustar BoF at ISC 2019
by Roland Fehrenbacher 12 Jun '19

12 Jun '19

Hi, we are organizing a Birds of a feather session [1] at this years ISC (Wednesday, June 19th 2:45pm - 3:45pm, Room Kontrast). So if you're in Frankfurt next week, take the chance to join us. Best, Roland [1] https://2019.isc-program.com/?post_type=page&p=11&id=bof125&sess=sess237

1 0

[Qlustar-General] https://www.qlustar.com site problems with certificate chain
by Rolandas 04 Jun '19

04 Jun '19

Hi, On new installation of Firefox we cannot connect to https://www.qlustar.com. The cause is missing intermediate certificate in server certificate chain response. By using openssl s_client -connect www.qlustar.com:443 we can see very strange chain: Certificate chain 0 s:CN = www.qlustar.com i:C = US, O = Let's Encrypt, CN = Let's Encrypt Authority X3 1 s:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Domain Validation Secure Server CA i:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Certification Authority 2 s:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Certification Authority i:C = SE, O = AddTrust AB, OU = AddTrust External TTP Network, CN = AddTrust External CA Root Let's Encrypt have different intermediate certificate. Regards, Rolandas P.S. It also caused problems with wget/curl to download files from your site.

2 3

[Qlustar-General] Re: multipath in qlustar storage nodes
by Roland Fehrenbacher 24 May '19

24 May '19

>>>>> "R" == Rolandas <rolnas(a)gmail.com> writes: R> So we need to use /etc/qlustar/common/rc.boot and R> /etc/qlustar/common/image-files to configure nodes ? But I have R> already problem with rc.boot scripts, they run too late (for R> e.g. ZFS pool import for lustre I have to run hostid > R> /etc/hostid) or copy-files is run in parallel to lustre startup. You can apply the patch below to the generated image (use 'qlustar-image-edit -s <image name>' and type 'exit' when done). This will make spl use a hostid that doesn't change if the hardware of the machine doesn't change. The patch will be part of future releases. ----------------------------------------------------------------------------- diff --git a/sbin/init.qlustar b/sbin/init.qlustar --- a/core/image/common/sbin/init.qlustar +++ b/core/image/common/sbin/init.qlustar @@ -91,8 +91,13 @@ echo FIXME echo -e "### Starting Qlustar pre-systemd boot script /sbin/init.qlustar ###" -# generate the systemd machine id here +# generate the systemd machine id here ... systemd-machine-id-setup +# ... and also the hostid ... +hostid > /etc/hostid +# ... and generate a unique spl_host_id from it +echo "options spl spl_hostid=$(( 16#$(cat /etc/hostid) ))" >> \ + /etc/modprobe.d/spl.conf ----------------------------------------------------------------------------- R> But qlustar defines only one MAC address per host, but in the R> case if first link is down, PXE booting will run on second link R> with different MAC address. Adapter redundancy upon boot is unfortunately not supported.

2 1

[Qlustar-General] Trouble installing
by Ian Kaufman 23 May '19

23 May '19

Hi all, I have a server that already has Ubuntu 16.04 installed on a RAID 1 device (two SSDs, software RAID). When I try to run the latest installer (Qlustar 10.1.1-3) from a live dvd, it fails to boot with the following error: No supported filesystem images found at /live Looking in the boot.log, I see error reading /lib/udev/hwdb.bin: No such file or directory Do think that is a result of the drives being md devices? The initramfs kernel sees /dev/md* and /dev/md12[67] Thanks, Ian -- Ian Kaufman Research Systems Administrator UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu

3 14

[Qlustar-General] multipath in qlustar storage nodes
by Rolandas 22 May '19

22 May '19

Hi, What is recommended way to run multipath in qlustar headnode and qlustar storage nodes ? Regards, Rolandas

2 3

[Qlustar-General] bug in slurm-config
by Tobias Moehle 14 May '19

14 May '19

Dear all, I ran into two problems with the configuration of slurm: a) Among others, I have the nodes 'compute-0-0' and 'compute-1-0'; if I put them into a common partition, qluman writes 'compute-[0-1]-0'; but this format seems not readable for slurm. I am not sure if this is a bug of slurm or of qluman; but it requires manual reconfiguration. b) When I try to assign some new properties to the 'Node Groups', the fields 'Delete' and 'New Node Property' are grayed out; I can only add values to existing properties. Can you probably tell me, what is going on? Is it maybe an issue with my configuration somewhere? Many thanks in advance, Tobias Moehle

1 0

[Qlustar-General] Re: setup infiniband fails
by Tobias Moehle 13 May '19

13 May '19

Hello Roland, great; after the upgrade ib works perfectly. Thank you very much! Best regards > On 11.05.19 09:42, Roland Fehrenbacher wrote: >>>>>>> "T" == Tobias Moehle <tobias.moehle(a)uni-rostock.de> writes: >> Hi Tobias, >> >> please upgrade to the just released 10.1.1.4-b509f1240. Support for the >> IBA7322 was missing and has been readded. >> >> T> Dear all, On our cluster, we have some nodes with infiniband >> T> which I am trying to set up at the moment. >> >> T> After some time of struggeling, I finally understand: >> T> 1) The hardware is found: >> >> T> #lspci | grep fini 04:00.0 InfiniBand: QLogic >> T> Corp. IBA7322 QDR InfiniBand HCA (rev 02) >> T> 2) The kernel-modules(?) seem to be loaded: .................. >> >> T> Also, "the pre-defined hardware property IB Adapter with a value >> T> of true must be assigned to a host, to explicitly enable IB for >> T> it" >> >> This is not necessary anymore. Needs to be fixed in the docs. >> >> T> But in my hardware properties no "IB Adapter" is available (only >> T> #CPU cores, #CPU sockets, HW Type, Size of RAM and Chassis >> T> Color). I expect this to be the issue; but what is wrong there? >> >> This HW property is obsolete. Just follow >> >> https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/10.1/html-single/QluMan_G… >> >> >> to configure the IB network. >> >> Best, >> >> Roland >> _______________________________________________ >> Qlustar-General mailing list -- qlustar-general(a)qlustar.org >> To unsubscribe send an email to qlustar-general-leave(a)qlustar.org

1 0

2025

2024

2023

2022

2021

2020

2019

2018

Qlustar General