- Qlustar General - Qlustar Mailing Lists

[Qlustar-General] Qlustar BoF at ISC 2019
by Roland Fehrenbacher 12 Jun '19

12 Jun '19

Hi, we are organizing a Birds of a feather session [1] at this years ISC (Wednesday, June 19th 2:45pm - 3:45pm, Room Kontrast). So if you're in Frankfurt next week, take the chance to join us. Best, Roland [1] https://2019.isc-program.com/?post_type=page&p=11&id=bof125&sess=sess237

1 0

[Qlustar-General] https://www.qlustar.com site problems with certificate chain
by Rolandas 04 Jun '19

04 Jun '19

Hi, On new installation of Firefox we cannot connect to https://www.qlustar.com. The cause is missing intermediate certificate in server certificate chain response. By using openssl s_client -connect www.qlustar.com:443 we can see very strange chain: Certificate chain 0 s:CN = www.qlustar.com i:C = US, O = Let's Encrypt, CN = Let's Encrypt Authority X3 1 s:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Domain Validation Secure Server CA i:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Certification Authority 2 s:C = GB, ST = Greater Manchester, L = Salford, O = COMODO CA Limited, CN = COMODO RSA Certification Authority i:C = SE, O = AddTrust AB, OU = AddTrust External TTP Network, CN = AddTrust External CA Root Let's Encrypt have different intermediate certificate. Regards, Rolandas P.S. It also caused problems with wget/curl to download files from your site.

2 3

[Qlustar-General] Re: multipath in qlustar storage nodes
by Roland Fehrenbacher 24 May '19

24 May '19

>>>>> "R" == Rolandas <rolnas(a)gmail.com> writes: R> So we need to use /etc/qlustar/common/rc.boot and R> /etc/qlustar/common/image-files to configure nodes ? But I have R> already problem with rc.boot scripts, they run too late (for R> e.g. ZFS pool import for lustre I have to run hostid > R> /etc/hostid) or copy-files is run in parallel to lustre startup. You can apply the patch below to the generated image (use 'qlustar-image-edit -s <image name>' and type 'exit' when done). This will make spl use a hostid that doesn't change if the hardware of the machine doesn't change. The patch will be part of future releases. ----------------------------------------------------------------------------- diff --git a/sbin/init.qlustar b/sbin/init.qlustar --- a/core/image/common/sbin/init.qlustar +++ b/core/image/common/sbin/init.qlustar @@ -91,8 +91,13 @@ echo FIXME echo -e "### Starting Qlustar pre-systemd boot script /sbin/init.qlustar ###" -# generate the systemd machine id here +# generate the systemd machine id here ... systemd-machine-id-setup +# ... and also the hostid ... +hostid > /etc/hostid +# ... and generate a unique spl_host_id from it +echo "options spl spl_hostid=$(( 16#$(cat /etc/hostid) ))" >> \ + /etc/modprobe.d/spl.conf ----------------------------------------------------------------------------- R> But qlustar defines only one MAC address per host, but in the R> case if first link is down, PXE booting will run on second link R> with different MAC address. Adapter redundancy upon boot is unfortunately not supported.

2 1

[Qlustar-General] Trouble installing
by Ian Kaufman 23 May '19

23 May '19

Hi all, I have a server that already has Ubuntu 16.04 installed on a RAID 1 device (two SSDs, software RAID). When I try to run the latest installer (Qlustar 10.1.1-3) from a live dvd, it fails to boot with the following error: No supported filesystem images found at /live Looking in the boot.log, I see error reading /lib/udev/hwdb.bin: No such file or directory Do think that is a result of the drives being md devices? The initramfs kernel sees /dev/md* and /dev/md12[67] Thanks, Ian -- Ian Kaufman Research Systems Administrator UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu

3 14

[Qlustar-General] multipath in qlustar storage nodes
by Rolandas 22 May '19

22 May '19

Hi, What is recommended way to run multipath in qlustar headnode and qlustar storage nodes ? Regards, Rolandas

2 3

[Qlustar-General] bug in slurm-config
by Tobias Moehle 14 May '19

14 May '19

Dear all, I ran into two problems with the configuration of slurm: a) Among others, I have the nodes 'compute-0-0' and 'compute-1-0'; if I put them into a common partition, qluman writes 'compute-[0-1]-0'; but this format seems not readable for slurm. I am not sure if this is a bug of slurm or of qluman; but it requires manual reconfiguration. b) When I try to assign some new properties to the 'Node Groups', the fields 'Delete' and 'New Node Property' are grayed out; I can only add values to existing properties. Can you probably tell me, what is going on? Is it maybe an issue with my configuration somewhere? Many thanks in advance, Tobias Moehle

1 0

[Qlustar-General] Re: setup infiniband fails
by Tobias Moehle 13 May '19

13 May '19

Hello Roland, great; after the upgrade ib works perfectly. Thank you very much! Best regards > On 11.05.19 09:42, Roland Fehrenbacher wrote: >>>>>>> "T" == Tobias Moehle <tobias.moehle(a)uni-rostock.de> writes: >> Hi Tobias, >> >> please upgrade to the just released 10.1.1.4-b509f1240. Support for the >> IBA7322 was missing and has been readded. >> >> T> Dear all, On our cluster, we have some nodes with infiniband >> T> which I am trying to set up at the moment. >> >> T> After some time of struggeling, I finally understand: >> T> 1) The hardware is found: >> >> T> #lspci | grep fini 04:00.0 InfiniBand: QLogic >> T> Corp. IBA7322 QDR InfiniBand HCA (rev 02) >> T> 2) The kernel-modules(?) seem to be loaded: .................. >> >> T> Also, "the pre-defined hardware property IB Adapter with a value >> T> of true must be assigned to a host, to explicitly enable IB for >> T> it" >> >> This is not necessary anymore. Needs to be fixed in the docs. >> >> T> But in my hardware properties no "IB Adapter" is available (only >> T> #CPU cores, #CPU sockets, HW Type, Size of RAM and Chassis >> T> Color). I expect this to be the issue; but what is wrong there? >> >> This HW property is obsolete. Just follow >> >> https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/10.1/html-single/QluMan_G… >> >> >> to configure the IB network. >> >> Best, >> >> Roland >> _______________________________________________ >> Qlustar-General mailing list -- qlustar-general(a)qlustar.org >> To unsubscribe send an email to qlustar-general-leave(a)qlustar.org

1 0

[Qlustar-General] setup infiniband fails
by Tobias Moehle 11 May '19

11 May '19

Dear all, On our cluster, we have some nodes with infiniband which I am trying to set up at the moment. After some time of struggeling, I finally understand: 1) The hardware is found: #lspci | grep fini 04:00.0 InfiniBand: QLogic Corp. IBA7322 QDR InfiniBand HCA (rev 02) 2) The kernel-modules(?) seem to be loaded: #lsmod | grep ib_ ib_ipoib 122880 0 ib_cm 53248 2 rdma_cm,ib_ipoib ib_uverbs 90112 1 rdma_ucm ib_umad 28672 0 ib_core 217088 7 rdma_cm,ib_ipoib,iw_cm,ib_umad,rdma_ucm,ib_uverbs,ib_cm ipv6 405504 59 rdma_cm,ib_ipoib,ib_core #lsmod | grep verbs ib_uverbs 90112 1 rdma_ucm ib_core 217088 7 rdma_cm,ib_ipoib,iw_cm,ib_umad,rdma_ucm,ib_uverbs,ib_cm 3) but 'ibv_devices' gives an empty list, as well as ibstat etc. maybe helpful: #ibnodes ibwarn: [3220] mad_rpc_open_port: can't open UMAD port ((null):0) src/ibnetdisc.c:784; can't open MAD port ((null):0) /usr/sbin/ibnetdiscover: iberror: failed: discover failed ibwarn: [3225] mad_rpc_open_port: can't open UMAD port ((null):0) src/ibnetdisc.c:784; can't open MAD port ((null):0) /usr/sbin/ibnetdiscover: iberror: failed: discover failed From the qlustar-documentation ( https://qlustar.com/book/docs/qluman-guide#Configuring-IB) I know that I need to setup nodes that run OpenSM (Set Generic Property->OpenSM Ports->ALL); this I have, the service is running. Also, "the pre-defined hardware property IB Adapter with a value of true must be assigned to a host, to explicitly enable IB for it" But in my hardware properties no "IB Adapter" is available (only #CPU cores, #CPU sockets, HW Type, Size of RAM and Chassis Color). I expect this to be the issue; but what is wrong there? Any help is highly appreciated. Best regards, Tobias Moehle

2 1

[Qlustar-General] qlustar-initial-config fails on qluman db bootstrap
by rolnas＠gmail.com 06 May '19

06 May '19

Hi, In ~50% cases qlustar-initial-config failing in qluman bootstrap step with duplicate table errors, like "Table 'Nets' already exists". I'm using qlustar-installer-10.1.1-2 version. Regards, Rolandas

5 8

[Qlustar-General] Missing swap after qlustar installation
by rolnas＠gmail.com 03 May '19

03 May '19

Hi, I just installed from qlustar-installer-10.1.1-2.iso and installed head node is missing swap. By looking into FaiConfig.py inside of installer it doesn't define swap for FAI to create. swapSize is defined and calculated, but not used anywhere. Best regards, Rolandas

3 2

[Qlustar-General] node-configuration
by Tobias Moehle 02 May '19

02 May '19

Dear all, I'd like to report some trouble I had with the node configuration (qlustar v. 10.1.1-2): I tried to add some nfs-mount as described here: https://docs.qlustar.com/en-US/Qlustar_Cluster_OS/10.1/html-single/Administ… However, the script was not executed. It took me quite a while to figure out that these scripts are run with 'run-parts' (see /lib/qlustar/nfs-rc for those who are interested) and this does not accepct stripts with '.sh' (see e.g. the first answer here: https://superuser.com/questions/719424/how-do-you-use-the-run-parts-command for some explanation). Probably it would be great to either use the '--regex'-option to circumvent this behaviour or at least to tell users about it? Moreover, I wondered if there is way to adjust the scripts in '/lib/qlustar/'? Unfortunately, I didn't find their place on the headnode. Best regards, Tobias Moehle

2 1

[Qlustar-General] Renaming slurm gres gpu type
by Bryan Hill 24 Apr '19

24 Apr '19

Hi All: Is there a preferred way to change the name of a GPU gres type in Qluman? For example, we have to use --gres=gpu:geforce-rtx-2080-ti:2 to request that specific model of GPU. I would like to simplify that to something like: --gres=gpu:2080ti:2 When I attempt to change the names from what the GPU Wizard had originally set up, it makes things go badly, in that the the gres resource is no longer recognized. Is there a clean way to do this? Thanks, Bryan

3 11

[Qlustar-General] QluMan containerization
by Hernán Morales Durand 01 Apr '19

01 Apr '19

Hello, I have a node where I've installed QluMan 10.1.1 so I can configure the Cluster using the GUI. Now this node is NOT added to the cluster (i.e. not currently booting any OS image) so it's somewhat "wasted". As far as I understood the OS images are executed in the nodes in RAM memory. So theoretically I could boot this node with an OS image and later mount the fs to try qluman-10.1.1.19-singularity.sqsh however I don't see how that could work because of lib compatibility. Is that correct/feasible? And I wonder if there is a container image already built specifically to run the qluman.sqsh application. I couldn't find none so far and I wanted to ask before starting to explore this path. What do you recommend? Cheers, Hernán

2 1

[Qlustar-General] HP Proliant DL360 G5 issues
by bscook999＠gmail.com 21 Mar '19

21 Mar '19

Hello. I'm having a lot of trouble getting the Qlustar 10.0 installer to recognize the the hard drives. During the installation process an error message comes up that there are no available hard drives and the FAI stops. HP Proliant DL360 G5 Smart Array P400i is working. I did a standard Ubuntu 18.04.2 Server LTS installation and the hard drives were recognized just fine. I'm not sure how to get the Qlustar to recognize it. Is it possible to install Qlustar from within ubuntu? I would prefer the automated installation process if possible to avoid errors, but if I can't get it to work. Please advise, thanks.

4 15

[Qlustar-General] Nodes won't boot
by Ansgar Esztermann-Kirchner 15 Mar '19

15 Mar '19

Hello List, recently, I've moved /apps to its own device. This invalidates NFS handles on the nodes, of course, so I started to reboot them. To my surprise, they don't come up again. The nodes complain about a time-out, "Failed to request QluMan node config in time", and ask me to check qlumand and qluman-route on the head. These two processes are indeed running. I've checked the logs, but couldn't fine anything helpful (to me) in there. qlumand seems to see the node briefly: 2019-03-05 11:45:06,615 [29219] INFO server.admin - Identifying node from '00-25-90-d9-08-86' 2019-03-05 11:45:06,617 [29219] INFO server.admin - Registering Execd 'node31-35' 2019-03-05 11:45:39,645 [29219] INFO server.admin - Execd '00-25-90-d9-08-86' disconnected I've attached the router log. There's one thing that's conspicuous, but it doesn't seem to be correlated with the nodes booting: a stack trace when accessing the database. I'll be grateful for any pointers. Thanks, A. -- Ansgar Esztermann Sysadmin Dep. Theoretical and Computational Biophysics http://www.mpibpc.mpg.de/grubmueller/esztermann

3 5

[Qlustar-General] NVidia driver
by Bryan Hill 13 Mar '19

13 Mar '19

Hello All! Is there a way to get a newer nvidia driver working with the current Qlustar 10.1.1? The nvidia module in the Qlustar repo is 390, and we just received some nodes with RTX2080 Ti cards, which require >= 410 I've tried installing inside of a chroot, but it doesn't want to work. Thanks, Bryan

3 9

[Qlustar-General] IPMI Power
by Ansgar Esztermann-Kirchner 01 Mar '19

01 Mar '19

Hello List, what is the preferred way to power control nodes? IPMI setup is done by qluman, but there does not seem to be a way to control nodes from the GUI. I've found ql-remote-control, but it complains about a missing config file, and I did not find an example file to explain its syntax. Thanks, A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

2 5

[Qlustar-General] Qlustar installation on HP Gen6 servers
by jorma.ojala＠iki.fi 15 Feb '19

15 Feb '19

Hi, Qlustar 10.1 installation failed on HP DL320 G6 server. The server has got 4 x 1TB disks, but the installer reported 'no unused disks'. I recall that the server has got the P410 RAID-controller on-board. I tried with different RAID configurations but with no luck. Maybe this is 'too old' hardware for Qlustar ? Cheers, Jorma

3 16

[Qlustar-General] Failed to run qluman-cli -bootstrap during second phase installation
by clavila＠gmail.com 25 Jan '19

25 Jan '19

Dear all, I am trying to install the latest version of Qlustar (10.1) in a server. During the first phase everything runs smoothly. During this stage I opted to run the front end on a VM. I have also setup manual network configurations for both cl-head and cl-fe. When I start the second phase after reboot by running qlustar-initial-config I get an error during qluman setup. To try to isolate the error, i ran the qlustar-initial-config -i -d (interactive and debug flags enabled). The output that I get is attached below. Any ideas on how to fix this? Cheers, Cesar run "qluman-cli --bootstrap" [n] Yes -- Starting Qluman bootstrap ... Base MAC for VMs: 02:00:99:99:99:00 -- Registering VM for frontend node ... Assigning MAC 02:00:99:99:99:fd to internal FrontEnd Node interface. Assigning MAC 02:01:99:99:9c:52 to external FrontEnd Node interface. -- Registering VMs for demo cluster ... Adding VM node beo-201: IP = 192.168.52.201, MAC = 02:00:99:99:99:c9 ###### Create some Enclosures ###### Create all Host/EnclosureSlots ###### Create some SpecPropNames ###### Create some spec Host Props ###### Create some GenPropNames ###### Create some GenProps ###### Create some GenPropSetNames ###### Create some GenPropSets ###### Create some HwPropNames ###### Create some HwProps Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) mysql.connector.errors.IntegrityError: 1062 (23000): Duplicate entry '5-2' for key 'name_id' The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 1470, in <module> main() File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 1461, in main bootstrap(config, db_data, cfg_gen) File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 1154, in bootstrap create_hw_props(d, ini_vals) File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 222, in create_hw_props db_data.insert(CT.TABLES.HwProp, prop_list) File "/usr/lib/python3/dist-packages/qluman-10/common/types.py", line 1760, in insert return table.insert(entries) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 96, in insert return self.insert(orig_entries, count = count + 1) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 96, in insert return self.insert(orig_entries, count = count + 1) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 96, in insert return self.insert(orig_entries, count = count + 1) File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 98, in insert raise exn File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 92, in insert self.sess.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 813, in commit self.transaction.commit() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 392, in commit self._prepare_impl() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl self.session.flush() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2027, in flush self._flush(objects) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2145, in _flush transaction.rollback(_capture_exception=True) File "/usr/lib/python3/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__ compat.reraise(exc_type, exc_value, exc_tb) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 183, in reraise raise value File "/usr/lib/python3/dist-packages/sqlalchemy/orm/session.py", line 2109, in _flush flush_context.execute() File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute rec.execute(self) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute uow File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 174, in save_obj mapper, table, insert) File "/usr/lib/python3/dist-packages/sqlalchemy/orm/persistence.py", line 800, in _emit_insert_statements execute(statement, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 914, in execute return meth(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection return connection._execute_clauseelement(self, multiparams, params) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement compiled_sql, distilled_params File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception exc_info File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause reraise(type(exception), exception, tb=exc_tb, cause=exc_value) File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise raise value.with_traceback(tb) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context context) File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute cursor.execute(statement, parameters) File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute self._handle_result(self._connection.cmd_query(stmt)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result raise errors.get_exception(packet) sqlalchemy.exc.IntegrityError: (mysql.connector.errors.IntegrityError) 1062 (23000): Duplicate entry '5-2' for key 'name_id' [SQL: 'INSERT INTO `HwProps` (val, mutable, name_id) VALUES (%(val)s, %(mutable)s, %(name_id)s)'] [parameters: {'val': '2', 'mutable': 1, 'name_id': 5}]

5 4

[Qlustar-General] Ganglia stop monitoring compute nodes, qlustar 10.1
by kwinten.nelissen＠gmail.com 15 Jan '19

15 Jan '19

Dear, Ganglia stops monitoring the compute nodes after a couple minutes after restart of the service. However the head node is monitored fine. Has anyone an idea what can cause this. There is nothing reported in the error logs what so ever. Thanks for help. Best regards, Kwinten

2 3

[Qlustar-General] Alternative to NTP?
by clavila＠gmail.com 09 Jan '19

09 Jan '19

Dear all, I was wondering if there is an alternative to using NTP to synchronize the clock. I am behind a proxy firewall and I cannot access NTP servers on the internet. Cheers, Cesar

2 1

[Qlustar-General] Add edge platform without QluMan Qt?
by Hernán Morales Durand 18 Dec '18

18 Dec '18

Hi, Inadvertently during installation I chose CentOS 7 as my edge platform and installing the QluMan GUI proves to be difficult on CentOS 7 due to missing Qt dependencies. Now I am stuck trying to install an alternative platform: root@plato:~ # schroot -l chroot:centos7 root@plato:~ # chroot-centos7 (centos7) root@plato:~ # yum update yum install qt-10 qt5-qtbase-devel mesa-libGL-devel mesa-libGLU-devel yum install qluman-qt Loaded plugins: keys, post-transaction-actions, protectbase 0 packages excluded due to repository protections Resolving Dependencies --> Running transaction check ---> Package qluman-qt.noarch 0:10.1.0.37-1.ql.el7 will be installed --> Processing Dependency: qt-10 = 10.1.0.37-1.ql.el7 for package: qluman-qt-10.1.0.37-1.ql.el7.noarch --> Finished Dependency Resolution Error: Package: qluman-qt-10.1.0.37-1.ql.el7.noarch (qlustar-10.1) Requires: qt-10 = 10.1.0.37-1.ql.el7 You could try using --skip-broken to work around the problem You could try running: rpm -Va --nofiles --nodigest I couldn't find how to install additional edge platform for my chroot environment **without** requiring QluMan, in the documentation : https://www.qlustar.com/book/docs/install-guide : "Note that you can always add support for a previously unselected edge platform later on by creating corresponding chroots and Qlustar images using QluMan." Is there an alternative way to add a platofrm without requiring the QluMan GUI? Is better to re-run the initial config again? /usr/sbin/qlustar-initial-config Best regards, Hernán

2 3

[Qlustar-General] Unsigned repository (NO_PUBKEY)
by Hernán Morales Durand 18 Dec '18

18 Dec '18

Hi, Trying to install qluman-qt on a clean (recently installed) Debian 9.2 workstation: # dpkg -l | grep python-software-properties > /dev/null 2>&1 || apt-get install python3-software-properties # apt-get install software-properties-common # add-apt-repository 'deb http://repo.qlustar.com/repo/qluman 9.2-wheezy-proposed-updates main non-free' # add-apt-repository 'deb http://repo.qlustar.com/repo/qluman 9.2-wheezy main non-free' Problems start here : # apt-get update Ign:1 http://ftp.ccc.uba.ar/pub/linux/debian/debian stretch InRelease Des:2 http://ftp.ccc.uba.ar/pub/linux/debian/debian stretch-updates InRelease [91,0 kB] Des:3 http://ftp.ccc.uba.ar/pub/linux/debian/debian stretch Release [118 kB] Obj:4 http://security.debian.org/debian-security stretch/updates InRelease Des:6 http://repo.qlustar.com/repo/qluman 9.2-wheezy-proposed-updates InRelease [9.567 B] Ign:6 http://repo.qlustar.com/repo/qluman 9.2-wheezy-proposed-updates InRelease Des:7 http://repo.qlustar.com/repo/qluman 9.2-wheezy InRelease [9.548 B] Ign:7 http://repo.qlustar.com/repo/qluman 9.2-wheezy InRelease Des:8 http://repo.qlustar.com/repo/qluman 9.2-wheezy-proposed-updates/main amd64 Packages [2.653 B] Des:9 http://repo.qlustar.com/repo/qluman 9.2-wheezy-proposed-updates/non-free amd64 Packages [2.779 B] Des:10 http://repo.qlustar.com/repo/qluman 9.2-wheezy/main amd64 Packages [7.888 B] Des:11 http://repo.qlustar.com/repo/qluman 9.2-wheezy/non-free amd64 Packages [2.094 B] Descargados 244 kB en 2s (103 kB/s) Leyendo lista de paquetes... Hecho W: Error de GPG: http://repo.qlustar.com/repo/qluman 9.2-wheezy-proposed-updates InRelease: Las firmas siguientes no se pudieron verificar porque su clave pública no está disponible: NO_PUBKEY E6BA110F3C0BC307 W: El repositorio «http://repo.qlustar.com/repo/qluman 9.2-wheezy-proposed-updates InRelease» no está firmado. N: Los datos de un repositorio como este no se pueden autenticar y por tanto su uso es potencialmente peligroso. N: Vea la página de manual apt-secure(8) para los detalles sobre la creación de repositorios y la configuración de usuarios. W: Error de GPG: http://repo.qlustar.com/repo/qluman 9.2-wheezy InRelease: Las firmas siguientes no se pudieron verificar porque su clave pública no está disponible: NO_PUBKEY E6BA110F3C0BC307 W: El repositorio «http://repo.qlustar.com/repo/qluman 9.2-wheezy InRelease» no está firmado. N: Los datos de un repositorio como este no se pueden autenticar y por tanto su uso es potencialmente peligroso. N: Vea la página de manual apt-secure(8) para los detalles sobre la creación de repositorios y la configuración de usuarios. # apt-get install qluman-qt Leyendo lista de paquetes... Hecho Creando árbol de dependencias Leyendo la información de estado... Hecho No se pudieron instalar algunos paquetes. Esto puede significar que usted pidió una situación imposible o, si está usando la distribución inestable, que algunos paquetes necesarios aún no se han creado o se han sacado de «Incoming». La siguiente información puede ayudar a resolver la situación: Los siguientes paquetes tienen dependencias incumplidas: qluman-qt : Depende: qluman-qt-3 pero no va a instalarse E: No se pudieron corregir los problemas, usted ha retenido paquetes rotos. It seems qlustar repository cannot be authenticated. Are there any additional steps to configure? Should I self-sign the qlustar repository? Cheers, Hernán

2 1

[Qlustar-General] API
by Ansgar Esztermann-Kirchner 10 Dec '18

10 Dec '18

Hello List, there's a few areas of configuration where we'd welcome more automation (e.g. creating a lot of nodes). Therefore, I'd like to develop some tools that interface with the central daemon. Is there any API documentation available? Thanks, A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

2 5

[Qlustar-General] Hardware config incomplete
by Ansgar Esztermann-Kirchner 03 Dec '18

03 Dec '18

Hello List, I've just added a few nodes to the cluster, and they're marked with the empty wrench icon "Hardware config incomplete". How do I find out what's missing? Thanks, A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

2 1

2025

2024

2023

2022

2021

2020

2019

2018

Qlustar General