- Qlustar General - Qlustar Mailing Lists

[Qlustar-General] SGE
by ignas.bunikis＠scilifelab.uu.se 05 Sep '18

05 Sep '18

Hej, I would like to set up SGE on freshly installed cluster. Could you please briefly describe necessary steps. Cheers, Iggy

2 2

[Qlustar-General] Open file limit
by ignas.bunikis＠scilifelab.uu.se 05 Sep '18

05 Sep '18

Hej, I need to increase Open file limit on the nodes. Should I use customized "limits.conf" and follow admin guide "4.2.5. Adding directories, files, links"? cat /etc/qlustar/common/image-files/my/limits.conf * soft nproc 10024 * hard nproc 10024 * soft nofile 50024 * hard nofile 50024 * soft memlock 255707144 * hard memlock 255707144 cat /etc/qlustar/common/image-files/destinations my/limits.conf /etc/security root:root 644 Is that a good way? Cheers, Iggy

2 2

[Qlustar-General] limit network access
by ignas.bunikis＠scilifelab.uu.se 05 Sep '18

05 Sep '18

Hej, I would like to limit access to the cluster via hosts.allow and hosts.deny. What is the best way to do it? I could create a script in /etc/qlustar/common/rc.boot/ that looks like this: #!/bin/bash echo 'sshd: ALL' >> /etc/hosts.deny echo 'sshd: localhost' >> /etc/hosts.allow echo 'sshd: xxx.xxx.xxx.xxx' >> /etc/hosts.allow Is that ok? Cheers, Iggy

2 2

[Qlustar-General] QluMan & Hardware Property Sets
by Ansgar Esztermann-Kirchner 30 Aug '18

30 Aug '18

Hello List, here's a question that cropped up during my search for HW Threads (see other message), but is actually unrelated: how do I edit HW property sets? If I use the pop-up menu to, say, change the number of cores from 10 to 20, the change reverts upon closing the property sets window. The context menu of the property has "Delete Property", but that has no effect; the context menu of the property set has "Edit Property Set", but that pertains only to the set's name and description, not the contained properties. Any ideas? Thanks a lot, A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

3 6

[Qlustar-General] HW Threads/Hyperthreading
by Ansgar Esztermann-Kirchner 24 Aug '18

24 Aug '18

Hello List, does Qlustar handle hardware threads? SLURM has the triple sockets/cores/threads, so I'd expect to be able to configure this somewhere. However, I couldn't find anything in the docs (or in QluMan). A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

2 3

[Qlustar-General] installing Qluman on workstation
by xyzemail19＠gmail.com 09 Jul '18

09 Jul '18

Reinstalling Qluman interface on my VM Virtualbox workstation. All worked fine then I needed to reload Virtualbox. Did a clean install on Ubuntu 16.04 and I received the following error message will trying to access the public key. root@workstation:~# dpkg -l software-properties-common > /dev/null 2>&1 || apt install software-properties-common root@workstation:~# gpg --no-default-keyring --primary-keyring /etc/apt/trusted.gpg --recv-keys E6BA110F3C0BC307 gpg: no keyserver known (use option --keyserver) gpg: keyserver receive failed: bad URI root@workstation:~# gpg --no-default-keyring --primary-keyring /etc/apt/trusted.gpg --recv-keys E6BA110F3C0BC307 gpg: no keyserver known (use option --keyserver) gpg: keyserver receive failed: bad URI

2 8

[Qlustar-General] Re: Qluman questions
by goswin-v-b＠web.de 30 May '18

30 May '18

2 1

[Qlustar-General] Qluman questions
by Ansgar Esztermann-Kirchner 29 May '18

29 May '18

Hello List, a couple of question regarding Qluman: -As far as I understand the docs, the hierarchy for nodes is supposed to be host < enclosure < rack. Putting a node inside an enclosure can be done easily via the node's enclosure pop-up, but I have been unable to put the enclosure inside the rack. The only method I did find (drag and drop inside the tree view) lead to an error: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/client/qt/TreeWidget.py", line 980, in dropEvent updates[slot.id] = {"child_enclosure_id": w.id} AttributeError: 'int' object has no attribute 'id' -How do I define rack types? We have 42U racks without any special slots, and 47U racks with a couple of special slots, and neither is present in Qluman by default. -How do I diagnose hardware mismatch problems? In the right hand pane of the Enclosure View, my test node shows a red wrench with tool tip "Hardware config doesn't match host". The wrench is shown on a clickable button, but when I click it, nothing happens. I couldn't find anything in the menus, either. A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

1 0

[Qlustar-General] When/How is slurm.conf generated
by Ansgar Esztermann-Kirchner 28 May '18

28 May '18

Hello List, next question: how is slurm.conf generated? On my fresh installation, slurmctld won't start, and there are no NodeName entries in slurm.conf except for "DEFAULT". I've added a dummy node via qluman in order to test general slurm functionality, but it doesn't appear in slurm.conf. Am I missing something? Do I need to boot the node in order for it to appear in the config? Thanks, A. -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

2 3

[Qlustar-General] Unable to generate one-time token
by Ansgar Esztermann-Kirchner 24 May '18

24 May '18

Hello List, after installing Qlustar 10, I've tried to connect to the cluster via the GUI. However, I am unable to generate the necessary token: # qluman-cli --gencert -o cert ERROR:client.cli.network:client.cli.network.Cluster.__init__(): could not connect to server Error: No such user: 'admin' ERROR:qlunet4.Node:Channel[('zmq_version_info', 1)].do_recv(): exception in request generator Traceback (most recent call last): File "/usr/lib/python3/dist-packages/qluman-10/qluman-cli.py", line 1274, in gencert db.users.lookup(field="name", val=user) File "/usr/lib/python3/dist-packages/qluman-10/common/types.py", line 1678, in lookup raise KeyError KeyError Checking the logs, there seems to be something wrong with qlumand and/or its database (see below). Any ideas? Thanks a lot, A. syslog excerpt: May 9 15:03:52 cl-head systemd[1]: qluman-server.service: Service hold-off time over, scheduling restart. May 9 15:03:52 cl-head systemd[1]: Stopped Qlustar Management server. May 9 15:03:52 cl-head systemd[1]: Started Qlustar Management server. May 9 15:03:52 cl-head qlumand[4428]: 2018-05-09 15:03:52,718 [4429] INFO#011__main__ May 9 15:03:52 cl-head qlumand[4428]: - Starting Qluman main server: qlumand. May 9 15:03:52 cl-head qlumand[4428]: 2018-05-09 15:03:52,719 [4429] INFO#011server.admin May 9 15:03:52 cl-head qlumand[4428]: - Qlumand running with address beosrv-c / external cl-head May 9 15:03:52 cl-head qlumand[4428]: 2018-05-09 15:03:52,823 [4429] INFO#011server.db.DBData May 9 15:03:52 cl-head qlumand[4428]: - DbVersion = 10.0.0 [expected 10.0.1] May 9 15:03:52 cl-head qlumand[4428]: 2018-05-09 15:03:52,824 [4429] ERROR#011server.db.DBData#011 Probably already have column: May 9 15:03:52 cl-head qlumand[4428]: Traceback (most recent call last): May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context May 9 15:03:52 cl-head qlumand[4428]: context) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute May 9 15:03:52 cl-head qlumand[4428]: cursor.execute(statement, parameters) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute May 9 15:03:52 cl-head qlumand[4428]: self._handle_result(self._connection.cmd_query(stmt)) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query May 9 15:03:52 cl-head qlumand[4428]: result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result May 9 15:03:52 cl-head qlumand[4428]: raise errors.get_exception(packet) May 9 15:03:52 cl-head qlumand[4428]: mysql.connector.errors.ProgrammingError: 1060 (42S21): Duplicate column name 'net_config_name_id' May 9 15:03:52 cl-head qlumand[4428]: The above exception was the direct cause of the following exception: May 9 15:03:52 cl-head qlumand[4428]: Traceback (most recent call last): May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 190, in add_column May 9 15:03:52 cl-head qlumand[4428]: engine.execute("ALTER TABLE {0} ADD COLUMN {1} {2} NOT NULL DEFAULT '{3}'".format(table_name, column_name, column_type, default)) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1991, in execute May 9 15:03:52 cl-head qlumand[4428]: return connection.execute(statement, *multiparams, **params) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 906, in execute May 9 15:03:52 cl-head qlumand[4428]: return self._execute_text(object, multiparams, params) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1054, in _execute_text May 9 15:03:52 cl-head qlumand[4428]: statement, parameters May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context May 9 15:03:52 cl-head qlumand[4428]: context) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception May 9 15:03:52 cl-head qlumand[4428]: exc_info May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 189, in raise_from_cause May 9 15:03:52 cl-head qlumand[4428]: reraise(type(exception), exception, tb=exc_tb, cause=exc_value) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/util/compat.py", line 182, in reraise May 9 15:03:52 cl-head qlumand[4428]: raise value.with_traceback(tb) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context May 9 15:03:52 cl-head qlumand[4428]: context) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute May 9 15:03:52 cl-head qlumand[4428]: cursor.execute(statement, parameters) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/mysql/connector/cursor.py", line 507, in execute May 9 15:03:52 cl-head qlumand[4428]: self._handle_result(self._connection.cmd_query(stmt)) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 722, in cmd_query May 9 15:03:52 cl-head qlumand[4428]: result = self._handle_result(self._send_cmd(ServerCmd.QUERY, query)) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/mysql/connector/connection.py", line 640, in _handle_result May 9 15:03:52 cl-head qlumand[4428]: raise errors.get_exception(packet) May 9 15:03:52 cl-head qlumand[4428]: sqlalchemy.exc.ProgrammingError: (mysql.connector.errors.ProgrammingError) 1060 (42S21): Duplicate column name 'net_config_name_id' [SQL: "ALTER TABLE Nic2NicProps ADD COLUMN net_config_name_id INTEGER UNSIGNED NOT NULL DEFAULT '1'"] May 9 15:03:52 cl-head qlumand[4428]: 2018-05-09 15:03:52,835 [4429] ERROR#011server.db.DBData#011Don't know how to update database format 10.0.0 to 10.0.1 May 9 15:03:52 cl-head qlumand[4428]: Traceback (most recent call last): May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 369, in __init__ May 9 15:03:52 cl-head qlumand[4428]: self.sess = db_updates[db_version.params](self.DB, self.sess, global_props) May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 337, in db_update_10_0_0 May 9 15:03:52 cl-head qlumand[4428]: db_set_version(global_props, "10.0.1") May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/qluman-10/server/db/DBData.py", line 174, in db_set_version May 9 15:03:52 cl-head qlumand[4428]: entry = global_props.lookup(field="name", val="DbVersion") May 9 15:03:52 cl-head qlumand[4428]: File "/usr/lib/python3/dist-packages/qluman-10/common/types.py", line 1678, in lookup May 9 15:03:52 cl-head qlumand[4428]: raise KeyError May 9 15:03:52 cl-head qlumand[4428]: KeyError -- Ansgar Esztermann Sysadmin http://www.mpibpc.mpg.de/grubmueller/esztermann

2 9

2026

2025

2024

2023

2022

2021

2020

2019

2018

Qlustar General