Qlustar
Kim here again; new Qlustar user, local university CS student. I have installed Qlustar on a Master node with 2 compute nodes attached, and I have installed the QluMan GUI Singularity container on a stand alone Front End computer. All seems to be working well. I get to Section 1.8 near the end of the First Steps Guide, and follow the instruction to log into the User account I have set up on the Head Node (Section 1.7), and run a test to verify the installation of MPI. I get no response to the instruction
mpicc.openmpi-gcc -o hello-world-c hello-world.c
I note that I get a response of: "no such instruction found" when I try:
mpirun --version
Anyone have an idea of what I might be doing wrong or what I might do to get OpenMPI working?
Kim
Correction to my description. The response to the instruction: mpicc.openmpi-gcc -o hello-world-c hello-world.c is: -bash: mpicc.openmpi-gcc: command not found
And the response to the instruction: mpirun --version is: -bash: mpirun: command not found
Sorry for being sloppy with my description of the problem. Kim
"K" == Kim Peterson kimjohnpeterson@gmail.com writes:
Hi Kim,
K> Correction to my description. The response to the instruction: K> mpicc.openmpi-gcc -o hello-world-c hello-world.c is: -bash: K> mpicc.openmpi-gcc: command not found
K> And the response to the instruction: mpirun --version is: -bash: K> mpirun: command not found
K> Sorry for being sloppy with my description of the problem. Kim
you need to check what unionfs chroots you have assigned to your Qlustar image running on the node and make sure that openmpi is installed in there. It is if you set up a demo cluster at install.
Best,
Roland
Roland
Thank you for the timely response, that, as usual, immediately identifies the issue for me. I did not set up a demo cluster during Qlustar install. I have an actual cluster composed of a Master node and 2 Compute nodes (the Master node is intended to be engaged as a compute resource along with the 2 Compute nodes during program execution). I use my desktop computer as a Front End, running the QluMan GUI from the Singularity container. I did not install a resource manager during the installation. I have set up a single user as described in Section 1.7 in the First Steps Guide.
The only Edge Platform selected during Qlustar install was Ubuntu/Bionic, and the only unionfs chroot I see reported in the Qlustar Management Interface - Manage Configs - Qlustar Images - Standard-bionic - unionFS chroot: is bionic. I have made no modifications to the chroot that was set up during installation.
The First Steps Guide Section 1.8 says: "The default MPI variant in Qlustar is OpenMPI and is automatically installed in the standard chroot during installation under Ubuntu."
I see the Note in the Installation Guide, Chapter 3, Step 9 that indicates the Demo Cluster is a requirement to be able to follow all the steps in the First Steps Guide, so it appears that since I did not install the Demo Cluster, I do not have OpenMPI installed. That adequately explains the absence of OpenMPI in my installation.
I spent some time looking through the Install Guide, Admin Manual and QluMan Guide to see if there was a procedure for installing OpenMPI on the Head node. I didn't find one. I see there are a number of OpenMPI related packages in the Qlustar Ubuntu Repository, but I am far from being familiar enough with Qlustar to try guessing about what might need to be done here. Can you describe the procedure I should use to install OpenMPI on my single Master/2 Compute node/remote attached Front End Qlustar cluster so that MPI enabled programs can be executed directly (without a Resource Manager) on the Head node, and the OpenMPI installation is properly tracked and managed by the Gluman GUI running on the Front End. I presume it would be a relatively simple procedure, something like: On the Head node, running as root, execute the instruction: apt install openmpi-gcc-4.0 In the QluMan GUI running on the Front End, set the following selections: In Manage Sets - Generic Property Sets: Verify or set this Do that In Manage Sets - Config Sets: Verify or set this Set that In Manage Configs - Qlustar Images - Standard-bionic: Select something Reboot the Head node and Compute nodes
The academic study that I am engaged in requires that the Qlustar cluster be set up so that it is operated by a single user, and able to run programs interactively 100% of the time, in much the same way that a PC computer is used, so executing directly on the Head node and running interactively is how this Qlustar cluster will always be used, and I want to set it up correctly.
Let me know if the QluMan GUI has the ability to run command line instructions on the Head node, so, in my case, I could compile and execute programs from the Front End using the QluMan GUI (I could initiate this request in a separate email after we are done with the OpenMPI question, if you prefer).
Thanks, Kim
"K" == Kim Peterson kimjohnpeterson@gmail.com writes:
Hi Kim,
I need to quit at this stage. Good luck in further exploring Qlustar. If someone on the list wants to take over, please go ahead. Unfortunately my resources don't allow to play the role of a thesis supervisor.
All the best,
Roland
K> Roland Thank you for the timely response, that, as usual, K> immediately identifies the issue for me. I did not set up a demo K> cluster during Qlustar install. I have an actual cluster K> composed of a Master node and 2 Compute nodes (the Master node is K> intended to be engaged as a compute resource along with the 2 K> Compute nodes during program execution). I use my desktop K> computer as a Front End, running the QluMan GUI from the K> Singularity container. I did not install a resource manager K> during the installation. I have set up a single user as K> described in Section 1.7 in the First Steps Guide.
K> The only Edge Platform selected during Qlustar install was K> Ubuntu/Bionic, and the only unionfs chroot I see reported in the K> Qlustar Management Interface - Manage Configs - Qlustar Images - K> Standard-bionic - unionFS chroot: is bionic. I have made no K> modifications to the chroot that was set up during installation.
K> The First Steps Guide Section 1.8 says: "The default MPI variant K> in Qlustar is OpenMPI and is automatically installed in the K> standard chroot during installation under Ubuntu."
K> I see the Note in the Installation Guide, Chapter 3, Step 9 that K> indicates the Demo Cluster is a requirement to be able to follow K> all the steps in the First Steps Guide, so it appears that since K> I did not install the Demo Cluster, I do not have OpenMPI K> installed. That adequately explains the absence of OpenMPI in my K> installation.
K> I spent some time looking through the Install Guide, Admin Manual K> and QluMan Guide to see if there was a procedure for installing K> OpenMPI on the Head node. I didn't find one. I see there are a K> number of OpenMPI related packages in the Qlustar Ubuntu K> Repository, but I am far from being familiar enough with Qlustar K> to try guessing about what might need to be done here. Can you K> describe the procedure I should use to install OpenMPI on my K> single Master/2 Compute node/remote attached Front End Qlustar K> cluster so that MPI enabled programs can be executed directly K> (without a Resource Manager) on the Head node, and the OpenMPI K> installation is properly tracked and managed by the Gluman GUI K> running on the Front End. I presume it would be a relatively K> simple procedure, something like: On the Head node, running as K> root, execute the instruction: apt install openmpi-gcc-4.0 In the K> QluMan GUI running on the Front End, set the following K> selections: K> In Manage Sets - Generic Property Sets: K> Verify or set this Do that K> In Manage Sets - Config Sets: K> Verify or set this Set that K> In Manage Configs - Qlustar Images - Standard-bionic: K> Select something K> Reboot the Head node and Compute nodes
K> The academic study that I am engaged in requires that the Qlustar K> cluster be set up so that it is operated by a single user, and K> able to run programs interactively 100% of the time, in much the K> same way that a PC computer is used, so executing directly on the K> Head node and running interactively is how this Qlustar cluster K> will always be used, and I want to set it up correctly.
K> Let me know if the QluMan GUI has the ability to run command line K> instructions on the Head node, so, in my case, I could compile K> and execute programs from the Front End using the QluMan GUI (I K> could initiate this request in a separate email after we are done K> with the OpenMPI question, if you prefer).
K> Thanks, Kim _______________________________________________
Roland
No problem with calling a stop. I need to move on as well. Thanks for being patient with me!
Kim