Hi,
In fresh qlustar installation without infiniband we cannot start MPI jobs. Error message is long, but essential part is:
[beo-01:19012] pmix_mca_base_component_repository_open: "mca_bfrops_v21" does not appear to be a valid bfrops MCA dynamic component (ignored): /usr/lib/openmpi/3.1.2/gcc/lib/openmpi/mca_pmix_ext2x.so: undefined symbol: mca_bfrops_v21_component. ret -1
Qlustar image for nodes have modules: core, slurm, ofed, lustre-client. UnionFS Chroot (xenial/10.1) is freshly installed without additional packages installed (dist-upgrade was executed).
Regards, Rolandas