Infiniband over slurm


DARDO ARIEL VIÑAS VISCARDI
 

Hello group! 

I have just installed a new Infiniband connection. After some troubleshooting I can now ping between them and everything.

############################################################
ibstatus 

Infiniband device 'mlx4_0' port 1 status:
default gid: fe80:0000:0000:0000:0021:2800:01a0:f831
base lid: 0x1
sm lid: 0x1
state: 4: ACTIVE
phys state: 5: LinkUp
rate: 40 Gb/sec (4X QDR)
link_layer: InfiniBand

ibstat

CA 'mlx4_0'
CA type: MT26428
Number of ports: 2
Firmware version: 2.11.2010
Hardware version: b0
Node GUID: 0x0021280001a0f830
System image GUID: 0x0021280001a0f833
Port 1:
State: Active
Physical state: LinkUp
Rate: 40
Base lid: 1
LMC: 0
SM lid: 1
Capability mask: 0x0259086a
Port GUID: 0x0021280001a0f831
Link layer: InfiniBand
############################################################

I want now to force slurm to use this new connection. How can I do that? I installed everthing following the centos 7.4 warewulf + slurm guide.

I currently have 2 nodes (including my master that also works as a compute node)

Join OpenHPC-users@groups.io to automatically receive all group messages.