DokuWiki

opensm config for KIT

multiple servers need to run the opensmd, as we don't have a fabric manager in the switches. Furthermore multiple independant fabrics needs to be serviced with the opensmd. Each GxFS server will start it's own opensmd with different priorities:

server	building block	fabric	opensmd prio
f01-120-121	sbb06	fabA	6
f01-120-145	sbb00	fabA	13
f01-121-121	sbb06	fabB	6
f01-122-121	sbb05	fabA	5
f01-122-123	sbb05	fabB	5
f01-123-121	sbb04	fabA	4
f01-123-123	sbb04	fabB	4
f01-124-121	sbb03	fabA	3
f01-124-145	sbb00	fabB	13
f01-125-121	sbb03	fabB	3
f01-126-121	sbb02	fabA	2
f01-126-123	sbb02	fabB	2
f01-127-121	sbb01	fabA	1
f01-127-123	sbb01	fabB	1
gxfsadmin		fabA and fabB	0

single steps to create according config:

# opensm --create-config /etc/opensm/opensm.conf
-------------------------------------------------
OpenSM 3.3.2_20090831_ce6f8dd
Command Line Arguments:
 Creating config file template ’/etc/opensm/opensm.conf’.
 Log File: /var/log/opensm.log
-------------------------------------------------
#

edit /etc/opensm/opensmd.config and configure the according GUID and priority. GUID information can befound by issueing 'ibv_devinfo' command. All GxFS Server are plugged iwth mlx5_0 in fabA and mlx5_1 in fabB.

start and enable service permantly using service and chkconfig command.