Mellanox Infiniband on SuSE 9.0 - xp0 module, etc
Dear colleagues ! I've some problem w/Mellanox IB software installation (in particular, the absence of xp0 kernel module). I've installed Infiniband HCA (PCI-X Infinihost MT23108 low profile) to upgarde my interconnect on Tyan S2880 under SuSE Linux 9.0 (2.4.21-243). It's official software platform supported by whole Mellanox IBHPC-0.5.0 software collection. 1)After minor source modification (in mosal.c) the installation (INSTALL script) was finished successfully. But after reboot I see that a) mst tools started successfully b) and I see then following boot messages: Setting up network interfaces : eth0 eth1 - both done ib0: modprobe: modprobe: can't locate module xp0 and ib0 interface is down (it's not connected through IB cable really). But I may do ib0 up manually; in particular, /etc/init.d/network start put ib0 in "up" state. I didn't find xb0.o in /lib/modules, and in any Mellanox software rpm's also ! What should I do now - and what/where is xp0 module ?? 2) I configured IPoIB at the installation. (To try IBsNice) I issued vapi start after boot, and see the message Loading mod_ib_mgt FAILED ("manual" modprobe mod_ib_mgt leads to init_module: device or reesource busy) If I run IBsNice, then I receive the same message about mod_ib_mgt but IBsNice create virtual eth2 , and ping to the IP of eth2 works normally. I'll be very appreciate if somebody clarify me this situation w/mod_ib_mgt ! 3) TO BE MORE CORRECT: pls take into account, that my host w/installed software& Mellanox hardware *isn't connected* currently with IB switch (i.e. is "standalone" server !) Yours Mikhail Kuzminsky Zelinsky Institute of Organic Chemistry Moscow
On Sun, Oct 17, 2004 at 11:00:13PM +0400, Mikhail Kuzminsky wrote:
Dear colleagues !
I've some problem w/Mellanox IB software installation (in particular, the absence of xp0 kernel module).
I've installed Infiniband HCA (PCI-X Infinihost MT23108 low profile) to upgarde my interconnect on Tyan S2880 under SuSE Linux 9.0 (2.4.21-243).
It's official software platform supported by whole Mellanox IBHPC-0.5.0 software collection.
I had difficulty with the 0.5.0 release on SuSE (9.1), but the latest release (1.6.0) which is available through the their web site (with registration). This worked seamlessly IPoIB came right up no problem. The resulting package is a bit bloated, but you do get everything. ...
3) TO BE MORE CORRECT: pls take into account, that my host w/installed software& Mellanox hardware *isn't connected* currently with IB switch (i.e. is "standalone" server !)
Remember that you need some form of subnet management to assign LIDs to the ports (minism or opensm on one node after the port is in "INIT" state -- using vstat). ... remaining deleted to save to old growth electrons ...
Yours Mikhail Kuzminsky Zelinsky Institute of Organic Chemistry Moscow
hope this helps -bob
participants (2)
-
Bob Lee
-
Mikhail Kuzminsky