Archive for: ‘April 2012’

Testing Infiniband Speeds using iperf

April 9, 2012 Posted by admin

It is possible to trick an application that use regular tcp sockets into using the infiniband transport layer instead without recompiling the application. All infiniband stacks  have a standardized way to do this called the Socket Direct Protocol (SDP).

ip over inifiniband
root@node02 ~]$ iperf -fM -c node01
------------------------------------------------------------
Client connecting to node01, TCP port 5001
TCP window size: 0.03 MByte (default)
------------------------------------------------------------
[  3] local 192.168.2.102 port 56989 connected with 192.168.2.101 port 5001
[  3]  0.0-10.0 sec  2817 MBytes    282 MBytes/sec

SDP
[root@node02 ~]$ LD_PRELOAD=libsdp.so iperf -fM -c node01
------------------------------------------------------------
Client connecting to node01, TCP port 5001
TCP window size: 0.13 MByte (default)
------------------------------------------------------------
[  4] local 192.168.2.102 port 48756 connected with 192.168.2.101 port 5001
[  4]  0.0-10.0 sec  7282 MBytes    728 MBytes/sec