NetPIPE is a project mainly written in C, it's free.

NetPIPE with ibverbs and mpi support - builds on RHEL and Fedora