# [OmniOS-discuss] Illumos and Infiniband

Ian Kaufman ikaufman at eng.ucsd.edu
Wed Jan 29 19:24:49 UTC 2014

- Previous message: [OmniOS-discuss] Illumos and Infiniband
- Next message: [OmniOS-discuss] Illumos and Infiniband
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

    On my systems, the X-2 cards claim 32 gbps. I sued IPoIB, and have
    seen transfers NFS transfers over 6 gbps and snapshot send/receive as
    high as 1.8 gbps while the system was simultaneously utilized during
    cluster computation.

    Ian

    On Wed, Jan 29, 2014 at 11:17 AM, David Bomba <turbo124 at gmail.com> wrote:
    > Hi Chris,
    >
    > We have an environment running OmniOS with both ConnectX and ConnectX-2
    > cards. The Hermon and Tavor drivers work very well.
    >
    > The only problem we had was that the CX-2 cards would only sync at 20gb/s.
    > We export Comstar iSER targets and they have been rock solid for us for over
    > a year.
    >
    > Dave
    >
    >
    > On 30 January 2014 05:38, Chris Zembower <zembower at criterion.com> wrote:
    >>
    >>
    >> Hello,
    >>
    >> I'm trying to dig up some information on Illumos (or Solaris)
    >> compatibility with the Mellanox ConnectX-3 VPI HCA. From what I can gather,
    >> the Hermon driver (for 1st-gen ConnectX) may work with this hardware with
    >> tweaking, but I can't seem to confirm that.
    >>
    >> OmniOS is my server OS of choice (I have several systems running), but the
    >> necessity of a working IB fabric here has led me to implement a ZFS on Linux
    >> box for this particular purpose. I'm currently using LIO/targetcli to export
    >> block SRP targets, and I'm not happy with it at all. Really wishing I had
    >> Comstar for this.
    >>
    >> Anyone here using IB with OmniOS? Anyone aware of a roadmap or active
    >> development of new IB drivers? Why isn't there an Illumos OFED port
    >> happening? No interest? It's thriving on the Linux side of the world...
    >>
    >> Please don't lecture me on the merits of 10GbE/FC over Infiniband, I've
    >> heard it all. :-)
    >>
    >> Any insights or suggestions are very much appreciated!
    >>
    >> Best,
    >> Chris
    >>
    >> _______________________________________________
    >> OmniOS-discuss mailing list
    >> OmniOS-discuss at lists.omniti.com
    >> http://lists.omniti.com/mailman/listinfo/omnios-discuss
    >>
    >
    >
    > _______________________________________________
    > OmniOS-discuss mailing list
    > OmniOS-discuss at lists.omniti.com
    > http://lists.omniti.com/mailman/listinfo/omnios-discuss
    >

    --
    Ian Kaufman
    Research Systems Administrator
    UC San Diego, Jacobs School of Engineering ikaufman AT ucsd DOT edu

- Previous message: [OmniOS-discuss] Illumos and Infiniband
- Next message: [OmniOS-discuss] Illumos and Infiniband
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

More information about the OmniOS-discuss mailing list