`<font face="Default Sans Serif,Verdana,Arial,Helvetica,sans-serif" size="2"><div><br></div><br><font color="#990099">-----Rune Tipsmark <rt@steait.net> skrev: -----</font><div class="iNotesHistory" style="padding-left:5px;"><div style="padding-right:0px;padding-left:5px;border-left:solid black 2px;">Till: Johan Kragsterman <johan.kragsterman@capvert.se><br>Från: Rune Tipsmark <rt@steait.net><br>Datum: 2015-03-07 17:14<br>Kopia: 'Nate Smith' <nsmith@careyweb.com>, 'Richard Elling' <richard.elling@richardelling.com>, "omnios-discuss@lists.omniti.com" <omnios-discuss@lists.omniti.com><br>Ärende: RE: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks?<br><br><div><font face="Courier New,Courier,monospace" size="3">ok, so HP has a riser and the FC cards are sitting in the riser. SM has no riser and all cards are inserted directly onto motherboard.<br><br>Also I just remembered... when I had the Infiniband ConnectX2 installed in the SM it would not reboot and I always had to reset it via IPMI. <br><br>The more I think about it the more I lean towards SM having an issue... and Dell uses essentially SM so same same.<br><br>br,<br>Rune<br><br><br><br><br>So, not a PCI bridge issue, then. The contrary, in fact. It works with the bridge, but not without....So that's obviously not the problem. But good to get it sorted....</font></div><div><font face="Courier New,Courier,monospace" size="3"><br></font></div><div><font face="Courier New,Courier,monospace" size="3">Johan<br><br><br><br><br><br>________________________________________<br>From: Johan Kragsterman <johan.kragsterman@capvert.se><br>Sent: Saturday, March 7, 2015 4:24 PM<br>To: Rune Tipsmark<br>Cc: 'Nate Smith'; 'Richard Elling'; omnios-discuss@lists.omniti.com<br>Subject: Ang: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks?<br><br>-----"OmniOS-discuss" <omnios-discuss-bounces@lists.omniti.com> skrev: -----<br>Till: "'Nate Smith'" <nsmith@careyweb.com>, "'Richard Elling'" <richard.elling@richardelling.com><br>Från: Rune Tipsmark<br>Sänt av: "OmniOS-discuss"<br>Datum: 2015-03-07 04:06<br>Kopia: "omnios-discuss@lists.omniti.com" <omnios-discuss@lists.omniti.com><br>Ärende: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks?<br><br>No idea to be honest, even if there is its scary if it can cause these kinds of problems…<br><br>Br,<br><br>Rune<br><br><br><br><br><br><br>You don't know wether these systems got risers or not?<br><br>That can't be difficult to find out: Are the HBA's located directly in PCIe slots on the system board, or are they instead located in riser boards that sits in the PCIe slots?<br><br>It would be very interesting to find out....<br><br>If Richards theory is correct, you got HBA's sitting in risers on the Supermicro, but on the HP you got the HBA's directly in the PCIe slots on the system board.<br><br> Rgrds Johan<br><br><br><br><br><br><br>From: OmniOS-discuss [<a href="mailto:omnios-discuss-bounces@lists.omniti.com">mailto:omnios-discuss-bounces@lists.omniti.com</a>] On Behalf Of Nate Smith<br>Sent: Friday, March 06, 2015 8:57 AM<br>To: 'Richard Elling'<br>Cc: omnios-discuss@lists.omniti.com<br>Subject: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks?<br><br><br><br>Yeah, there is on R720s, I think. What about on the Supermicro and HP servers?<br><br><br><br>From: Richard Elling [<a href="mailto:richard.elling@richardelling.com">mailto:richard.elling@richardelling.com</a>]<br>Sent: Friday, March 06, 2015 11:39 AM<br>To: Nate Smith<br>Cc: omnios-discuss@lists.omniti.com<br>Subject: Re: [OmniOS-discuss] QLE2652 I/O Disconnect. Heat Sinks?<br><br><br><br><br><br>On Mar 5, 2015, at 6:00 AM, Nate Smith <nsmith@careyweb.com> wrote:<br><br><br><br>I’ve had this problem for a while, and I have no way to diagnose what is going on, but occasionally when system IO gets high (I’ve seen it happen especially on backups), I will lose connectivity with my Fibre Channel cards which serve up fibre channel LUNS to a VM cluster. All hell breaks loose, and then connectivity gets restored. I don’t get an error that it’s dropped, at least not on the Omnios system, but I get notice when it’s restored (which makes no sense). I’m wondering if the cards are just overheating, and if heat sinks with a fan would help on the io chip.<br><br><br><br>Is there a PCI bridge in the data path? These can often be found on mezzanine or riser cards.<br><br> -- richard<br><br><br><br><br><br>Mar 5 01:55:01 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt2,0 LINK UP, portid 20000, topology Fabric Pt-to-Pt,speed 8G<br><br>Mar 5 01:56:26 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt0,0 LINK UP, portid 20100, topology Fabric Pt-to-Pt,speed 8G<br><br>Mar 5 02:00:13 newstorm last message repeated 1 time<br><br>Mar 5 02:00:15 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt3,0 LINK UP, portid 10000, topology Fabric Pt-to-Pt,speed 8G<br><br>Mar 5 02:00:15 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt2,0 LINK UP, portid 20000, topology Fabric Pt-to-Pt,speed 8G<br><br>Mar 5 02:00:18 newstorm fct: [ID 132490 kern.notice] NOTICE: qlt1,0 LINK UP, portid 10100, topology Fabric Pt-to-Pt,speed 8G<br><br>_______________________________________________<br>OmniOS-discuss mailing list<br>OmniOS-discuss@lists.omniti.com<br><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br><br><br><br>_______________________________________________<br>OmniOS-discuss mailing list<br>OmniOS-discuss@lists.omniti.com<br><a href="http://lists.omniti.com/mailman/listinfo/omnios-discuss">http://lists.omniti.com/mailman/listinfo/omnios-discuss</a><br><br><br><br></font></div></div></div><div></div></font>
`