From esproul at omniti.com  Thu Aug  2 11:15:46 2012
From: esproul at omniti.com (Eric Sproul)
Date: Thu, 2 Aug 2012 11:15:46 -0400
Subject: [OmniOS-discuss] Updated release: r151002r
Message-ID: <CA+QY2RRB30959bkePENpWpqqX9_9+nPL67BaeTGsjA734CfrWA@mail.gmail.com>

aka The Pirate Update   "Arrr!"

OmniOS weekly release r151002r updates developer/gcc46 with some
additional dependencies, updates network/dns/bind and
system/pciutils/pci.ids to their latest releases.

http://omnios.omniti.com/wiki.php/ReleaseNotes#r151002r

From nagele at wildbit.com  Sat Aug  4 19:41:47 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Sat, 4 Aug 2012 19:41:47 -0400
Subject: [OmniOS-discuss] Low latency networking
Message-ID: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>

I've been testing an environment before we send it over to the data
center. The setup is an OmniOS install (Supermicro X9, 24 drives,
DDRdrive for ZIL) used as an NFS file server and multiple Debian
machines connected via directly attached 10GB SFP+ twin-axial cables.
We went with the 10Gb in order to get lower latency to compensate for
the high TCP overhead of NFS.

For some reason, I can't get ping times below 0.2ms when using OmniOS.
If I install Debian on the same machines I get consistent 0.08ms
between the machines. In addition, iperf shows a maximum of 6.6Gb/s on
OmniOS, and about 9.89Gb/s on Debian.

We are using the x520-DA2, which is well supported in Illumos. I also
tried on Nexenta and OpenIndiana with the same result. I was thinking
of trying different cards (Myricom maybe), different cabling (CX4?),
or even Infiniband since it is known for low latency.

Any recommendations? I am wondering if I just need to adjust some
tunables or maybe update a driver.

Thanks,
Chris

From richard.elling at richardelling.com  Sat Aug  4 23:06:18 2012
From: richard.elling at richardelling.com (Richard Elling)
Date: Sat, 4 Aug 2012 20:06:18 -0700
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
Message-ID: <0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>

Hi Chris,
Check all cable ends for errors. In an extreme case, we sent an Engineer to Germany
to solve a "performance problem" that turned out to be a bad SFP+ transceiver. The bill
was, shall we say, higher than the average service call :-)
 -- richard

On Aug 4, 2012, at 4:41 PM, Chris Nagele wrote:

> I've been testing an environment before we send it over to the data
> center. The setup is an OmniOS install (Supermicro X9, 24 drives,
> DDRdrive for ZIL) used as an NFS file server and multiple Debian
> machines connected via directly attached 10GB SFP+ twin-axial cables.
> We went with the 10Gb in order to get lower latency to compensate for
> the high TCP overhead of NFS.
> 
> For some reason, I can't get ping times below 0.2ms when using OmniOS.
> If I install Debian on the same machines I get consistent 0.08ms
> between the machines. In addition, iperf shows a maximum of 6.6Gb/s on
> OmniOS, and about 9.89Gb/s on Debian.
> 
> We are using the x520-DA2, which is well supported in Illumos. I also
> tried on Nexenta and OpenIndiana with the same result. I was thinking
> of trying different cards (Myricom maybe), different cabling (CX4?),
> or even Infiniband since it is known for low latency.
> 
> Any recommendations? I am wondering if I just need to adjust some
> tunables or maybe update a driver.
> 
> Thanks,
> Chris
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss

--
ZFS Performance and Training
Richard.Elling at RichardElling.com
+1-760-896-4422



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120804/23423944/attachment.html>

From nagele at wildbit.com  Sun Aug  5 10:41:53 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Sun, 5 Aug 2012 10:41:53 -0400
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
	<0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
Message-ID: <CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>

Hi Richard,

> Check all cable ends for errors. In an extreme case, we sent an Engineer to
> Germany
> to solve a "performance problem" that turned out to be a bad SFP+
> transceiver. The bill
> was, shall we say, higher than the average service call :-)

At first I thought that was the issue, but I tested in Debian and got
sub 1ms ping times and much faster NFS benchmarks. I adjusted the
ixgbe.conf file and set the following:

default_mtu=9000;
intr_throttling=0;

Reference: http://www.oracle.com/technetwork/database/focus-areas/bi-datawarehousing/sas/o11-075-sas-grid-computing-485336.html

This got the ping times down from 0.225ms to 0.17ms. I'm still trying
to get closer to the 0.08ms that I get on Debian.

What are your thoughts on Infiniband?

Chris

From nagele at wildbit.com  Sun Aug  5 20:07:29 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Sun, 5 Aug 2012 20:07:29 -0400
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
	<0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
	<CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>
Message-ID: <CAHfYOdUt=+ekDiVgCh0gAoC228DCXJfFAy89xavA4uhgKUAK6A@mail.gmail.com>

Update:

I was able to get iperf results of 9.89Gb/s each way, between Debian
and OmniOS.

I accomplished this by setting intr_throttling=1; in the
/kernel.drv/ixgbe.conf file on OmniOS.

Reference: http://support.ap.dell.com/support/edocs/network/intelpro/r195641/en/ixgbe.htm

For some reason though, ping times from OmniOS to Debian are still
much slower, above 0.2ms. I know it is nit picking, but we invested in
10g for lower latency, so I am trying to get the most out of it. From
Debian to OmniOS I get about 0.08ms still.

-Chris


On Sun, Aug 5, 2012 at 10:41 AM, Chris Nagele <nagele at wildbit.com> wrote:
> Hi Richard,
>
>> Check all cable ends for errors. In an extreme case, we sent an Engineer to
>> Germany
>> to solve a "performance problem" that turned out to be a bad SFP+
>> transceiver. The bill
>> was, shall we say, higher than the average service call :-)
>
> At first I thought that was the issue, but I tested in Debian and got
> sub 1ms ping times and much faster NFS benchmarks. I adjusted the
> ixgbe.conf file and set the following:
>
> default_mtu=9000;
> intr_throttling=0;
>
> Reference: http://www.oracle.com/technetwork/database/focus-areas/bi-datawarehousing/sas/o11-075-sas-grid-computing-485336.html
>
> This got the ping times down from 0.225ms to 0.17ms. I'm still trying
> to get closer to the 0.08ms that I get on Debian.
>
> What are your thoughts on Infiniband?
>
> Chris

From esproul at omniti.com  Mon Aug  6 10:06:02 2012
From: esproul at omniti.com (Eric Sproul)
Date: Mon, 6 Aug 2012 10:06:02 -0400
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <CAHfYOdUt=+ekDiVgCh0gAoC228DCXJfFAy89xavA4uhgKUAK6A@mail.gmail.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
	<0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
	<CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>
	<CAHfYOdUt=+ekDiVgCh0gAoC228DCXJfFAy89xavA4uhgKUAK6A@mail.gmail.com>
Message-ID: <CA+QY2RS_rC6Z6B6sojjH1KHBHszEYLp+FA4rAUcKWuAXJCXJ9g@mail.gmail.com>

On Sun, Aug 5, 2012 at 8:07 PM, Chris Nagele <nagele at wildbit.com> wrote:
> For some reason though, ping times from OmniOS to Debian are still
> much slower, above 0.2ms. I know it is nit picking, but we invested in
> 10g for lower latency, so I am trying to get the most out of it. From
> Debian to OmniOS I get about 0.08ms still.

Hi Chris,
It'd be great to see some tcpdumps of this traffic.  The most curious
thing to me is that you see differences in RTT between Debian and
OmniOS systems just by switching sender and receiver.  Perhaps there's
something about the payload of a typical ping packet between the
systems.

Eric

From nagele at wildbit.com  Mon Aug  6 12:07:40 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Mon, 6 Aug 2012 12:07:40 -0400
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <CA+QY2RS_rC6Z6B6sojjH1KHBHszEYLp+FA4rAUcKWuAXJCXJ9g@mail.gmail.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
	<0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
	<CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>
	<CAHfYOdUt=+ekDiVgCh0gAoC228DCXJfFAy89xavA4uhgKUAK6A@mail.gmail.com>
	<CA+QY2RS_rC6Z6B6sojjH1KHBHszEYLp+FA4rAUcKWuAXJCXJ9g@mail.gmail.com>
Message-ID: <CAHfYOdUgP=2dzuRQ4bg_VZfAen7HvuKDwU5RuEX-sy5rX3VTsA@mail.gmail.com>

Hi Eric,

Richard had me run:

truss -dD ping -s 10.135.1.11

>From this result I can't seem to find anything useful. The longest
time is taken at the top:

0.0556  0.0000 write(1, "\n", 1)                               = 1
 0.9975  0.9419     Received signal #14, SIGALRM, in pollsys() [caught]
 0.9976  0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000)  Err#4 EINTR
 0.9976  0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,
0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
 0.9976  0.0000 sendto(3, "\b\0 AA3068A\001 lE51F P".., 64, 32768,
0x0807BA90, 16) = 64
 0.9977  0.0001 alarm(1)                                        = 0
 0.9977  0.0000 setcontext(0x08047660)
 0.9978  0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000)  = 1
 0.9978  0.0000 recvmsg(3, 0x08047CD0, 32768)                   = 84
 0.9978  0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,
0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
 0.9978  0.0000 lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000,
0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
64 bytes from 10.135.1.11:  0.9979       0.0001 write(1, " 6 4   b y t
e s   f r o".., 27)      = 27
icmp_seq=1.  0.9979      0.0000 write(1, " i c m p _ s e q = 1 .  ",
12)        = 12
time=0.225 ms 0.9980     0.0001 write(1, " t i m e = 0 . 2 2 5   m"..,
13)      = 13

Looking at snoop, I see the following:

 18.34001  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
(ID: 1780 Sequence number: 5)
 18.34019  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
(ID: 1780 Sequence number: 5)
 18.34641  debian-host -> *            length:   60  ARP C Who is
10.135.1.10, 10.135.1.10 ?
 18.34643  10.135.1.10 -> debian-host  length:   42  ARP R
10.135.1.10, 10.135.1.10 is 90:e2:ba:f:ce:ec
 19.34000  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
(ID: 1780 Sequence number: 6)
 19.34018  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
(ID: 1780 Sequence number: 6)
 20.33998  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
(ID: 1780 Sequence number: 7)
 20.34015  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
(ID: 1780 Sequence number: 7)

Which all looks pretty normal as well. I might give superping.d a try
as well (http://www.c0t0d0s0.org/archives/7479-Dont-misuse-ping!.html).

Let me know if you have any other ideas.

Thanks,
Chris


On Mon, Aug 6, 2012 at 10:06 AM, Eric Sproul <esproul at omniti.com> wrote:
> On Sun, Aug 5, 2012 at 8:07 PM, Chris Nagele <nagele at wildbit.com> wrote:
>> For some reason though, ping times from OmniOS to Debian are still
>> much slower, above 0.2ms. I know it is nit picking, but we invested in
>> 10g for lower latency, so I am trying to get the most out of it. From
>> Debian to OmniOS I get about 0.08ms still.
>
> Hi Chris,
> It'd be great to see some tcpdumps of this traffic.  The most curious
> thing to me is that you see differences in RTT between Debian and
> OmniOS systems just by switching sender and receiver.  Perhaps there's
> something about the payload of a typical ping packet between the
> systems.
>
> Eric
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss

From nagele at wildbit.com  Mon Aug  6 13:07:56 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Mon, 6 Aug 2012 13:07:56 -0400
Subject: [OmniOS-discuss] Dtrace errors
Message-ID: <CAHfYOdXaEYM+s7+YG0sPVE9FjMAaHzfv+r+GwcuRm7Y-90StmQ@mail.gmail.com>

I've been doing some testing and trying to run common dtrace scripts
like zilstat. For almost all of them, I get the error:

"/usr/lib/dtrace/nfssrv.d", line 34: operator . cannot be applied to
type "struct intpdata *"; must be applied to a struct or union

Is this something I can fix on my side?

-Chris

From jesus at omniti.com  Mon Aug  6 20:33:18 2012
From: jesus at omniti.com (Theo Schlossnagle)
Date: Mon, 6 Aug 2012 20:33:18 -0400
Subject: [OmniOS-discuss] Dtrace errors
In-Reply-To: <CAHfYOdXaEYM+s7+YG0sPVE9FjMAaHzfv+r+GwcuRm7Y-90StmQ@mail.gmail.com>
References: <CAHfYOdXaEYM+s7+YG0sPVE9FjMAaHzfv+r+GwcuRm7Y-90StmQ@mail.gmail.com>
Message-ID: <CACLsApv92ZEufQ5xuYKbCnMzWOsUJgdZXDe8ovnkfr1VoM+4FQ@mail.gmail.com>

Can you try moving that file out of the way.. just move it to ~root/
and see if the errors go away.

I've seen odd dtrace provider definition regressions before -- but not this one.

On Mon, Aug 6, 2012 at 1:07 PM, Chris Nagele <nagele at wildbit.com> wrote:
> I've been doing some testing and trying to run common dtrace scripts
> like zilstat. For almost all of them, I get the error:
>
> "/usr/lib/dtrace/nfssrv.d", line 34: operator . cannot be applied to
> type "struct intpdata *"; must be applied to a struct or union
>
> Is this something I can fix on my side?
>
> -Chris
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss



-- 
Theo Schlossnagle

http://omniti.com/is/theo-schlossnagle

From nagele at wildbit.com  Tue Aug  7 09:43:01 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Tue, 7 Aug 2012 09:43:01 -0400
Subject: [OmniOS-discuss] Dtrace errors
In-Reply-To: <CACLsApv92ZEufQ5xuYKbCnMzWOsUJgdZXDe8ovnkfr1VoM+4FQ@mail.gmail.com>
References: <CAHfYOdXaEYM+s7+YG0sPVE9FjMAaHzfv+r+GwcuRm7Y-90StmQ@mail.gmail.com>
	<CACLsApv92ZEufQ5xuYKbCnMzWOsUJgdZXDe8ovnkfr1VoM+4FQ@mail.gmail.com>
Message-ID: <CAHfYOdU4iNgFBUAJJvFXJsrAUisFR-o7TgOjqKRWN2n1XNVcVg@mail.gmail.com>

Yep, that worked.

-Chris


On Mon, Aug 6, 2012 at 8:33 PM, Theo Schlossnagle <jesus at omniti.com> wrote:
> Can you try moving that file out of the way.. just move it to ~root/
> and see if the errors go away.
>
> I've seen odd dtrace provider definition regressions before -- but not this one.
>
> On Mon, Aug 6, 2012 at 1:07 PM, Chris Nagele <nagele at wildbit.com> wrote:
>> I've been doing some testing and trying to run common dtrace scripts
>> like zilstat. For almost all of them, I get the error:
>>
>> "/usr/lib/dtrace/nfssrv.d", line 34: operator . cannot be applied to
>> type "struct intpdata *"; must be applied to a struct or union
>>
>> Is this something I can fix on my side?
>>
>> -Chris
>> _______________________________________________
>> OmniOS-discuss mailing list
>> OmniOS-discuss at lists.omniti.com
>> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>
>
>
> --
> Theo Schlossnagle
>
> http://omniti.com/is/theo-schlossnagle

From info at thetube.ch  Tue Aug  7 10:55:23 2012
From: info at thetube.ch (Benjamin Grogg)
Date: Tue, 7 Aug 2012 16:55:23 +0200
Subject: [OmniOS-discuss] Old OpenSolaris Zones in OmniOS?
Message-ID: <CAHGPa8qsMWwz+Ug83FzQ1Es_kvJGV1=5pKOuSmW4LQsjsMtyzQ@mail.gmail.com>

Dear List,

I run OpenSolaris svn_134 on my Homeserver. My idea is switch to OmniOS.
The base installation is on a single physical disk. All data are in a
mirrored pool (two other physical disks).
I have 7 ipkg zones (Data on the mirrored pool).
Now my questions :

1) Can I use (import) my 7 zones under OmniOS or I have create all
zones from scratch?
2) I run VirtualBox in a Zone. Anyone try this under OmniOS? (If it's
possible to run KVM on a AMD-V I would switch)

Best regards,
benjamin

From jesus at omniti.com  Tue Aug  7 11:06:33 2012
From: jesus at omniti.com (Theo Schlossnagle)
Date: Tue, 7 Aug 2012 11:06:33 -0400
Subject: [OmniOS-discuss] Old OpenSolaris Zones in OmniOS?
In-Reply-To: <CAHGPa8qsMWwz+Ug83FzQ1Es_kvJGV1=5pKOuSmW4LQsjsMtyzQ@mail.gmail.com>
References: <CAHGPa8qsMWwz+Ug83FzQ1Es_kvJGV1=5pKOuSmW4LQsjsMtyzQ@mail.gmail.com>
Message-ID: <CACLsApvuU8uqi9YWKUsJDK-yM0Pgwgw5yG5f+GqxGSmdBwqTWA@mail.gmail.com>

On Tue, Aug 7, 2012 at 10:55 AM, Benjamin Grogg <info at thetube.ch> wrote:
> Dear List,
>
> I run OpenSolaris svn_134 on my Homeserver. My idea is switch to OmniOS.
> The base installation is on a single physical disk. All data are in a
> mirrored pool (two other physical disks).
> I have 7 ipkg zones (Data on the mirrored pool).
> Now my questions :
>
> 1) Can I use (import) my 7 zones under OmniOS or I have create all
> zones from scratch?

ipkg does upgrade on import and my guess is that this will be utter
hell.  I think you're going to have to redo them.

> 2) I run VirtualBox in a Zone. Anyone try this under OmniOS? (If it's
> possible to run KVM on a AMD-V I would switch)

Virtualbox in a zone works fine.  You'll likely have a better overall
experience with KVM on Intel. AMD-V is not currently supported on
illumos-kvm.

-- 
Theo Schlossnagle

http://omniti.com/is/theo-schlossnagle

From esproul at omniti.com  Tue Aug  7 15:34:33 2012
From: esproul at omniti.com (Eric Sproul)
Date: Tue, 7 Aug 2012 15:34:33 -0400
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <CAHfYOdUgP=2dzuRQ4bg_VZfAen7HvuKDwU5RuEX-sy5rX3VTsA@mail.gmail.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
	<0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
	<CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>
	<CAHfYOdUt=+ekDiVgCh0gAoC228DCXJfFAy89xavA4uhgKUAK6A@mail.gmail.com>
	<CA+QY2RS_rC6Z6B6sojjH1KHBHszEYLp+FA4rAUcKWuAXJCXJ9g@mail.gmail.com>
	<CAHfYOdUgP=2dzuRQ4bg_VZfAen7HvuKDwU5RuEX-sy5rX3VTsA@mail.gmail.com>
Message-ID: <CA+QY2RTL5GhV72uECOuSEQ=ZywO=CvfFZVonkzDsgMOzAzFwHw@mail.gmail.com>

On Mon, Aug 6, 2012 at 12:07 PM, Chris Nagele <nagele at wildbit.com> wrote:
> Hi Eric,
>
> Richard had me run:
>
> truss -dD ping -s 10.135.1.11

Chris,
If you don't already have this set, could you try activating the
high-res timer?  By default the system timer is 10ms (100 Hz) but if
you set the following in /etc/system:

set hires_tick = 1

it changes to 1ms (1000 Hz).  Among other things, this affects sleep
and wait calls which might be artificially inflating latency in
programs like ping.

Eric

From richard.elling at richardelling.com  Tue Aug  7 16:12:31 2012
From: richard.elling at richardelling.com (Richard Elling)
Date: Tue, 7 Aug 2012 13:12:31 -0700
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <CAHfYOdUgP=2dzuRQ4bg_VZfAen7HvuKDwU5RuEX-sy5rX3VTsA@mail.gmail.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
	<0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
	<CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>
	<CAHfYOdUt=+ekDiVgCh0gAoC228DCXJfFAy89xavA4uhgKUAK6A@mail.gmail.com>
	<CA+QY2RS_rC6Z6B6sojjH1KHBHszEYLp+FA4rAUcKWuAXJCXJ9g@mail.gmail.com>
	<CAHfYOdUgP=2dzuRQ4bg_VZfAen7HvuKDwU5RuEX-sy5rX3VTsA@mail.gmail.com>
Message-ID: <A2C172A3-5344-48E5-BBEC-50F067F5325D@RichardElling.com>

Hi Chris,

On Aug 6, 2012, at 9:07 AM, Chris Nagele wrote:

> Hi Eric,
> 
> Richard had me run:
> 
> truss -dD ping -s 10.135.1.11
> 
> From this result I can't seem to find anything useful. The longest
> time is taken at the top:
> 
> 0.0556  0.0000 write(1, "\n", 1)                               = 1
> 0.9975  0.9419     Received signal #14, SIGALRM, in pollsys() [caught]

It is already over by now. Look for the difference between the first sendto(3, ...) and 
recvmsg(3,...) something like:

 0.0210  0.0013 write(1, " P I N G   1 9 2 . 1 6 8".., 34)      = 34
 0.0212  0.0002 sendto(3, "\b\0F6 ^\r1F\0\0   U1F P".., 64, 32768, 0x0806BD88, 16) = 64
 0.0214  0.0002 sigaction(SIGALRM, 0x08047BA0, 0x08047C20)      = 0
 0.0215  0.0001 lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000, 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
 0.0216  0.0001 alarm(1)                                        = 0
 0.0220  0.0004 pollsys(0x08047AA0, 1, 0x00000000, 0x00000000)  = 1
 0.0222  0.0002 recvmsg(3, 0x08047C10, 32768)                   = 84

 -- richard

> 0.9976  0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000)  Err#4 EINTR
> 0.9976  0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,
> 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
> 0.9976  0.0000 sendto(3, "\b\0 AA3068A\001 lE51F P".., 64, 32768,
> 0x0807BA90, 16) = 64
> 0.9977  0.0001 alarm(1)                                        = 0
> 0.9977  0.0000 setcontext(0x08047660)
> 0.9978  0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000)  = 1
> 0.9978  0.0000 recvmsg(3, 0x08047CD0, 32768)                   = 84
> 0.9978  0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,
> 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
> 0.9978  0.0000 lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000,
> 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
> 64 bytes from 10.135.1.11:  0.9979       0.0001 write(1, " 6 4   b y t
> e s   f r o".., 27)      = 27
> icmp_seq=1.  0.9979      0.0000 write(1, " i c m p _ s e q = 1 .  ",
> 12)        = 12
> time=0.225 ms 0.9980     0.0001 write(1, " t i m e = 0 . 2 2 5   m"..,
> 13)      = 13
> 
> Looking at snoop, I see the following:
> 
> 18.34001  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
> (ID: 1780 Sequence number: 5)
> 18.34019  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
> (ID: 1780 Sequence number: 5)
> 18.34641  debian-host -> *            length:   60  ARP C Who is
> 10.135.1.10, 10.135.1.10 ?
> 18.34643  10.135.1.10 -> debian-host  length:   42  ARP R
> 10.135.1.10, 10.135.1.10 is 90:e2:ba:f:ce:ec
> 19.34000  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
> (ID: 1780 Sequence number: 6)
> 19.34018  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
> (ID: 1780 Sequence number: 6)
> 20.33998  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
> (ID: 1780 Sequence number: 7)
> 20.34015  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
> (ID: 1780 Sequence number: 7)
> 
> Which all looks pretty normal as well. I might give superping.d a try
> as well (http://www.c0t0d0s0.org/archives/7479-Dont-misuse-ping!.html).
> 
> Let me know if you have any other ideas.
> 
> Thanks,
> Chris
> 
> 
> On Mon, Aug 6, 2012 at 10:06 AM, Eric Sproul <esproul at omniti.com> wrote:
>> On Sun, Aug 5, 2012 at 8:07 PM, Chris Nagele <nagele at wildbit.com> wrote:
>>> For some reason though, ping times from OmniOS to Debian are still
>>> much slower, above 0.2ms. I know it is nit picking, but we invested in
>>> 10g for lower latency, so I am trying to get the most out of it. From
>>> Debian to OmniOS I get about 0.08ms still.
>> 
>> Hi Chris,
>> It'd be great to see some tcpdumps of this traffic.  The most curious
>> thing to me is that you see differences in RTT between Debian and
>> OmniOS systems just by switching sender and receiver.  Perhaps there's
>> something about the payload of a typical ping packet between the
>> systems.
>> 
>> Eric
>> _______________________________________________
>> OmniOS-discuss mailing list
>> OmniOS-discuss at lists.omniti.com
>> http://lists.omniti.com/mailman/listinfo/omnios-discuss
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss

--
ZFS Performance and Training
Richard.Elling at RichardElling.com
+1-760-896-4422



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120807/83f85b88/attachment.html>

From nagele at wildbit.com  Wed Aug  8 10:01:29 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Wed, 8 Aug 2012 10:01:29 -0400
Subject: [OmniOS-discuss] Low latency networking
In-Reply-To: <A2C172A3-5344-48E5-BBEC-50F067F5325D@RichardElling.com>
References: <CAHfYOdUAP=F8P=Sb2eGVxAb0SLE0HmSdRoUYBXvsJ1RPwdCULA@mail.gmail.com>
	<0B4E9F76-9A90-4E29-A7E5-33DF48714B11@RichardElling.com>
	<CAHfYOdXO2ENi_gp1D2G2enr9F1ndmHMzd-AVPPLaGBFjKtkagg@mail.gmail.com>
	<CAHfYOdUt=+ekDiVgCh0gAoC228DCXJfFAy89xavA4uhgKUAK6A@mail.gmail.com>
	<CA+QY2RS_rC6Z6B6sojjH1KHBHszEYLp+FA4rAUcKWuAXJCXJ9g@mail.gmail.com>
	<CAHfYOdUgP=2dzuRQ4bg_VZfAen7HvuKDwU5RuEX-sy5rX3VTsA@mail.gmail.com>
	<A2C172A3-5344-48E5-BBEC-50F067F5325D@RichardElling.com>
Message-ID: <CAHfYOdWwhRhD6czFc9rznmjOosJUHv-O3_o2grVLmyXBryA8OA@mail.gmail.com>

Nice. So the actual latency is really short. Now that I have dtrace
working I'll give superping.d a try as well.

Thanks!

On Tue, Aug 7, 2012 at 4:12 PM, Richard Elling
<richard.elling at richardelling.com> wrote:
> Hi Chris,
>
> On Aug 6, 2012, at 9:07 AM, Chris Nagele wrote:
>
> Hi Eric,
>
> Richard had me run:
>
> truss -dD ping -s 10.135.1.11
>
> From this result I can't seem to find anything useful. The longest
> time is taken at the top:
>
> 0.0556  0.0000 write(1, "\n", 1)                               = 1
> 0.9975  0.9419     Received signal #14, SIGALRM, in pollsys() [caught]
>
>
> It is already over by now. Look for the difference between the first
> sendto(3, ...) and
> recvmsg(3,...) something like:
>
>  0.0210  0.0013 write(1, " P I N G   1 9 2 . 1 6 8".., 34)      = 34
>  0.0212  0.0002 sendto(3, "\b\0F6 ^\r1F\0\0   U1F P".., 64, 32768,
> 0x0806BD88, 16) = 64
>  0.0214  0.0002 sigaction(SIGALRM, 0x08047BA0, 0x08047C20)      = 0
>  0.0215  0.0001 lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000, 0x00000000,
> 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
>  0.0216  0.0001 alarm(1)                                        = 0
>  0.0220  0.0004 pollsys(0x08047AA0, 1, 0x00000000, 0x00000000)  = 1
>  0.0222  0.0002 recvmsg(3, 0x08047C10, 32768)                   = 84
>
>  -- richard
>
> 0.9976  0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000)  Err#4 EINTR
> 0.9976  0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,
> 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
> 0.9976  0.0000 sendto(3, "\b\0 AA3068A\001 lE51F P".., 64, 32768,
> 0x0807BA90, 16) = 64
> 0.9977  0.0001 alarm(1)                                        = 0
> 0.9977  0.0000 setcontext(0x08047660)
> 0.9978  0.0001 pollsys(0x08047B50, 1, 0x00000000, 0x00000000)  = 1
> 0.9978  0.0000 recvmsg(3, 0x08047CD0, 32768)                   = 84
> 0.9978  0.0000 lwp_sigmask(SIG_SETMASK, 0x00002000, 0x00000000,
> 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
> 0.9978  0.0000 lwp_sigmask(SIG_SETMASK, 0x00000000, 0x00000000,
>
> 0x00000000, 0x00000000) = 0xFFBFFEFF [0xFFFFFFFF]
> 64 bytes from 10.135.1.11:  0.9979       0.0001 write(1, " 6 4   b y t
> e s   f r o".., 27)      = 27
> icmp_seq=1.  0.9979      0.0000 write(1, " i c m p _ s e q = 1 .  ",
> 12)        = 12
> time=0.225 ms 0.9980     0.0001 write(1, " t i m e = 0 . 2 2 5   m"..,
> 13)      = 13
>
> Looking at snoop, I see the following:
>
> 18.34001  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
> (ID: 1780 Sequence number: 5)
> 18.34019  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
> (ID: 1780 Sequence number: 5)
> 18.34641  debian-host -> *            length:   60  ARP C Who is
> 10.135.1.10, 10.135.1.10 ?
> 18.34643  10.135.1.10 -> debian-host  length:   42  ARP R
> 10.135.1.10, 10.135.1.10 is 90:e2:ba:f:ce:ec
> 19.34000  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
> (ID: 1780 Sequence number: 6)
> 19.34018  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
> (ID: 1780 Sequence number: 6)
> 20.33998  10.135.1.10 -> debian-host  length:   98  ICMP Echo request
> (ID: 1780 Sequence number: 7)
> 20.34015  debian-host -> 10.135.1.10  length:   98  ICMP Echo reply
> (ID: 1780 Sequence number: 7)
>
> Which all looks pretty normal as well. I might give superping.d a try
> as well (http://www.c0t0d0s0.org/archives/7479-Dont-misuse-ping!.html).
>
> Let me know if you have any other ideas.
>
> Thanks,
> Chris
>
>
> On Mon, Aug 6, 2012 at 10:06 AM, Eric Sproul <esproul at omniti.com> wrote:
>
> On Sun, Aug 5, 2012 at 8:07 PM, Chris Nagele <nagele at wildbit.com> wrote:
>
> For some reason though, ping times from OmniOS to Debian are still
>
> much slower, above 0.2ms. I know it is nit picking, but we invested in
>
> 10g for lower latency, so I am trying to get the most out of it. From
>
> Debian to OmniOS I get about 0.08ms still.
>
>
> Hi Chris,
>
> It'd be great to see some tcpdumps of this traffic.  The most curious
>
> thing to me is that you see differences in RTT between Debian and
>
> OmniOS systems just by switching sender and receiver.  Perhaps there's
>
> something about the payload of a typical ping packet between the
>
> systems.
>
>
> Eric
>
> _______________________________________________
>
> OmniOS-discuss mailing list
>
> OmniOS-discuss at lists.omniti.com
>
> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>
>
> --
> ZFS Performance and Training
> Richard.Elling at RichardElling.com
> +1-760-896-4422
>
>
>

From henson at acm.org  Wed Aug  8 17:23:58 2012
From: henson at acm.org (Paul B. Henson)
Date: Wed, 08 Aug 2012 14:23:58 -0700
Subject: [OmniOS-discuss] combo storage/virtualization server
Message-ID: <5022D8EE.5030602@acm.org>

Once upon a time I was planning to set up a zfs-based storage server at 
home along with a virtualization server running either linux/kvm or 
vmware esxi. Then Oracle came along and killed off OpenSolaris, and that 
plan got put on hold (for a bit over two years now <sigh>). When Joyent 
announced kvm for illumos, I thought it would be sweet to combine the 
originally planned two separate servers into one mongo zfs/kvm/illumos 
box :).

I'm having trouble finding the perfect distribution though ;). I've been 
keeping an eye on illumian, as I didn't really enjoy working with IPS 
under OpenSolaris, and a dpkg based system sounds more palatable. 
However, a production ready version isn't quite out yet, and it looks 
like the first release isn't going to have kvm support. SmartOS is the 
clear leader for pure virtualization purposes, but the lack of 
persistent customization/configuration in the global zone makes it not 
very suitable for a storage server.

OmniOS seems production ready (although I don't think I can swing the 
$4k/yr support contract for my home deployment ;) ), includes kvm 
support, and I like the minimalistic approach for the base OS. I've been 
thinking about giving it a try, and was wondering if anybody has done 
much virtualization with it and might provide some feedback as far as 
how that's been working out.

I was also curious about the issues OmniTI had with minimizing 
OpenIndiana, and was wondering if the same issues might be encountered 
with illumian. illumian is only going to be a server OS, and not include 
any of the GUI or desktop packages, so potentially would be easier to 
minimize.

Thanks...

From jesus at omniti.com  Wed Aug  8 17:49:48 2012
From: jesus at omniti.com (Theo Schlossnagle)
Date: Wed, 8 Aug 2012 17:49:48 -0400
Subject: [OmniOS-discuss] combo storage/virtualization server
In-Reply-To: <5022D8EE.5030602@acm.org>
References: <5022D8EE.5030602@acm.org>
Message-ID: <CACLsApvvQxAzxh6w35_KA4_hHSkCaC+zXVT1DJfzLwqePXvwew@mail.gmail.com>

To be clear, you do not need a support contract to run OmniOS on your
servers. You can get community support on this list and on IRC.
Commercial support is those that run the product in an environment
where one cannot be subject to the whimsical schedules/availability of
the community and need things fixed regardless of the difficulty or
complexity of the problem.

For what you describe, OmniOS will likely meet your needs just fine.

On Wed, Aug 8, 2012 at 5:23 PM, Paul B. Henson <henson at acm.org> wrote:
> Once upon a time I was planning to set up a zfs-based storage server at home
> along with a virtualization server running either linux/kvm or vmware esxi.
> Then Oracle came along and killed off OpenSolaris, and that plan got put on
> hold (for a bit over two years now <sigh>). When Joyent announced kvm for
> illumos, I thought it would be sweet to combine the originally planned two
> separate servers into one mongo zfs/kvm/illumos box :).
>
> I'm having trouble finding the perfect distribution though ;). I've been
> keeping an eye on illumian, as I didn't really enjoy working with IPS under
> OpenSolaris, and a dpkg based system sounds more palatable. However, a
> production ready version isn't quite out yet, and it looks like the first
> release isn't going to have kvm support. SmartOS is the clear leader for
> pure virtualization purposes, but the lack of persistent
> customization/configuration in the global zone makes it not very suitable
> for a storage server.
>
> OmniOS seems production ready (although I don't think I can swing the $4k/yr
> support contract for my home deployment ;) ), includes kvm support, and I
> like the minimalistic approach for the base OS. I've been thinking about
> giving it a try, and was wondering if anybody has done much virtualization
> with it and might provide some feedback as far as how that's been working
> out.
>
> I was also curious about the issues OmniTI had with minimizing OpenIndiana,
> and was wondering if the same issues might be encountered with illumian.
> illumian is only going to be a server OS, and not include any of the GUI or
> desktop packages, so potentially would be easier to minimize.
>
> Thanks...
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss



-- 
Theo Schlossnagle

http://omniti.com/is/theo-schlossnagle

From esproul at omniti.com  Wed Aug  8 17:54:28 2012
From: esproul at omniti.com (Eric Sproul)
Date: Wed, 8 Aug 2012 17:54:28 -0400
Subject: [OmniOS-discuss] combo storage/virtualization server
In-Reply-To: <5022D8EE.5030602@acm.org>
References: <5022D8EE.5030602@acm.org>
Message-ID: <CA+QY2RQ5=wcBqx=bWapiFiaZpJHV3yEHab4=9QOKawt=uvFnGw@mail.gmail.com>

On Wed, Aug 8, 2012 at 5:23 PM, Paul B. Henson <henson at acm.org> wrote:
> OmniOS seems production ready (although I don't think I can swing the $4k/yr
> support contract for my home deployment ;) ), includes kvm support, and I
> like the minimalistic approach for the base OS. I've been thinking about
> giving it a try, and was wondering if anybody has done much virtualization
> with it and might provide some feedback as far as how that's been working
> out.

Hi Paul,
OmniTI has been using OmniOS in production for quite some time.  We do
both native zones and Linux as KVM guests in our environments.  It
works well.

>
> I was also curious about the issues OmniTI had with minimizing OpenIndiana,
> and was wondering if the same issues might be encountered with illumian.
> illumian is only going to be a server OS, and not include any of the GUI or
> desktop packages, so potentially would be easier to minimize.

The biggest issue with OpenIndiana minimization was the interlocking
incorporation dependencies.  Breaking those dependencies apart
requires publishing alternate versions of those packages to another
repo.  Once you start down the path of maintaining an alternate set of
packages, you "own" them in the sense that you're responsible for
maintaining them, incorporating upstream changes, etc.  We ended up
with OmniOS as a logical extension of that process-- by the end there
was no OI in the picture.

AIUI, Illumian is taking the Illumos core plus whatever other userland
bits they want, and packaging them with dpkg/apt.  As to their focus
on desktop vs. server or both, I have no information.

Eric

From henson at acm.org  Wed Aug  8 19:14:15 2012
From: henson at acm.org (Paul B. Henson)
Date: Wed, 08 Aug 2012 16:14:15 -0700
Subject: [OmniOS-discuss] combo storage/virtualization server
In-Reply-To: <CACLsApvvQxAzxh6w35_KA4_hHSkCaC+zXVT1DJfzLwqePXvwew@mail.gmail.com>
References: <5022D8EE.5030602@acm.org>
	<CACLsApvvQxAzxh6w35_KA4_hHSkCaC+zXVT1DJfzLwqePXvwew@mail.gmail.com>
Message-ID: <5022F2C7.5030305@acm.org>

On 8/8/2012 2:49 PM, Theo Schlossnagle wrote:
> To be clear, you do not need a support contract to run OmniOS on your
> servers.

I know; I was just trying (and clearly failing ;) ) to be funny :).

> Commercial support is those that run the product in an environment
> where one cannot be subject to the whimsical schedules/availability of
> the community and need things fixed regardless of the difficulty or
> complexity of the problem.

Heh, 9 times out of 10 I get better support for my Solaris 10 deployment 
at $WORK from the community than from my official Oracle support 
contract 8-/. Management does like somebody to point their fingers at 
though, so the availability of commercial support for an illumos 
distribution might make it easier to someday ditch Oracle at the day job :).

> For what you describe, OmniOS will likely meet your needs just fine.

Cool, thanks for the reply.

From henson at acm.org  Wed Aug  8 19:58:01 2012
From: henson at acm.org (Paul B. Henson)
Date: Wed, 08 Aug 2012 16:58:01 -0700
Subject: [OmniOS-discuss] combo storage/virtualization server
In-Reply-To: <CA+QY2RQ5=wcBqx=bWapiFiaZpJHV3yEHab4=9QOKawt=uvFnGw@mail.gmail.com>
References: <5022D8EE.5030602@acm.org>
	<CA+QY2RQ5=wcBqx=bWapiFiaZpJHV3yEHab4=9QOKawt=uvFnGw@mail.gmail.com>
Message-ID: <5022FD09.5070108@acm.org>

On 8/8/2012 2:54 PM, Eric Sproul wrote:

> OmniTI has been using OmniOS in production for quite some time.  We do
> both native zones and Linux as KVM guests in our environments.  It
> works well.

Good to hear :), I'll definitely give it a spin.

> The biggest issue with OpenIndiana minimization was the interlocking
> incorporation dependencies.

Ah, yes, IPS <sigh>. That definitely wouldn't be a problem with illumian 
then.

> AIUI, Illumian is taking the Illumos core plus whatever other userland
> bits they want, and packaging them with dpkg/apt.  As to their focus
> on desktop vs. server or both, I have no information.

Based on recent conversation, my understanding is that illumian is going 
to be positioned for servers, and StormOS is going to take it and extend 
it with a GUI and desktop oriented packages. They're not going to 
support kvm though, at least not initially.

Thanks much for the reply...

From cwebber at ucr.edu  Wed Aug  8 21:24:12 2012
From: cwebber at ucr.edu (Christopher R Webber)
Date: Wed, 8 Aug 2012 18:24:12 -0700
Subject: [OmniOS-discuss] Infiniband
Message-ID: <E602A930-396A-4017-A8B7-E1727AC91012@ucr.edu>

All,

I recently purchased a system and am planning to run OmniOS on it. I know that OpenIndiana supports at very least the Mellanox IB cards, does anyone know if OmniOS also supports those cards? I ended up with a QLogic card and dladm show-ib is not listing it. Any help would be appreciated.

Thanks.
 
-- cwebber

Christopher Webber - Systems Administrator 
Bioinformatics Core - Institute for Integrative Genome Biology
University of California, Riverside

Twitter: @cwebber
Tel: 951.867.7108
http://cwebber.ucr.edu


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120808/62c5d8dc/attachment.html>

From jesus at omniti.com  Wed Aug  8 21:30:09 2012
From: jesus at omniti.com (Theo Schlossnagle)
Date: Wed, 8 Aug 2012 21:30:09 -0400
Subject: [OmniOS-discuss] Infiniband
In-Reply-To: <E602A930-396A-4017-A8B7-E1727AC91012@ucr.edu>
References: <E602A930-396A-4017-A8B7-E1727AC91012@ucr.edu>
Message-ID: <CACLsApsZkQM4ZbG2NwoRB6QgyLVBNKoLTZbjWq41FknJZi5WqQ@mail.gmail.com>

On Wed, Aug 8, 2012 at 9:24 PM, Christopher R Webber <cwebber at ucr.edu> wrote:
> I recently purchased a system and am planning to run OmniOS on it. I know
> that OpenIndiana supports at very least the Mellanox IB cards, does anyone
> know if OmniOS also supports those cards? I ended up with a QLogic card and
> dladm show-ib is not listing it. Any help would be appreciated.

If it works on any other illumos-based distro, it should work fine on OmniOS.

-- 
Theo Schlossnagle
http://omniti.com/is/theo-schlossnagle

From esproul at omniti.com  Thu Aug  9 11:16:45 2012
From: esproul at omniti.com (Eric Sproul)
Date: Thu, 9 Aug 2012 11:16:45 -0400
Subject: [OmniOS-discuss] Fwd:  combo storage/virtualization server
In-Reply-To: <CA+QY2RRyMS4dPkWkH_ckbddeuQ5sqesRu3kuvrp0YnA+pDu4CQ@mail.gmail.com>
References: <5022D8EE.5030602@acm.org>
	<CA+QY2RQ5=wcBqx=bWapiFiaZpJHV3yEHab4=9QOKawt=uvFnGw@mail.gmail.com>
	<5022FD09.5070108@acm.org>
	<CA+QY2RRyMS4dPkWkH_ckbddeuQ5sqesRu3kuvrp0YnA+pDu4CQ@mail.gmail.com>
Message-ID: <CA+QY2RTn16ZLva2-=DALu3U7x3unEppqjU=kNZHopxMVyoUTww@mail.gmail.com>

Grr, forgot to reply-all...


---------- Forwarded message ----------
From: Eric Sproul <esproul at omniti.com>
Date: Thu, Aug 9, 2012 at 11:16 AM
Subject: Re: [OmniOS-discuss] combo storage/virtualization server
To: "Paul B. Henson" <henson at acm.org>


On Wed, Aug 8, 2012 at 7:58 PM, Paul B. Henson <henson at acm.org> wrote:
>> The biggest issue with OpenIndiana minimization was the interlocking
>> incorporation dependencies.
>
>
> Ah, yes, IPS <sigh>. That definitely wouldn't be a problem with illumian
> then.

To be clear, IPS isn't the problem.  OmniOS uses IPS but delivers a
much-reduced set of packages.  The issue is the decisions made about
how to group individual pieces of software together, and how tightly
to couple them.  OI is, in large part, identical to OpenSolaris in
this respect, maintaining the majority of the incorporations that
caused us to go a different way.

Eric

From henson at acm.org  Thu Aug  9 13:54:15 2012
From: henson at acm.org (Paul B. Henson)
Date: Thu, 09 Aug 2012 10:54:15 -0700
Subject: [OmniOS-discuss] combo storage/virtualization server
In-Reply-To: <CA+QY2RRyMS4dPkWkH_ckbddeuQ5sqesRu3kuvrp0YnA+pDu4CQ@mail.gmail.com>
References: <5022D8EE.5030602@acm.org>
	<CA+QY2RQ5=wcBqx=bWapiFiaZpJHV3yEHab4=9QOKawt=uvFnGw@mail.gmail.com>
	<5022FD09.5070108@acm.org>
	<CA+QY2RRyMS4dPkWkH_ckbddeuQ5sqesRu3kuvrp0YnA+pDu4CQ@mail.gmail.com>
Message-ID: <5023F947.8030503@acm.org>

On 8/9/2012 8:16 AM, Eric Sproul wrote:

> To be clear, IPS isn't the problem.  OmniOS uses IPS but delivers a
> much-reduced set of packages.  The issue is the decisions made about
> how to group individual pieces of software together, and how tightly
> to couple them.  OI is, in large part, identical to OpenSolaris in
> this respect, maintaining the majority of the incorporations that
> caused us to go a different way.

Granted, but OTOH, it is the design and feature set of IPS that allows 
that to happen :). I guess I can't say at this point how much of my 
annoyance over IPS was inherent and how much was due to how OpenSolaris 
used it, but I recall being highly annoyed working with it when I was 
evaluating OpenSolaris 8-/.

Overall, it struck me as overengineered and unnecessarily complicated. 
Unless I missed something, you have to spin up a networked package 
repository just to install a single package on one box locally, which 
just seems wrong.

Hopefully the less complicated use in OmniOS won't be as much trouble to 
deal with :). Given the relatively sparse availability of aftermarket 
packages with OmniOS, I was thinking I might try to get Joyent's pkgsrc 
system working on top of it, leaving IPS just for the base OS packages.

Thanks...

From esproul at omniti.com  Thu Aug  9 15:55:51 2012
From: esproul at omniti.com (Eric Sproul)
Date: Thu, 9 Aug 2012 15:55:51 -0400
Subject: [OmniOS-discuss] combo storage/virtualization server
In-Reply-To: <5023F947.8030503@acm.org>
References: <5022D8EE.5030602@acm.org>
	<CA+QY2RQ5=wcBqx=bWapiFiaZpJHV3yEHab4=9QOKawt=uvFnGw@mail.gmail.com>
	<5022FD09.5070108@acm.org>
	<CA+QY2RRyMS4dPkWkH_ckbddeuQ5sqesRu3kuvrp0YnA+pDu4CQ@mail.gmail.com>
	<5023F947.8030503@acm.org>
Message-ID: <CA+QY2RSZ7mMN9QbJSFpeZ4E+WLuSyCUEMhWp4dM2-GbOOaLs7Q@mail.gmail.com>

On Thu, Aug 9, 2012 at 1:54 PM, Paul B. Henson <henson at acm.org> wrote:
> Overall, it struck me as overengineered and unnecessarily complicated.
> Unless I missed something, you have to spin up a networked package
> repository just to install a single package on one box locally, which just
> seems wrong.

Not true.  It supports local file-based repos as well.  In fact, the
thing that makes it a networked repo is a separate process
(pkg.depotd) that puts an HTTP interface in front of what is just an
file-based repo on the package server.  Making a repo is dead-simple
(1, maybe 2 commands).

I had some of the same reservations initially as you did, but I've
come to appreciate some of the design decisions after having lived
with it for more than a year.  In particular, the fact that it does
not enforce a specific build methodology, e.g. rpmbuild or debuild,
allows admins to build their software however they like and publish an
IPS package from the result.  On the sysop side, the fact that you can
do differential updates saves a ton of time (and bandwidth).

>
> Hopefully the less complicated use in OmniOS won't be as much trouble to
> deal with :). Given the relatively sparse availability of aftermarket
> packages with OmniOS, I was thinking I might try to get Joyent's pkgsrc
> system working on top of it, leaving IPS just for the base OS packages.

Someone on the #omnios channel was working on that-- I don't recall
who.  We have a decent amount of packages that we use internally for
our managed-services operation, but we keep the repo server in the
open: http://pkg.omniti.com/omniti-ms/

They're built the way we like them for our own operations, but
everything there is freely redistributable so feel free to use them.

Eric

From henson at acm.org  Thu Aug  9 18:36:03 2012
From: henson at acm.org (Paul B. Henson)
Date: Thu, 09 Aug 2012 15:36:03 -0700
Subject: [OmniOS-discuss] combo storage/virtualization server
In-Reply-To: <CA+QY2RSZ7mMN9QbJSFpeZ4E+WLuSyCUEMhWp4dM2-GbOOaLs7Q@mail.gmail.com>
References: <5022D8EE.5030602@acm.org>
	<CA+QY2RQ5=wcBqx=bWapiFiaZpJHV3yEHab4=9QOKawt=uvFnGw@mail.gmail.com>
	<5022FD09.5070108@acm.org>
	<CA+QY2RRyMS4dPkWkH_ckbddeuQ5sqesRu3kuvrp0YnA+pDu4CQ@mail.gmail.com>
	<5023F947.8030503@acm.org>
	<CA+QY2RSZ7mMN9QbJSFpeZ4E+WLuSyCUEMhWp4dM2-GbOOaLs7Q@mail.gmail.com>
Message-ID: <50243B53.60800@acm.org>

On 8/9/2012 12:55 PM, Eric Sproul wrote:

> Not true.  It supports local file-based repos as well.

Good thing I started that comment with "unless I missed something" :). 
As I recall the documentation wasn't too great at the time, so I'll 
blame that ;).

Won't be the first time I've changed my mind on a piece of technology, 
I'll try to put my current bias to the side and reevaluate it fairly...

> They're built the way we like them for our own operations, but
> everything there is freely redistributable so feel free to use them.

Cool, thanks, I'll take a look. We use pkgsrc for our Solaris 10 
deployment, so I know it mostly has what I need and am fairly used to 
working with it.


From nagele at wildbit.com  Thu Aug  9 18:44:55 2012
From: nagele at wildbit.com (Chris Nagele)
Date: Thu, 9 Aug 2012 18:44:55 -0400
Subject: [OmniOS-discuss] Expectations of ZIL iops
Message-ID: <CAHfYOdXMW8Hu6gzKUYywP+bk9_A4syPbbgF6QoSGBzi4-PdVLw@mail.gmail.com>

We are running our final tests with our servers before we send them
off to the DC. We have tested various ZIL devices, including Zeusram
and DDRdrive. I wanted to get some comments on what we should expect
when it comes to w/s in iostat for the ZIL. I've heard conflicting
results.

So far, running dd with 512b and oflag=sync, the most we can get is 8k
iops on the zil device. I even tried with some SSDs (Crucial M4,
Vertex 4) and it is the same result. They all cap at about 8k iops.
The only outlier is the DDRDrive, which hovers around 6.9k iops. To
rule things out, I tried Nexenta, OmniOS and Solaris 11, all with
mostly the same result.

Is this the expected result? Should I be pushing for more? In IRC I
was told that I should be able to get 12k no problem. And Chris from
DDR was able to get around 10k iops in a quick test.

Hoping for some good answers. Thanks everyone.

-Chris

From info at thetube.ch  Fri Aug 10 07:35:48 2012
From: info at thetube.ch (Benjamin Grogg)
Date: Fri, 10 Aug 2012 13:35:48 +0200
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
Message-ID: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>

Dear List

I do some compilation for my Homeserver. You can find this stuff there:
http://pkg.thetube.ch:10001/en/index.shtml
Better you add the feed in your RSS reader, so you see whats going on:
http://pkg.thetube.ch:10001/feed
Add the repository with following line:
pkg set-authority -O http://pkg.thetube.ch:10001/ pkg.thetube.ch

Unfortunately you can't search the repository (like pkg search or in
the Webinterface).
I will check this issue a.s.a.p. More packages will follow in the next
few weeks.
Note: I use /usr/local as installation directory. Ensure you set the
PATH variable.
All packages are "tested" with OmniOS (Stable) release. Use at your own risk!

Have fun,
benjamin

From jesus at omniti.com  Fri Aug 10 09:18:49 2012
From: jesus at omniti.com (Theo Schlossnagle)
Date: Fri, 10 Aug 2012 09:18:49 -0400
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
In-Reply-To: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
References: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
Message-ID: <CACLsApt4fh8qcBR_Lms58uQTXc3=5G-6X7vCYUWF3yShU1Li_Q@mail.gmail.com>

On Fri, Aug 10, 2012 at 7:35 AM, Benjamin Grogg <info at thetube.ch> wrote:
> I do some compilation for my Homeserver. You can find this stuff there:
> http://pkg.thetube.ch:10001/en/index.shtml

Benjamin,

Awesome! Welcome to the ecosystem.

- Theo

From richard.elling at richardelling.com  Fri Aug 10 17:52:07 2012
From: richard.elling at richardelling.com (Richard Elling)
Date: Fri, 10 Aug 2012 14:52:07 -0700
Subject: [OmniOS-discuss] Interview with Theo on InfoWorld
Message-ID: <C2B3C7ED-7E42-49D2-9B44-471C78AB8397@richardelling.com>

FYI, Simon Phipps interviews Theo for InfoWorld. Video on Youtube is worth a look.
http://www.infoworld.com/d/open-source-software/openstack-github-omnios-3-projects-1-lesson-199748

Well done!
 -- richard

--
ZFS Performance and Training
Richard.Elling at RichardElling.com
+1-760-896-4422



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120810/e66f41de/attachment.html>

From cwebber at ucr.edu  Fri Aug 10 18:58:44 2012
From: cwebber at ucr.edu (Christopher R Webber)
Date: Fri, 10 Aug 2012 15:58:44 -0700
Subject: [OmniOS-discuss] Collectd
Message-ID: <290DFA77-5F15-46A8-87EA-CF3DBDCFF031@ucr.edu>

Does anyone happen to have a collectd package that tracks the ARC that doesnt regularly dump core?

Thanks.

-- cwebber

Christopher Webber - Systems Administrator 
Bioinformatics Core - Institute for Integrative Genome Biology
University of California, Riverside

Twitter: @cwebber
Tel: 951.867.7108
http://cwebber.ucr.edu


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120810/af08a282/attachment.html>

From denis at denisandyuki.net  Fri Aug 10 19:14:30 2012
From: denis at denisandyuki.net (Denis Cheong)
Date: Sat, 11 Aug 2012 09:14:30 +1000
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
In-Reply-To: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
References: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
Message-ID: <AAAB8A8B-52A0-493F-9303-697EDDF36145@denisandyuki.net>

Looks great Benjamin!

Any chance of a request, for transmission?

Denis



On 10/08/2012, at 9:35 PM, Benjamin Grogg <info at thetube.ch> wrote:

> Dear List
> 
> I do some compilation for my Homeserver. You can find this stuff there:
> http://pkg.thetube.ch:10001/en/index.shtml
> Better you add the feed in your RSS reader, so you see whats going on:
> http://pkg.thetube.ch:10001/feed
> Add the repository with following line:
> pkg set-authority -O http://pkg.thetube.ch:10001/ pkg.thetube.ch
> 
> Unfortunately you can't search the repository (like pkg search or in
> the Webinterface).
> I will check this issue a.s.a.p. More packages will follow in the next
> few weeks.
> Note: I use /usr/local as installation directory. Ensure you set the
> PATH variable.
> All packages are "tested" with OmniOS (Stable) release. Use at your own risk!
> 
> Have fun,
> benjamin
> _______________________________________________
> OmniOS-discuss mailing list
> OmniOS-discuss at lists.omniti.com
> http://lists.omniti.com/mailman/listinfo/omnios-discuss

From info at thetube.ch  Sun Aug 12 08:23:35 2012
From: info at thetube.ch (Benjamin Grogg)
Date: Sun, 12 Aug 2012 14:23:35 +0200
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
In-Reply-To: <AAAB8A8B-52A0-493F-9303-697EDDF36145@denisandyuki.net>
References: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
	<AAAB8A8B-52A0-493F-9303-697EDDF36145@denisandyuki.net>
Message-ID: <CAHGPa8pfaKzrRnRcwihOZ=o=bSMORLZSaYvduWNJMjN8OSdd3A@mail.gmail.com>

Dear Denis

You wish transmission bittorrent? Here it is :
pkg://pkg.thetube.ch:10001/OmniOStransmission at 2.61,5.11:20120813T121633Z

Please note, it will also install libevent straightforward in your /usr/lib.
The Client GUI is not included, But the Transmission WebUI is also nice.
Any one who needs libevent you find it also at pkg.thetube.ch:10001

Happy downloading,
benjamin

On 11 August 2012 01:14, Denis Cheong <denis at denisandyuki.net> wrote:
> Looks great Benjamin!
>
> Any chance of a request, for transmission?
>
> Denis
>
>
>
> On 10/08/2012, at 9:35 PM, Benjamin Grogg <info at thetube.ch> wrote:
>
>> Dear List
>>
>> I do some compilation for my Homeserver. You can find this stuff there:
>> http://pkg.thetube.ch:10001/en/index.shtml
>> Better you add the feed in your RSS reader, so you see whats going on:
>> http://pkg.thetube.ch:10001/feed
>> Add the repository with following line:
>> pkg set-authority -O http://pkg.thetube.ch:10001/ pkg.thetube.ch
>>
>> Unfortunately you can't search the repository (like pkg search or in
>> the Webinterface).
>> I will check this issue a.s.a.p. More packages will follow in the next
>> few weeks.
>> Note: I use /usr/local as installation directory. Ensure you set the
>> PATH variable.
>> All packages are "tested" with OmniOS (Stable) release. Use at your own risk!
>>
>> Have fun,
>> benjamin
>> _______________________________________________
>> OmniOS-discuss mailing list
>> OmniOS-discuss at lists.omniti.com
>> http://lists.omniti.com/mailman/listinfo/omnios-discuss

From denis at denisandyuki.net  Sun Aug 12 10:13:34 2012
From: denis at denisandyuki.net (Denis Cheong)
Date: Mon, 13 Aug 2012 00:13:34 +1000
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
In-Reply-To: <CAHGPa8pfaKzrRnRcwihOZ=o=bSMORLZSaYvduWNJMjN8OSdd3A@mail.gmail.com>
References: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
	<AAAB8A8B-52A0-493F-9303-697EDDF36145@denisandyuki.net>
	<CAHGPa8pfaKzrRnRcwihOZ=o=bSMORLZSaYvduWNJMjN8OSdd3A@mail.gmail.com>
Message-ID: <CABOCf+iBDTDFOgdh4jp=HWYG1sCWWz7qg8wYwZjyX=i5_DaW8w@mail.gmail.com>

That's awesome, thanks Benjamin.

Is there a particular reason why it installs to /usr/local/transmission
rather than just /usr/local ?

Also, if you really want to take the packaging to the next level, these are
all the steps required to install it as a service:
http://www.dev-eth0.de/installing-a-bittorrent-client-with-webgui-on-opensolaris/

It would be really neat if all of this were included in the package ...
I've already done all this manually so not necessary for me.

I spent hours trying to get transmission compiled on OmniOS ... is there an
easy trick to getting a working GNU compilation environment up and running?

On Sun, Aug 12, 2012 at 10:23 PM, Benjamin Grogg <info at thetube.ch> wrote:

> Dear Denis
>
> You wish transmission bittorrent? Here it is :
> pkg://pkg.thetube.ch:10001/OmniOStransmission at 2.61,5.11:20120813T121633Z
>
> Please note, it will also install libevent straightforward in your
> /usr/lib.
> The Client GUI is not included, But the Transmission WebUI is also nice.
> Any one who needs libevent you find it also at pkg.thetube.ch:10001
>
> Happy downloading,
> benjamin
>
> On 11 August 2012 01:14, Denis Cheong <denis at denisandyuki.net> wrote:
> > Looks great Benjamin!
> >
> > Any chance of a request, for transmission?
> >
> > Denis
> >
> >
> >
> > On 10/08/2012, at 9:35 PM, Benjamin Grogg <info at thetube.ch> wrote:
> >
> >> Dear List
> >>
> >> I do some compilation for my Homeserver. You can find this stuff there:
> >> http://pkg.thetube.ch:10001/en/index.shtml
> >> Better you add the feed in your RSS reader, so you see whats going on:
> >> http://pkg.thetube.ch:10001/feed
> >> Add the repository with following line:
> >> pkg set-authority -O http://pkg.thetube.ch:10001/ pkg.thetube.ch
> >>
> >> Unfortunately you can't search the repository (like pkg search or in
> >> the Webinterface).
> >> I will check this issue a.s.a.p. More packages will follow in the next
> >> few weeks.
> >> Note: I use /usr/local as installation directory. Ensure you set the
> >> PATH variable.
> >> All packages are "tested" with OmniOS (Stable) release. Use at your own
> risk!
> >>
> >> Have fun,
> >> benjamin
> >> _______________________________________________
> >> OmniOS-discuss mailing list
> >> OmniOS-discuss at lists.omniti.com
> >> http://lists.omniti.com/mailman/listinfo/omnios-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120813/f584cd73/attachment.html>

From info at thetube.ch  Sun Aug 12 12:03:16 2012
From: info at thetube.ch (Benjamin Grogg)
Date: Sun, 12 Aug 2012 18:03:16 +0200
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
In-Reply-To: <CABOCf+iBDTDFOgdh4jp=HWYG1sCWWz7qg8wYwZjyX=i5_DaW8w@mail.gmail.com>
References: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
	<AAAB8A8B-52A0-493F-9303-697EDDF36145@denisandyuki.net>
	<CAHGPa8pfaKzrRnRcwihOZ=o=bSMORLZSaYvduWNJMjN8OSdd3A@mail.gmail.com>
	<CABOCf+iBDTDFOgdh4jp=HWYG1sCWWz7qg8wYwZjyX=i5_DaW8w@mail.gmail.com>
Message-ID: <CAHGPa8qF6szMqj085g2bfPMqW9rMRMikYeK9r+NBsZxx4rfLQA@mail.gmail.com>

Thanks Denis,

> Is there a particular reason why it installs to /usr/local/transmission
> rather than just /usr/local ?

I don't touch the default path. So it's what the Transmission developer sets.

> Also, if you really want to take the packaging to the next level, these are
> all the steps required to install it as a service:
> http://www.dev-eth0.de/installing-a-bittorrent-client-with-webgui-on-opensolaris/

I'm not sure how the Transmission-Daemon works exactly. Better I run it
in userland (as logged in User), that means every download is user based.
With a system daemon. I'm not sure if its possible to protect each download
from every user?

> I spent hours trying to get transmission compiled on OmniOS ... is there an
> easy trick to getting a working GNU compilation environment up and running?

OmniOS provide everything except libevent. There was just an issue with a
building macro that detect libcurl not/worg
The rest was just straight forward, thanks to the OmniOS developers!

Best regrads,
benjamin

From denis at denisandyuki.net  Sun Aug 12 20:01:31 2012
From: denis at denisandyuki.net (Denis Cheong)
Date: Mon, 13 Aug 2012 10:01:31 +1000
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
In-Reply-To: <CAHGPa8qF6szMqj085g2bfPMqW9rMRMikYeK9r+NBsZxx4rfLQA@mail.gmail.com>
References: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
	<AAAB8A8B-52A0-493F-9303-697EDDF36145@denisandyuki.net>
	<CAHGPa8pfaKzrRnRcwihOZ=o=bSMORLZSaYvduWNJMjN8OSdd3A@mail.gmail.com>
	<CABOCf+iBDTDFOgdh4jp=HWYG1sCWWz7qg8wYwZjyX=i5_DaW8w@mail.gmail.com>
	<CAHGPa8qF6szMqj085g2bfPMqW9rMRMikYeK9r+NBsZxx4rfLQA@mail.gmail.com>
Message-ID: <CABOCf+jde2juUUdeihsqiZ9-iV19HbcOVcv1yHuLunEKSMeokQ@mail.gmail.com>

On Mon, Aug 13, 2012 at 2:03 AM, Benjamin Grogg <info at thetube.ch> wrote:

> > Also, if you really want to take the packaging to the next level, these
> are
> > all the steps required to install it as a service:
> >
> http://www.dev-eth0.de/installing-a-bittorrent-client-with-webgui-on-opensolaris/
>
>
> I'm not sure how the Transmission-Daemon works exactly. Better I run it
> in userland (as logged in User), that means every download is user based.
> With a system daemon. I'm not sure if its possible to protect each download
> from every user?


Yes, the instructions run through creating a user and running the daemon as
that user.

It's not as big an issue under OmniOS because it retains the ability to use
the legacy Solaris 11 Express rc.d style init files to run daemons (stick
it in rc.local), however with Solaris 11 there is no practical way to start
up transmission-daemon without using SMF, which is what those instructions
show you how to do.


> > I spent hours trying to get transmission compiled on OmniOS ... is there
> an
> > easy trick to getting a working GNU compilation environment up and
> running?
>
> OmniOS provide everything except libevent. There was just an issue with a
> building macro that detect libcurl not/worg
> The rest was just straight forward, thanks to the OmniOS developers!
>

Must still be something I'm missing ... it never worked for me, there was
always weird unresolvable error during building apps even after installing
all the development tools.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120813/5c7aef36/attachment.html>

From info at thetube.ch  Mon Aug 13 07:29:29 2012
From: info at thetube.ch (Benjamin Grogg)
Date: Mon, 13 Aug 2012 13:29:29 +0200
Subject: [OmniOS-discuss] Another OmniOS Software Repository.
In-Reply-To: <CABOCf+jde2juUUdeihsqiZ9-iV19HbcOVcv1yHuLunEKSMeokQ@mail.gmail.com>
References: <CAHGPa8pAkB3WPCrKEAjVvXCPsS4TjRemNMNCD1V_0Dc2HAY91Q@mail.gmail.com>
	<AAAB8A8B-52A0-493F-9303-697EDDF36145@denisandyuki.net>
	<CAHGPa8pfaKzrRnRcwihOZ=o=bSMORLZSaYvduWNJMjN8OSdd3A@mail.gmail.com>
	<CABOCf+iBDTDFOgdh4jp=HWYG1sCWWz7qg8wYwZjyX=i5_DaW8w@mail.gmail.com>
	<CAHGPa8qF6szMqj085g2bfPMqW9rMRMikYeK9r+NBsZxx4rfLQA@mail.gmail.com>
	<CABOCf+jde2juUUdeihsqiZ9-iV19HbcOVcv1yHuLunEKSMeokQ@mail.gmail.com>
Message-ID: <CAHGPa8rLF-xMmL98yyjZhfi=uXJ7nYL59S49wNDuc+xo_C6g1g@mail.gmail.com>

Denis,

> transmission-daemon without using SMF, which is what those instructions show
> you how to do.

Thanks for that. I will read about it.

> Must still be something I'm missing ... it never worked for me, there was
> always weird unresolvable error during building apps even after installing
> all the development tools.

I run OmniOS Stable. Following tools I installed :
gcc46, gnu-make, cpp, header-math, object-file,header and OmniOSlibevent
Adjust the env variables, that's all. Maybe you can post some output.

Best regards,
benjamin

From frederic.alix at fredalix.com  Sat Aug 18 15:07:01 2012
From: frederic.alix at fredalix.com (=?ISO-8859-1?Q?Fr=E9d=E9ric_Alix?=)
Date: Sat, 18 Aug 2012 21:07:01 +0200
Subject: [OmniOS-discuss] Can we participate ?
Message-ID: <CAN4tE3_Ze3g+XCYi5TLdFNQaXi7VdjeZACzudA+W=qQSca4BwA@mail.gmail.com>

Hi all,

Few weeks ago, i discovered OmniOS.
That is an long time i searched an illumos distribution without X11.
I use SmartOS during few months, but i don?t like the json files
configuration, and i prefer install my Oses on hard drives. But SmartOs is
a good distribution :-D
During these last weeks, i clone omnios IPS depot and test zones creation.
I like very much this distribution.
Now, i contact all my sysadmin friends for ask them to boot OmniOS on
different servers like HP DL380, Tyan servers, SuperMicro,? and build an
HCL.
how can i contribute to your project ?
Is it possible? In past, i was participated to translate English
OpenSolaris install documentation into French.
I would like participating to documentation part and evangelize OmniOs into
my country.

Regards, fax
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120818/b7bbe2d0/attachment.html>

From esproul at omniti.com  Mon Aug 20 10:19:30 2012
From: esproul at omniti.com (Eric Sproul)
Date: Mon, 20 Aug 2012 10:19:30 -0400
Subject: [OmniOS-discuss] Can we participate ?
In-Reply-To: <CAN4tE3_Ze3g+XCYi5TLdFNQaXi7VdjeZACzudA+W=qQSca4BwA@mail.gmail.com>
References: <CAN4tE3_Ze3g+XCYi5TLdFNQaXi7VdjeZACzudA+W=qQSca4BwA@mail.gmail.com>
Message-ID: <CA+QY2RQT34=Bn5LXvkS1is4RDueXJD9WoQdOwSXnHWoJ_ZaoBQ@mail.gmail.com>

On Sat, Aug 18, 2012 at 3:07 PM, Fr?d?ric Alix
<frederic.alix at fredalix.com> wrote:
> During these last weeks, i clone omnios IPS depot and test zones creation.
> I like very much this distribution.

That's great to hear, welcome!

> Now, i contact all my sysadmin friends for ask them to boot OmniOS on
> different servers like HP DL380, Tyan servers, SuperMicro,? and build an
> HCL.

There is an automatically-generated HCL at http://illumos.org/hcl/

It looks at the Illumos source for supported devices and
cross-references them with the PCI ID Database.  Since OmniOS is based
on Illumos, generally anything that Illumos supports, OmniOS does as
well.  Exceptions to this may be for very recent hardware, for which
preliminary support exists in the tip of illumos-gate but which has
not yet been pulled into OmniOS's own copy of Illumos.

> how can i contribute to your project ?
> Is it possible? In past, i was participated to translate English OpenSolaris
> install documentation into French.
> I would like participating to documentation part and evangelize OmniOs into
> my country.

Documentation would be most welcome.  Most of the work will likely be
in the Illumos core, things like man pages and such.
https://www.illumos.org/projects/documentation would be a place to
start.  However, if you are a PHP admin (or know anyone who is),
adding support for non-English languages to mtrack (the project/wiki
software that powers omnios.omniti.net) would be great as well.  It
would probably involve getting PHP to search for wiki pages with
extensions matching the language requested, with fall-back to the
default English page if it does not exist.  mtrack is at
https://bitbucket.org/wez/mtrack

Once again, welcome to the community!
Eric

From bdha at mirrorshades.net  Mon Aug 20 00:36:48 2012
From: bdha at mirrorshades.net (Bryan Horstmann-Allen)
Date: Mon, 20 Aug 2012 00:36:48 -0400
Subject: [OmniOS-discuss] Bug tracker accounts?
Message-ID: <20120820043647.GA11210@lab.pobox.com>

Where should we be submitting bugs?

ie, the kayak SMF service is not imported when the kayak packages are
installed. I'd like to submit a bug and a patch for this, but can't figure out
how to create an account on the wiki/bug tracker.

Cheers.
-- 
bdha
cyberpunk is dead. long live cyberpunk.

From esproul at omniti.com  Mon Aug 20 10:40:52 2012
From: esproul at omniti.com (Eric Sproul)
Date: Mon, 20 Aug 2012 10:40:52 -0400
Subject: [OmniOS-discuss] Bug tracker accounts?
In-Reply-To: <20120820043647.GA11210@lab.pobox.com>
References: <20120820043647.GA11210@lab.pobox.com>
Message-ID: <CA+QY2RTAH9gF_KtQ1GOP3xum5Sij2VGbJNuFM-TtbfEoL6Mc4A@mail.gmail.com>

On Mon, Aug 20, 2012 at 12:36 AM, Bryan Horstmann-Allen
<bdha at mirrorshades.net> wrote:
> Where should we be submitting bugs?
>
> ie, the kayak SMF service is not imported when the kayak packages are
> installed. I'd like to submit a bug and a patch for this, but can't figure out
> how to create an account on the wiki/bug tracker.

Bryan,
There's currently no interface for the public to create their own
accounts, but send me an Apache MD5 hash of your password (htpasswd
-nm) and I'll get you an account.

Eric

From esproul at omniti.com  Mon Aug 20 16:24:07 2012
From: esproul at omniti.com (Eric Sproul)
Date: Mon, 20 Aug 2012 16:24:07 -0400
Subject: [OmniOS-discuss] r151002u
Message-ID: <CA+QY2RRHdNpm9DTz80r5rMqu-46p=GeZaG3Hm2rA8Cf3UH8T_A@mail.gmail.com>

OmniOS weekly release r151002u updates sudo, pci.ids and screen.

http://omnios.omniti.com/wiki.php/ReleaseNotes#r151002u

From jasonjwwilliams at gmail.com  Mon Aug 20 17:28:29 2012
From: jasonjwwilliams at gmail.com (Jason J. W. Williams)
Date: Mon, 20 Aug 2012 14:28:29 -0700
Subject: [OmniOS-discuss] IPS & BE creation suppression
In-Reply-To: <CAHZAEpfvQ2vpndUA6jYOhj+hgXmW3yetVrop-JfWhNUzR=0uOg@mail.gmail.com>
References: <CAHZAEpfvQ2vpndUA6jYOhj+hgXmW3yetVrop-JfWhNUzR=0uOg@mail.gmail.com>
Message-ID: <CAHZAEpdj3_vxNvocCUvJQTVmrPfU_RdAx67qub7T6RxH1r=cAg@mail.gmail.com>

Is OmniOS any different from OpenIndian with regards to certain packages
requiring new BEs to be created? New BEs really raise hell with config
management systems like Puppet and Chef.

-J
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120820/1d1d35ec/attachment.html>

From jesus at omniti.com  Mon Aug 20 17:32:44 2012
From: jesus at omniti.com (Theo Schlossnagle)
Date: Mon, 20 Aug 2012 17:32:44 -0400
Subject: [OmniOS-discuss] IPS & BE creation suppression
In-Reply-To: <CAHZAEpdj3_vxNvocCUvJQTVmrPfU_RdAx67qub7T6RxH1r=cAg@mail.gmail.com>
References: <CAHZAEpfvQ2vpndUA6jYOhj+hgXmW3yetVrop-JfWhNUzR=0uOg@mail.gmail.com>
	<CAHZAEpdj3_vxNvocCUvJQTVmrPfU_RdAx67qub7T6RxH1r=cAg@mail.gmail.com>
Message-ID: <CACLsApto2F-0Oc3FKnWEHa7pb9hqDLMfNGARUMy8tFmu5nZEwg@mail.gmail.com>

On Mon, Aug 20, 2012 at 5:28 PM, Jason J. W. Williams
<jasonjwwilliams at gmail.com> wrote:
> Is OmniOS any different from OpenIndian with regards to certain packages
> requiring new BEs to be created? New BEs really raise hell with config
> management systems like Puppet and Chef.

I suppose Chef and Puppet needs to be taught about new BEs?  The short
answer is, anything that would require a reboot to take full effect
would require a new BE -- just like OI.

We don't seem to have issues with this and Chef in our environment, FWIW.

-- 
Theo Schlossnagle
http://omniti.com/is/theo-schlossnagle

From jasonjwwilliams at gmail.com  Mon Aug 20 17:38:29 2012
From: jasonjwwilliams at gmail.com (Jason J. W. Williams)
Date: Mon, 20 Aug 2012 14:38:29 -0700
Subject: [OmniOS-discuss] IPS & BE creation suppression
In-Reply-To: <CACLsApto2F-0Oc3FKnWEHa7pb9hqDLMfNGARUMy8tFmu5nZEwg@mail.gmail.com>
References: <CAHZAEpfvQ2vpndUA6jYOhj+hgXmW3yetVrop-JfWhNUzR=0uOg@mail.gmail.com>
	<CAHZAEpdj3_vxNvocCUvJQTVmrPfU_RdAx67qub7T6RxH1r=cAg@mail.gmail.com>
	<CACLsApto2F-0Oc3FKnWEHa7pb9hqDLMfNGARUMy8tFmu5nZEwg@mail.gmail.com>
Message-ID: <CAHZAEpfeYgQXJGE=vDBKp58DV1uamk_vfT_Kj5oKSpU=RfaDQw@mail.gmail.com>

>
> I suppose Chef and Puppet needs to be taught about new BEs?  The short
> answer is, anything that would require a reboot to take full effect
> would require a new BE -- just like OI.
>

That could be a bit tricky. They'd have to check after every package
install directive to see if there was a new BE and start writing to that
path instead. We're trying to dump OpenIndiana for Illumian because of
this, was open OmniOS's packages would be more friendly to the "suppress
new BE" flag that IPS takes.


> We don't seem to have issues with this and Chef in our environment, FWIW.
>

We have a huge issue with this when bootstrapping a new server,
particularly around packages like ssh.

-J
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.omniti.com/pipermail/omnios-discuss/attachments/20120820/00bdb861/attachment.html>

From esproul at omniti.com  Mon Aug 20 17:51:00 2012
From: esproul at omniti.com (Eric Sproul)
Date: Mon, 20 Aug 2012 17:51:00 -0400
Subject: [OmniOS-discuss] IPS & BE creation suppression
In-Reply-To: <CAHZAEpfeYgQXJGE=vDBKp58DV1uamk_vfT_Kj5oKSpU=RfaDQw@mail.gmail.com>
References: <CAHZAEpfvQ2vpndUA6jYOhj+hgXmW3yetVrop-JfWhNUzR=0uOg@mail.gmail.com>
	<CAHZAEpdj3_vxNvocCUvJQTVmrPfU_RdAx67qub7T6RxH1r=cAg@mail.gmail.com>
	<CACLsApto2F-0Oc3FKnWEHa7pb9hqDLMfNGARUMy8tFmu5nZEwg@mail.gmail.com>
	<CAHZAEpfeYgQXJGE=vDBKp58DV1uamk_vfT_Kj5oKSpU=RfaDQw@mail.gmail.com>
Message-ID: <CA+QY2RT8yVEkrA5JB=64Bz4EkfwbhsZNDOC0C9jvb+a3qVQbYw@mail.gmail.com>

On Mon, Aug 20, 2012 at 5:38 PM, Jason J. W. Williams
<jasonjwwilliams at gmail.com> wrote:
> That could be a bit tricky. They'd have to check after every package install
> directive to see if there was a new BE and start writing to that path
> instead. We're trying to dump OpenIndiana for Illumian because of this, was
> open OmniOS's packages would be more friendly to the "suppress new BE" flag
> that IPS takes.

Not all BEs are create equal.  Note that on some pkg operations, a
"backup BE" is created, but it will not be necessary to boot into it.
They can be safely removed

The creation of backup BEs and other BE-related operations are
controlled by the image property "be-policy".  The default policy is
the same as the "create-backup" option.  See the pkg(1) man page in
the section "IMAGE PROPERTIES".  It actually explains pretty well the
reasoning for each policy.

You could set the policy such that backup BEs are never made
(be-policy "when-required").  That way if you see a new BE, you'll
know a reboot is required before continuing.

Eric

From stephen at atalanta-systems.com  Tue Aug 21 04:23:34 2012
From: stephen at atalanta-systems.com (Stephen Nelson-Smith)
Date: Tue, 21 Aug 2012 09:23:34 +0100
Subject: [OmniOS-discuss] IPS & BE creation suppression
In-Reply-To: <CA+QY2RT8yVEkrA5JB=64Bz4EkfwbhsZNDOC0C9jvb+a3qVQbYw@mail.gmail.com>
References: <CAHZAEpfvQ2vpndUA6jYOhj+hgXmW3yetVrop-JfWhNUzR=0uOg@mail.gmail.com>
	<CAHZAEpdj3_vxNvocCUvJQTVmrPfU_RdAx67qub7T6RxH1r=cAg@mail.gmail.com>
	<CACLsApto2F-0Oc3FKnWEHa7pb9hqDLMfNGARUMy8tFmu5nZEwg@mail.gmail.com>
	<CAHZAEpfeYgQXJGE=vDBKp58DV1uamk_vfT_Kj5oKSpU=RfaDQw@mail.gmail.com>
	<CA+QY2RT8yVEkrA5JB=64Bz4EkfwbhsZNDOC0C9jvb+a3qVQbYw@mail.gmail.com>
Message-ID: <CAOq1yR6-0MY2tUS7EjUudF8PJxzbF1e+d=MSGxt9WcaJHVEh4A@mail.gmail.com>

Hi,

On 20 August 2012 22:51, Eric Sproul <esproul at omniti.com> wrote:

> The creation of backup BEs and other BE-related operations are
> controlled by the image property "be-policy".  The default policy is
> the same as the "create-backup" option.  See the pkg(1) man page in
> the section "IMAGE PROPERTIES".  It actually explains pretty well the
> reasoning for each policy.
>
> You could set the policy such that backup BEs are never made
> (be-policy "when-required").  That way if you see a new BE, you'll
> know a reboot is required before continuing.

Useful info, Eric.  I'm looking at exactly this issue for the Chef IPS
provider at the moment, so will report back when I have something
testable.

S.

