`<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">2016-03-05 0:01 GMT+08:00 Freddie Cash <span dir="ltr"><<a href="mailto:fjwcash@gmail.com" target="_blank">fjwcash@gmail.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><p dir="ltr"><span>On Mar 4, 2016 2:05 AM, "Fred Liu" <<a href="mailto:fred.fliu@gmail.com" target="_blank">fred.fliu@gmail.com</a>> wrote:<br>> 2016-03-04 13:47 GMT+08:00 Freddie Cash <<a href="mailto:fjwcash@gmail.com" target="_blank">fjwcash@gmail.com</a>>:<br>
>><br>
>> Currently, I just use a simple coordinate system. Columns are letters, rows are numbers.<br>
>></span><span class="" style="white-space:pre"> </span>"<a href="mailto:smartos-discuss@lists.smartos.org">smartos-discuss@lists.smartos.org</a>" <<a href="mailto:smartos-discuss@lists.smartos.org">smartos-discuss@lists.smartos.org</a>>、</p><p dir="ltr">developer <<a href="mailto:developer@open-zfs.org">developer@open-zfs.org</a>>、</p><p dir="ltr">illumos-developer <<a href="mailto:developer@lists.illumos.org">developer@lists.illumos.org</a>>、</p><p dir="ltr">omnios-discuss <<a href="mailto:omnios-discuss@lists.omniti.com">omnios-discuss@lists.omniti.com</a>>、</p><p dir="ltr">Discussion list for OpenIndiana <<a href="mailto:openindiana-discuss@openindiana.org">openindiana-discuss@openindiana.org</a>>、</p><p dir="ltr">illumos-zfs <<a href="mailto:zfs@lists.illumos.org">zfs@lists.illumos.org</a>>、</p><p dir="ltr">"<a href="mailto:zfs-discuss@list.zfsonlinux.org">zfs-discuss@list.zfsonlinux.org</a>" <<a href="mailto:zfs-discuss@list.zfsonlinux.org">zfs-discuss@list.zfsonlinux.org</a>>、</p><p dir="ltr">"freebsd-fs@FreeBSD.org" <<a href="mailto:freebsd-fs@freebsd.org">freebsd-fs@freebsd.org</a>>、</p><p dir="ltr">"<a href="mailto:zfs-devel@freebsd.org">zfs-devel@freebsd.org</a>" <<a href="mailto:zfs-devel@freebsd.org">zfs-devel@freebsd.org</a>></p><p dir="ltr"><span>
>> Each disk is partitioned using GPT with the first (only) partition starting at 1 MB and covering the whole disk, and labelled with the column/row where it is located (disk-a1, disk-g6, disk-p3, etc).<br>
><br>
> [Fred]: So you manually pull off all the drives one by one to locate them? <br><br></span></p><p dir="ltr"></p><div style="font-family:'courier new',monospace;display:inline">​When putting the system together for the first time, I insert each disk one at a time, wait for it to be detected, partition it, then label it based on physical location.​ Then do the next one. It's just part of the normal server build process, whether it has 2 drives, 20 drives, or 200 drives.</div><br><p></p><p dir="ltr"></p><div style="font-family:'courier new',monospace;display:inline">​We build all our own servers from off-the-shelf parts; we don't buy anything pre-built from any of the large OEMs.​</div></div></blockquote><div><br></div><div>[Fred]: Gotcha!</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><p></p><p dir="ltr"><span>>> The pool is created using the GPT labels, so the label shows in "zpool list" output.<br>
><br>
> [Fred]: What will the output look like? <br><br></span></p><div style="font-family:'courier new',monospace;display:inline">​From our smaller backups server, with just 24 drive bays:</div><p></p><p dir="ltr"><font face="courier new, monospace">$ zpool status storage</font></p><div style="display:inline"><p dir="ltr"><font face="courier new, monospace"> pool: storage</font></p><p dir="ltr"><font face="courier new, monospace"> state: ONLINE</font></p><p dir="ltr"><font face="courier new, monospace">status: Some supported features are not enabled on the pool. The pool can</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>still be used, but some features are unavailable.</font></p><p dir="ltr"><font face="courier new, monospace">action: Enable all features using 'zpool upgrade'. Once this is done,</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>the pool may no longer be accessible by software that does not support</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>the features. See zpool-features(7) for details.</font></p><p dir="ltr"><font face="courier new, monospace"> scan: scrub canceled on Wed Feb 17 12:02:20 2016</font></p><p dir="ltr"><font face="courier new, monospace">config:</font></p><p dir="ltr"><font face="courier new, monospace"><br></font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>NAME STATE READ WRITE CKSUM</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>storage ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-0 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-a6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-b6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-c6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> raidz2-3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d2 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d3 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d4 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d5 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/disk-d6 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span>cache</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/cache0 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><span style="white-space:pre-wrap"> </span> gpt/cache1 ONLINE 0 0 0</font></p><p dir="ltr"><font face="courier new, monospace"><br></font></p><p dir="ltr"><font face="courier new, monospace">errors: No known data errors</font></p><div><br></div><div>The 90-bay systems look the same, just that the letters go all the way to p (so disk-p1 through disk-p6). And there's one vdev that uses 3 drives from each chassis (7x 6-disk vdev only uses 42 drives of the 45-bay chassis, so there's lots of spares if using a single chassis; using two chassis, there's enough drives to add an extra 6-disk vdev).</div></div></div></blockquote><div><br></div><div>[Fred]: It looks like the gpt label shown in "zpool status" only works in FreeBSD/FreeNAS. Are you using FreeBSD/FreeNAS? I can't find the similar possibilities in Illumos/Linux.</div><div><br></div><div>Thanks,</div><div><br></div><div>Fred </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-color:rgb(204,204,204);border-left-style:solid;padding-left:1ex"><div dir="ltr"><div style="display:inline"><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p></div><p dir="ltr"></p><br><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p><p></p></div><div bgcolor="#ffffff" style="width:auto;margin:0px;padding:5px;clear:both;border-top-width:1px;border-top-style:solid;border-top-color:rgb(204,204,204);background-color:rgb(255,255,255)"><table bgcolor="#ffffff" border="0" cellpadding="0" cellspacing="0" style="background-color:rgb(255,255,255)" width="100%"><tbody><tr><td><font color="#333333" size="1" style="font-family:helvetica,sans-serif">
<strong>illumos-zfs</strong> | <a href="https://www.listbox.com/member/archive/182191/=now" style="text-decoration:none;color:rgb(102,153,51);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(68,68,68)" title="Go to archives for illumos-zfs" target="_blank">Archives</a>
<a border="0" href="https://www.listbox.com/member/archive/rss/182191/22147814-d504851f" style="text-decoration:none;color:rgb(102,153,51)" title="RSS feed for illumos-zfs" target="_blank"><img border="0" src="http://postlink.www.listbox.com/2073738/833487e62783d55fe81f119fb93ef644/22147814/cdaed36a.jpg?uri=aHR0cHM6Ly93d3cubGlzdGJveC5jb20vaW1hZ2VzL2ZlZWQtaWNvbi0xMHgxMC5qcGc"></a>
| <a href="https://www.listbox.com/member/?member_id=22147814&id_secret=22147814-a72bcb8a" style="text-decoration:none;color:rgb(102,153,51);border-bottom-width:1px;border-bottom-style:solid;border-bottom-color:rgb(68,68,68)" title="" target="_blank">Modify</a>
Your Subscription</font></td><td align="right" valign="top"><a href="http://www.listbox.com" style="border-bottom-style:none" target="_blank">
<img border="0" src="http://postlink.www.listbox.com/2073739/3379085af0f1cf7fc3708f04b4471ae2/22147814/cdaed36a.png?uri=aHR0cHM6Ly93d3cubGlzdGJveC5jb20vaW1hZ2VzL2xpc3Rib3gtbG9nby1zbWFsbC5wbmc" title="Powered by Listbox"></a></td></tr></tbody></table></div></blockquote></div><br></div></div>
`