# [OmniOS-discuss] Slow NFS writes in 151026

Tobias Oetiker tobi at oetiker.ch
Fri Aug 24 08:54:29 UTC 2018

- Previous message: [OmniOS-discuss] Slow NFS writes in 151026
- Next message: [OmniOS-discuss] Slow NFS writes in 151026
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

    Hi All,

    Lee has opened a issue here https://github.com/omniosorg/illumos-omnios/issues/256
    it might be a good place to discuss this.

    I have also posted a very simple tests script (not sure if it is enough to reproduce the problem, but it would at least give a common baseline as to what we are talking about).

    cheers
    tobi

    ----- On Aug 24, 2018, at 10:07 AM, Adam Feigin feigin at iis.ee.ethz.ch wrote:

    > Hi Lee:
    >
    >
    > I've been experiencing something very similar. I recently (several
    > months ago) moved a ~30T pool from a "old" OpenIndiana 151a9 system ,
    > where it had been working flawlessly for several years, to a "new"
    > OmniOSce 151022 installation (zpool export on old, zpool import on new).
    >
    >
    > Now, I have extremely poor NFS write speeds on the new system. I've even
    > swapped the cards (LSI SAS, 10G Ethernet) from the OI system to the
    > OmniOS system, to eliminate some hardware discrepancies, but this had no
    > effect whatsoever. Its not a network problem. I can happily get near
    > line-rate on the 10G network between the server and various 10G
    > connected hosts. Its not a ZIL/L2ARC problem either, removing them
    > (they're on SSDs, as yours) had minimal effect.
    >
    >
    > The new hardware is signifcantly more performant, with nearly 10x more
    > memory (240G vs 32G), more cores and faster CPUs; I never expected
    > performance to get worse.
    >
    >
    > I'm not convinced its a "pure" NFS problem either, as I've noticed some
    > other strange performance degradation on the new system. The pool used
    > to take somewhere between 40 - 60 hours to run a scrub on the OI system.
    > Recent scrubs were taking 400+ hours. After a recent pkg update and
    > reboot, the last scrub took ~159 hours. During the scrub, I noticed that
    > the scanning speed, while starting out relatively fast, pretty much
    > monotonically decreased in speed as time when on, going from 50 M/s near
    > the beginning to 17M/s at the end. I have to see what happens at the
    > next monthly scrub of the pool.
    >
    >
    > Have you looked at your scrub performance ?
    >
    > What else is different between the 2 machines ?
    >
    >
    >
    > _______________________________________________
    > OmniOS-discuss mailing list
    > OmniOS-discuss at lists.omniti.com
    > http://lists.omniti.com/mailman/listinfo/omnios-discuss

    --
    Tobi Oetiker, OETIKER+PARTNER AG, Aarweg 15 CH-4600 Olten, Switzerland
    www.oetiker.ch tobi at oetiker.ch +41 62 775 9902

- Previous message: [OmniOS-discuss] Slow NFS writes in 151026
- Next message: [OmniOS-discuss] Slow NFS writes in 151026
- Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]

More information about the OmniOS-discuss mailing list