openzfs/zfs on Hacker News

…master Illumos repository ( https://github.com/illumos/illumos-gate ). I know that ZFS on Linux ( https://github.com/zfsonlinux/zfs ) routinely integrates those changes, as well as making some of its own and I believe pushing them upstream…

comment by thatcks · 2017-05-21 · in TFS: A file system built for performance, space efficiency, and scalability

…our large container workload hasn't had the same luck. The issues I've hit are the following: https://github.com/zfsonlinux/zfs/issues/5814 https://github.com/zfsonlinux/zfs/issues/5535 Unfortunately, these problems stem from page faults…

comment by sargun · 2017-04-01 · in Ask HN: What do you want to see in Ubuntu 17.10?

…I am aware of. I'd be fascinated to hear if others are aware of other similar works. [1] https://github.com/zfsonlinux/zfs/wiki/dRAID-HOWTO

comment by gbrown_ · 2017-03-23 · in Permutation Development Data Layout (1999) [pdf]

…the current cgroup is OOM. ZFS subsequently gets stuck in an infinite loop, and locks up. See: https://github.com/zfsonlinux/zfs/issues/5535 I understand that a lot of ZFS works comes from LLNL & government funding. I'm not blaming them,…

comment by sargun · 2017-03-23 · in Bcachefs: “the COW filesystem for Linux that won't eat your data”

…mechanisms, and ZFS's dedup is...well, it's a four-letter word in a number of ZFS circles. [1] - https://github.com/zfsonlinux/zfs/issues/405#issuecomment-50...

comment by rincebrain · 2017-03-23 · in Efficient File Copying on Linux

…- https://www.freebsd.org/cgi/man.cgi?query=zpool-features&apr... - https://github.com/zfsonlinux/zfs/blob/master/man/man5/zpool...

comment by tgragnato · 2017-03-20 · in How I Store My 1's and 0′s (2012)

Native ZFS encryption may become available soon. It is pending code review: https://github.com/zfsonlinux/zfs/pull/5769 There was a presentation of this by Tom Caputi at the most recent OpenZFS Developer Summit. Slides:…

comment by zxv · 2017-03-12 · in Silent Data Corruption Is Real

…figures, like 20 GB [3]. [1] http://www.oracle.com/technetwork/articles/servers-storage-a... [2] https://github.com/zfsonlinux/zfs/commit/9907cc1cc8c16fa2c7c... [3] http://constantin.glez.de/blog/2011/07/zfs-dedupe-or-not-ded...

comment by GrayShade · 2017-01-28 · in How Mail.Ru Reduced Email Storage From 50 To 32 PB

I've used this guide and it works fine: https://github.com/zfsonlinux/zfs/wiki/Ubuntu-16.04-Root-on-... It however advises to use blockid, not device-id, for mounts. Any idea if this doesn't apply to AMIs?

comment by josteink · 2016-12-30 · in ZFS Root Filesystem on AWS

…when a containerized process gets terminated by the kernel for exceeding its memory limit: https://github.com/zfsonlinux/zfs/issues/5535 We're strongly considering using something else until this gets addressed. The problem is, we don't…

comment by otterley · 2016-12-29 · in ZFS Root Filesystem on AWS

cf. https://github.com/zfsonlinux/zfs/wiki/RHEL-%26-CentOS

comment by jlgaddis · 2016-12-29 · in ZFS Root Filesystem on AWS

…in git, and FBSD doesn't support userobj_accounting or large_dnode from ZoL git master[2][3]. [1] - https://github.com/zfsonlinux/zfs/issues/2438 [2] - https://github.com/zfsonlinux/zfs/issues/3500 [3] -…

comment by rincebrain · 2016-12-25 · in Cohabiting FreeBSD and Gentoo Linux on a Common ZFS Pool

…work on Linux or FreeNAS. You need some scripting/external tooling to do the equivalent. See https://github.com/zfsonlinux/zfs/issues/2449 https://forums.servethehome.com/index.php?threads/zol-hotspa... I've had a few drives fail on my ZFS…

comment by dhess · 2016-08-25 · in FreeNAS: Open Source Storage Operating System

…I've been reluctant to upgrade as of yet. Otherwise, ZFS on a home file server has been great. [1] https://github.com/zfsonlinux/zfs/issues/3808

comment by Zancarius · 2016-07-21 · in Native encryption added to ZFS on Linux

…-- it was like someone hit the laptop's "pause" button a couple of times per minute. [0]: https://github.com/zfsonlinux/zfs/wiki/Ubuntu-16.04-Root-on-...

comment by jlgaddis · 2016-07-20 · in Native encryption added to ZFS on Linux

…service, but ended up going back to ext4 due to memory management bugs. In particular this one: https://github.com/zfsonlinux/zfs/issues/3645

comment by lfittl · 2016-07-20 · in Native encryption added to ZFS on Linux

…ZoL-specific, though 0.6.5 not having a fix merged for a while is slightly surprising. Just grab https://github.com/zfsonlinux/zfs/pull/4833 and send/recv in safety. ;)

comment by rincebrain · 2016-07-20 · in Native encryption added to ZFS on Linux

…as you don't backup with send/receive. ("Silently corrupted file in snapshots after send/receive" https://github.com/zfsonlinux/zfs/issues/4809 )

comment by tobias3 · 2016-07-20 · in Native encryption added to ZFS on Linux

Related pull request with more details & discussion https://github.com/zfsonlinux/zfs/pull/4329

comment by mrsteveman1 · 2016-07-20 · in Native encryption added to ZFS on Linux

…zero hassle. FreeBSD is nice though. No harm in trying it out to widen your horizon :) [1] https://github.com/zfsonlinux/zfs/wiki/Ubuntu-16.04-Root-on-...

comment by josteink · 2016-07-05 · in BSD vs. Linux (2005)

I did a brief write-up about this effect on the ZoL issue tracker: https://github.com/zfsonlinux/zfs/issues/4785#issuecomment-2... In short, if you want more consistent performance as the pool fills, disable metaslab_lba_weighting_enabled,…

comment by ryao · 2016-06-23 · in ZFS: Apple’s New Filesystem That Wasn’t

…that's generated is strikingly better, although not quite as good as the hand tuned code in e.g. ( https://github.com/zfsonlinux/zfs/pull/4439 ). It may be interesting to compare performance, but given that compression=lz4 and…

comment by raattgift · 2016-06-16 · in Apple File System

…lately. Saw Ubuntu get behind it, even in light of Btrfs being available for many years now. https://github.com/zfsonlinux/zfs/commits/master is pretty active... It seems everyone at some point expected Btrfs to shoot ahead and leave other…

comment by rdtsc · 2016-06-15 · in ZFS: Apple’s New Filesystem That Wasn’t

There are far more than 2 people here: https://github.com/zfsonlinux/zfs/commits/master I will admit that my contribution activity has been low as of late, but it will pick up again soon. As for the bug list, that is because basically all…

comment by ryao · 2016-05-26 · in Who Needs Git When You Have ZFS?

There is a DKMS package similar to the Debian one which requires just a single command to install: https://github.com/zfsonlinux/zfs/wiki/Fedora However it is unlikely that Fedora will ship ZFS unless the license changes or is clarified by…

comment by rwmj · 2016-05-14 · in ZFS lands in Debian contrib

…the kernel version unless something turns out to be wrong. I put the idea into the issue tracker: https://github.com/zfsonlinux/zfs/issues/4375

comment by ryao · 2016-02-27 · in The Linux Kernel, CDDL and Related Issues

…by commit count according to github's statistics and I have maintained that position for years: https://github.com/zfsonlinux/zfs/graphs/contributors If any of the other OpenZFS developers had a problem with Linux distributions shipping…

comment by ryao · 2016-02-25 · in GPL Violations Related to Combining ZFS and Linux

…USB, ZFS is not at any disadvantage versus other filesystems. For what it is worth, I am this ryao: https://github.com/zfsonlinux/zfs/graphs/contributors

comment by ryao · 2016-02-20 · in ZFS is the FS for Containers in Ubuntu 16.04

…This ought to help prevent best-fit allocation from occurring earlier than necessary on SSDs: https://github.com/zfsonlinux/zfs/commit/fb40095f5f0853946f8... That said, Delphix made changes to consider on fragmentation rather than space…

comment by ryao · 2016-02-19 · in ZFS is the FS for Containers in Ubuntu 16.04

Does this include a fix for this bug? https://github.com/zfsonlinux/zfs/issues/1548

comment by jgworks · 2016-02-18 · in ZFS is the FS for Containers in Ubuntu 16.04

OZFS has it, but ZoL doesn't (yet), so I'd guess they don't yet. https://github.com/zfsonlinux/zfs/issues/3896 e: Ah, they run ZFS on FreeBSD, but I don't think FBSD has it yet either...

comment by rincebrain · 2015-12-18 · in Rsync.net: ZFS Replication to the cloud is here and fast

tweaks needed it you put mysql database files on zfs linux: https://github.com/zfsonlinux/zfs/issues/2872 and: https://github.com/zfsonlinux/zfs/issues/224 other than that: awesome!

comment by seoguru · 2014-11-29 · in Zfs support for docker (beta)

…system lost * power while rewriting the only good copy, * there would be no good copies left! */ https://github.com/zfsonlinux/zfs/blob/master/module/zfs/vde... That touches more than obvious at a glance because the mirror code is used for…

comment by ryao · 2014-10-11 · in Is ZFS a suitable replacement for other Linux filesystems?

I ported this fix to ZoL and opened a pull request to get it merged into HEAD for the next release: https://github.com/zfsonlinux/zfs/pull/2784 O3X merges fixes from ZoL, so it should get this fix soon after it has been merged to ZoL.

comment by ryao · 2014-10-10 · in Is ZFS a suitable replacement for other Linux filesystems?

…There is a patch in ZoL HEAD for the next release that makes zfs_dedup_prefetch=0 by default: https://github.com/zfsonlinux/zfs/commit/0dfc732416922e1dd59... Aside from that, you are right that there has not been much done here. Making…

comment by ryao · 2014-10-10 · in Is ZFS a suitable replacement for other Linux filesystems?

…that the project plans to merge before the next release: https://github.com/zfsonlinux/spl/pull/369 https://github.com/zfsonlinux/zfs/pull/2411 The fix requires both pull requests, but I have yet to refresh the second pull request with the…

comment by ryao · 2014-10-10 · in Is ZFS a suitable replacement for other Linux filesystems?

…will likely implement an option to build a FUSE driver in the future, but it is not a priority: https://github.com/zfsonlinux/zfs/issues/8

comment by ryao · 2014-09-19 · in File Systems, Data Loss and ZFS

…increasing performance in certain workloads: https://github.com/zfsonlinux/spl/pull/369 https://github.com/zfsonlinux/zfs/pull/2411 * The above pull requests have a fairly dramatic impact on NFS performance. Benchmarks shown to me by…

comment by ryao · 2014-09-15 · in The State of ZFS on Linux

…there are several improvements in the pipeline for ZoL zvols that should improve its performance: https://github.com/zfsonlinux/zfs/pull/2484 With that introduction out of the way, the actual answer to your first question is that it is…

comment by ryao · 2014-09-15 · in The State of ZFS on Linux

…It's not a major issue and I've yet to encounter the issue again I've already filed a related bug: https://github.com/zfsonlinux/zfs/issues/2508 but I'm not an expert. If I can gather more data I'll try to submit as much data and hints I…

comment by nisa · 2014-09-11 · in The State of ZFS on Linux

…on the topic. If there are any outstanding issues not listed there, please file an issue on github: https://github.com/zfsonlinux/zfs/issues/new I also encourage you to file an issue requesting support for cgroup bsaed IO throttling. You…

comment by ryao · 2014-09-11 · in The State of ZFS on Linux

Your deadlock was likely caused by the sole regression to get by us in the 0.6.2 release: https://github.com/zfsonlinux/zfs/commit/a117a6d66e5cf1e9d4f... This occurred because it was rare enough that neither us nor the buildbots caught it…

comment by ryao · 2014-09-11 · in The State of ZFS on Linux

…hung and none of my ZFS commands were returning. The snapshot delete was not killable with kill -9. https://github.com/zfsonlinux/zfs/issues/1283 Also, under load encountered a kernel panic or a hang (I forget), turns out it's because the…

comment by astral303 · 2014-09-11 · in The State of ZFS on Linux

…in the LLNL buildbot. The majority of the enabling work in this area was done by Turbo Fredriksson. https://github.com/zfsonlinux/zfs/commits?author=FransUrbo I would emailing the zfs-discuss mailing list with Turbo on CC to ask:…

comment by ryao · 2014-09-11 · in The State of ZFS on Linux

…initramfs generator in ZoL upstream. I suggest filing an issue to inquire about this possibility: https://github.com/zfsonlinux/zfs/issues/new

comment by ryao · 2014-09-11 · in The State of ZFS on Linux

…do this for each distribution. There is an open issue for integrating encryption into ZoL itself: https://github.com/zfsonlinux/zfs/issues/494 This will likely be added to ZoL in the future, but no one is actively working on it at this…

comment by ryao · 2014-09-11 · in The State of ZFS on Linux

…This functionality could likely be implemented into it. Please file an issue requesting this: https://github.com/zfsonlinux/zfs/issues/new

comment by ryao · 2014-09-11 · in The State of ZFS on Linux

…and sharesmb settings from `zpool history`. Please file issues with them in the issue tracker: https://github.com/zfsonlinux/zfs/issues/new Please include information describing your distribution, the distribution release, your kernel…

comment by ryao · 2014-09-11 · in The State of ZFS on Linux

The design is documented here: https://github.com/zfsonlinux/zfs/blob/master/module/zfs/arc...

comment by wmf · 2013-09-07 · in Linode SSD Beta

…milestones are also interesting. v0.6.0 had several RCs before being released as stable.[2] [1]: https://github.com/zfsonlinux/zfs/issues/milestones [2]: https://github.com/zfsonlinux/zfs/issues/milestones?state=cl...

comment by djeikyb · 2013-03-29 · in ZFS on Linux 0.6.1 released: Ready for wide scale deployment