openzfs/zfs on Hacker News

ZFS on top of LUKS seems to have it's own issues though. :( https://github.com/openzfs/zfs/issues/15533

comment by justinclift · 2023-12-17 · in ZFS Profiling on Arch Linux

My experience has been aggravated by being simultaneously affected by https://github.com/openzfs/zfs/issues/11893 , which results in all zfs operations hanging (kill -9 is ineffective) until a power cycle. This round of upgrades was not…

comment by 3np · 2023-12-07 · in Tell HN: ZFS silent data corruption bugfix – my research results

https://github.com/openzfs/zfs/pull/15529#pullrequestreview-... Honestly, ZFS is the best thing on the (Free)BSDs only... On Linux it doesn't even use the page cache, and you conflict severely with L2ARC. I know there's a variety of people…

comment by KyleSanderson · 2023-12-07 · in Tell HN: ZFS silent data corruption bugfix – my research results

…the fix [0] was from 2006[1], which was ~5 months after Sun released ZFS. Glad this is fixed! [0] https://github.com/openzfs/zfs/pull/15571 [1] https://github.com/illumos/illumos-gate/commit/c543ec060d

comment by evanjrowley · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

There's an ongoing work on a stress test for this. https://github.com/openzfs/zfs/pull/15608

comment by jiripospisil · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

Bug has been fix (apparently), btw.. https://github.com/openzfs/zfs/releases/tag/zfs-2.2.2

comment by Anon_C0ward · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

…asked if they could keep the system permanently for future testing. But that was exciting. [1] - https://github.com/openzfs/zfs/pull/15588

comment by rincebrain · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

A more "correct" fix has been posted https://github.com/openzfs/zfs/pull/15615

comment by jiripospisil · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

Isn't it there? https://github.com/openzfs/zfs/commit/fd7265c646f40e364396af... git branch --contains fd7265c * master Since 0.8. git branch -r --contains fd7265c | head origin/HEAD -> origin/master origin/compat-5.15-META…

comment by donmcronald · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

…but it never got merged to the master or release as far as I see it Current Master: https://github.com/openzfs/zfs/blob/acb33ee1c169bf1c1f687db1... When I look up the problem, I could only see the issue being discussed, and probably…

comment by reacharavindh · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

The bug was finally fixed with the following commit: https://github.com/openzfs/zfs/pull/15579/commits/679738cc40... It looks like they managed to exactly pin down what was happening.

comment by szpght · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

…still not able to hardlink across file systems in BSD. >It is not really behind. It is behind: https://github.com/openzfs/zfs/issues/405

comment by Always_Anon · 2023-11-29 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

No it wasn't: https://github.com/openzfs/zfs/issues/405 This hit Linux first, which is why Linux experienced the issue. FreeBSD does not currently have reflink cp.

comment by Always_Anon · 2023-11-29 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

…confirm the core ideas and design something that I will only have to do once, and the discussion on https://github.com/openzfs/zfs/issues/15526#issuecomment-182... is still ongoing. If you want more detail about my proposed approach,…

comment by csdvrx · 2023-11-28 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

…corrupted files (with some risk of false positives) by searching for zero-byte blocks: [2] [0]: https://github.com/openzfs/zfs/issues/15526#issuecomment-181... [1]: https://github.com/openzfs/zfs/issues/15526#issuecomment-182... [2]:…

comment by n8henrie · 2023-11-26 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

…how it became much more likely to happen recently, even though it has existed for a very long time: https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by veidr · 2023-11-26 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

It seems that this doesn't really fixe the bug [0] and also enables another one [1][2] [0] https://github.com/openzfs/zfs/issues/15526#issuecomment-182... [1] https://github.com/openzfs/zfs/issues/15526#issuecomment-182... [2]…

comment by qwertox · 2023-11-25 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

…rruption/ [2]: https://gist.github.com/masonmark/03c7cb08e22968b1f2feb1a6ac... [3]: https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by veidr · 2023-11-25 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

Apply this patch, it appears to be the real fix. https://github.com/openzfs/zfs/pull/15571/files?diff=split&w...

comment by keep_reading · 2023-11-25 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

Nope, somebody managed to reproduce this issue even with zfs_dmu_offset_next_sync=0 https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by fortani · 2023-11-24 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

RobN has opened a PR consisting of the patch he asked people to test in the issue. https://github.com/openzfs/zfs/pull/15571 Pretty crazy the bug might date back 10 years.

comment by AndrewDavis · 2023-11-24 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

…predating bclone Edit: yep, it's an older bug. Set zfs_dmu_offset_next_sync=0 to save your data https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by keep_reading · 2023-11-24 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by jiripospisil · 2023-11-23 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

Don't forget how `zfs send | zfs receive` could cause both pools to be corrupted, reported in - https://github.com/openzfs/zfs/issues/15140 : supposed to be from flushing largepages - https://github.com/openzfs/zfs/issues/15275 fixed by…

comment by csdvrx · 2023-11-22 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

Here's an example of a nasty data corruption bug in ZFS from not that long ago: https://github.com/openzfs/zfs/issues/7401 Corresponding HN discussion at the time: https://news.ycombinator.com/item?id=16797644

comment by antongribok · 2023-11-22 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

…more frequent with ZFS on Linux, especially if you use more fringe features like encryption. [0]: https://github.com/openzfs/zfs/issues/14290 [1]: https://github.com/atuinsh/atuin/issues/952

comment by mastax · 2023-11-22 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

…providing significant performance improvements. Post-2.2 OpenZFS has RAID-Z expansion committed: * https://github.com/openzfs/zfs/discussions/15232 Also committed to FreeBSD -HEAD/development: * https://github.com/freebsd/freebsd-src/commit…

comment by throw0101a · 2023-11-20 · in FreeBSD 14.0-Release

Actual link is https://github.com/openzfs/zfs/pull/15022#issuecomment-18024... but HN's dup detection links to a story from 83 days ago. @dang et al, would be nice to consider anchor text in the duplication feature for such occasions.

comment by cookiecaper · 2023-11-11 · in Raid-Z expansion merged to master, targeting OpenZFS 2.3 release

Great work, though note that it will be available on 2.3 release estimated in 2024 https://github.com/openzfs/zfs/pull/15022#issuecomment-18024...

comment by fomine3 · 2023-11-10 · in OpenZFS Lands Raidz Expansion Feature

…a whole new RAID-Z group (typically doubling the number of disks)." Here's the commit message https://github.com/openzfs/zfs/pull/15022/commits/c3f8a291b1...

comment by sillywalk · 2023-11-09 · in OpenZFS Lands Raidz Expansion Feature

https://github.com/openzfs/zfs/issues/260 I stand corrected, last time I checked they didn't support freeze/unthaw on ZoL, it's always worked on FreeBSD though.

comment by carlhjerpe · 2023-11-01 · in Bcachefs Merged into the Linux 6.7 Kernel

…is required. The list of open issues on GitHub in the native encryption component is quite telling: https://github.com/openzfs/zfs/issues?q=is%3Aopen+is%3Aissue...

comment by praseodym · 2023-10-27 · in My 2023 all-flash ZFS NAS (Network Storage) build

…zvol. So you would need a non-zfs managed partition/device for swap. Not sure about current status? https://github.com/openzfs/zfs/issues/7734 https://github.com/openzfs/zfs/issues/342 https://utcc.utoronto.ca/~cks/space/blog/solaris/ZFSFor…

comment by e12e · 2023-10-27 · in My 2023 all-flash ZFS NAS (Network Storage) build

…and clones when a replica of the data already exists in the form of a backup send stream. * https://github.com/openzfs/zfs/releases/tag/zfs-2.2.0 * https://github.com/openzfs/zfs/pull/9372

comment by throw0101c · 2023-10-27 · in My 2023 all-flash ZFS NAS (Network Storage) build

There's https://github.com/openzfs/zfs/tree/master/contrib/pyzfs , which is as official as it gets.

comment by pgeorgi · 2023-10-18 · in OpenZFS 2.2: Block Cloning, Linux Containers, BLAKE3

Nah, the PR for that is still being reviewed prior to getting merged: https://github.com/openzfs/zfs/pull/15022

comment by justinclift · 2023-10-15 · in OpenZFS 2.2: Block Cloning, Linux Containers, BLAKE3

It's been a good week! https://github.com/openzfs/zfs/releases/tag/zfs-2.2.0

comment by oconnor663 · 2023-10-15 · in Debunking NIST's calculation of the Kyber-512 security level

…going on. If they can get it working it seemed to give a decent boost for certain scenarios. [1]: https://github.com/openzfs/zfs/pull/13148 [2]: https://github.com/openzfs/zfs/issues/15351

comment by magicalhippo · 2023-10-13 · in OpenZFS 2.2: Block Cloning, Linux Containers, BLAKE3

…[2]: https://people.freebsd.org/~gibbs/zfs_doxygenation/html/d9/d... [3]: https://github.com/openzfs/zfs/blob/c0e58995e33479a9c1d97fb2... [4]: https://github.com/openzfs/zfs/blob/c0e58995e33479a9c1d97fb2...

comment by gavinhoward · 2023-10-13 · in OpenZFS 2.2: Block Cloning, Linux Containers, BLAKE3

…and clones when a replica of the data already exists in the form of a backup send stream. [0] https://github.com/openzfs/zfs/pull/9372

comment by EvanAnderson · 2023-10-13 · in OpenZFS 2.2: Block Cloning, Linux Containers, BLAKE3

…While block cloning isn't supported for encrypted datasets yet, looks like there is a WIP already: https://github.com/openzfs/zfs/pull/14705 Very cool to have the ability for near instant cp or mv between datasets or snapshot (at least…

comment by dsp_person · 2023-10-13 · in OpenZFS 2.2: Block Cloning, Linux Containers, BLAKE3

…and test, always test . [0] https://openzfs.github.io/openzfs-docs/Project%20and%20Commu... [1] https://github.com/openzfs/zfs/pull/4523/commits/73abf3a8634...

comment by tomxor · 2023-09-06 · in ZFS for Dummies

…(looks weird, but this is a legit web front end for the mailing list) and the github issues: https://github.com/openzfs/zfs/issues

comment by Modified3019 · 2023-09-05 · in ZFS for Dummies

…some current work to add a disk to existing vdevs, and I think even a semi-working PR for it now: https://github.com/openzfs/zfs/pull/15022 . Hopefully in theory that will make ZFS a little less frustrating.

comment by tombert · 2023-08-23 · in Zrepl – ZFS replication

…data between them isn't instant. No more the case after block cloning support goes production: https://github.com/openzfs/zfs/pull/13392

comment by philkrylov · 2023-08-23 · in I only lost 10 minutes of data, thanks to ZFS

Beware using ZFS with external disks: https://github.com/openzfs/zfs/issues/3461

comment by yencabulator · 2023-08-21 · in OpenZFS – add disks to existing RAIDZ

…FreeNAS/TrueNAS) is sponsoring this work now. This PR supersedes ones that was opened back in 2021 https://github.com/openzfs/zfs/pull/12225#issuecomment-16101...

comment by eminence32 · 2023-08-19 · in OpenZFS – add disks to existing RAIDZ

…known performance issues that were improved greatly in the latest openzfs release. If you read https://github.com/openzfs/zfs/issues/11407 It should be in there somewhere. Dataset plus raw file will almost always be faster though due to…

comment by DannyBee · 2023-08-18 · in FreeBSD Bhyve Virtualization

…partition. [0] even setting the myriad of options there still exist reports about hangs, like https://github.com/openzfs/zfs/issues/7734#issuecomment-4167...

comment by tlamponi · 2023-07-05 · in ZFS 2.2.0 (RC): Block Cloning merged

…support for ZFS and native encryption uses a hacky intermediate key under LUKS, but it works. [0] https://github.com/openzfs/zfs/issues/12014 [1] https://github.com/openzfs/zfs/issues/12594 [2] https://serverfault.com/questions/265779/split…

comment by benlivengood · 2023-07-04 · in ZFS 2.2.0 (RC): Block Cloning merged