openzfs/zfs on Hacker News

For more details about this slop space, see this comment: https://github.com/openzfs/zfs/blob/99741bde59d1d1df0963009b...

comment by MarkSweep · 2024-04-04 · in A disk so full, it couldn't be restored

▲ 4

OpenZFS: Fix corruption caused by MMAP flushing problems

story by jiripospisil · 2024-03-26 · 0 comments

…and breaking ZFS which then needs a while to catch up. For the latest reoccurrence of this, see https://github.com/openzfs/zfs/pull/15931 for Linux 6.8 compatibility. There's also the fact that not everything is OOB compatible with ZFS.…

comment by vladvasiliu · 2024-03-20 · in Bug hunting in Btrfs

▲ 3

ZFS v2.2.3: Some copied files are still corrupted (chunks replaced by zeros)

story by turrini · 2024-02-27 · 0 comments

IMO the "next fs" is just zfs. They somewhat recently merged RAIDZ expansion feature https://github.com/openzfs/zfs/pull/12225 and make regular improvements. If no file system has what you need today, zfs will probably be the first one to…

comment by komali2 · 2024-02-20 · in DiskClick: Ever wanted to hear old hard drive sounds

…don't miss any edge cases, at least on the functional side. But then you occasionally get bugs like https://github.com/openzfs/zfs/issues/15453 which can't easily be caught by test suites.

comment by nubinetwork · 2024-02-12 · in OpenZFS bug reports for native encryption

https://github.com/openzfs/zfs/issues/10769 I wasn't a fan of that change, it serves no purpose other than to sweep issues under the carpet (which can be said of any project that uses one). Which is funny because they have just as many…

comment by nubinetwork · 2024-02-12 · in OpenZFS bug reports for native encryption

…it needed to keep this closed-source in order to get ROI[2]. [1]: https://youtu.be/opW9KhjOQ3Q [2]: https://github.com/openzfs/zfs/issues/12119

comment by magicalhippo · 2024-02-03 · in SeaweedFS fast distributed storage system for blobs, objects, files and datalake

…from 6 years ago. Just a month after that there was a pretty big bug in ZFS that corrupted data. https://github.com/openzfs/zfs/issues/7401 Corresponding HN discussion at the time: https://news.ycombinator.com/item?id=16797644

comment by antongribok · 2024-01-30 · in Rclone syncs your files to cloud storage

https://github.com/openzfs/zfs/issues/15526#issuecomment-181... > zpool get all tank | grep bclone > kc3000 bcloneused 442M > kc3000 bclonesaved 1.42G > kc3000 bcloneratio 4.30x > My understanding is this: If the result is 0 for both…

comment by dist-epoch · 2023-12-26 · in A data corruption bug in OpenZFS?

…files being moved around where suddenly files are zero). [0] https://bugs.gentoo.org/917224 [1] https://github.com/openzfs/zfs/issues/15526 (referenced in the article)

comment by moviuro · 2023-12-26 · in A data corruption bug in OpenZFS?

…work, and I also couldn't convince myself it should. It seems to have worked out. [1] [1] - https://github.com/openzfs/zfs/commit/f375b23c026aec00cc9527...

comment by rincebrain · 2023-12-23 · in Ask HN: What's your "it's not stupid if it works" story?

https://github.com/openzfs/zfs/issues/7631 This is a long-standing issue with zvols which affects overall system stability, and has no real solution as of yet.

comment by Xorlev · 2023-12-17 · in ZFS Profiling on Arch Linux

More details on this discussion: https://github.com/openzfs/zfs/issues/6824#issuecomment-1817... . Basically he is too busy to continue developing the encryption features but is able to review the related works. There is also discussion…

comment by wb14123 · 2023-12-17 · in ZFS Profiling on Arch Linux

…that they are just having issues with certain kind of hard drives. There is a PR out for this: https://github.com/openzfs/zfs/pull/15588

comment by PaulCarrack · 2023-12-17 · in ZFS Profiling on Arch Linux

ZFS on top of LUKS seems to have it's own issues though. :( https://github.com/openzfs/zfs/issues/15533

comment by justinclift · 2023-12-17 · in ZFS Profiling on Arch Linux

My experience has been aggravated by being simultaneously affected by https://github.com/openzfs/zfs/issues/11893 , which results in all zfs operations hanging (kill -9 is ineffective) until a power cycle. This round of upgrades was not…

comment by 3np · 2023-12-07 · in Tell HN: ZFS silent data corruption bugfix – my research results

https://github.com/openzfs/zfs/pull/15529#pullrequestreview-... Honestly, ZFS is the best thing on the (Free)BSDs only... On Linux it doesn't even use the page cache, and you conflict severely with L2ARC. I know there's a variety of people…

comment by KyleSanderson · 2023-12-07 · in Tell HN: ZFS silent data corruption bugfix – my research results

▲ 4

ZFS 2.2.2: Important fix for a data corruption bug

story by turrini · 2023-12-04 · 0 comments

…the fix [0] was from 2006[1], which was ~5 months after Sun released ZFS. Glad this is fixed! [0] https://github.com/openzfs/zfs/pull/15571 [1] https://github.com/illumos/illumos-gate/commit/c543ec060d

comment by evanjrowley · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

There's an ongoing work on a stress test for this. https://github.com/openzfs/zfs/pull/15608

comment by jiripospisil · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

Bug has been fix (apparently), btw.. https://github.com/openzfs/zfs/releases/tag/zfs-2.2.2

comment by Anon_C0ward · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

…asked if they could keep the system permanently for future testing. But that was exciting. [1] - https://github.com/openzfs/zfs/pull/15588

comment by rincebrain · 2023-12-01 · in In OpenZFS and Btrfs, everyone was just guessing

A more "correct" fix has been posted https://github.com/openzfs/zfs/pull/15615

comment by jiripospisil · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

Isn't it there? https://github.com/openzfs/zfs/commit/fd7265c646f40e364396af... git branch --contains fd7265c * master Since 0.8. git branch -r --contains fd7265c | head origin/HEAD -> origin/master origin/compat-5.15-META…

comment by donmcronald · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

…but it never got merged to the master or release as far as I see it Current Master: https://github.com/openzfs/zfs/blob/acb33ee1c169bf1c1f687db1... When I look up the problem, I could only see the issue being discussed, and probably…

comment by reacharavindh · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

The bug was finally fixed with the following commit: https://github.com/openzfs/zfs/pull/15579/commits/679738cc40... It looks like they managed to exactly pin down what was happening.

comment by szpght · 2023-11-30 · in In OpenZFS and Btrfs, everyone was just guessing

…still not able to hardlink across file systems in BSD. >It is not really behind. It is behind: https://github.com/openzfs/zfs/issues/405

comment by Always_Anon · 2023-11-29 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

No it wasn't: https://github.com/openzfs/zfs/issues/405 This hit Linux first, which is why Linux experienced the issue. FreeBSD does not currently have reflink cp.

comment by Always_Anon · 2023-11-29 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

…confirm the core ideas and design something that I will only have to do once, and the discussion on https://github.com/openzfs/zfs/issues/15526#issuecomment-182... is still ongoing. If you want more detail about my proposed approach,…

comment by csdvrx · 2023-11-28 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

…corrupted files (with some risk of false positives) by searching for zero-byte blocks: [2] [0]: https://github.com/openzfs/zfs/issues/15526#issuecomment-181... [1]: https://github.com/openzfs/zfs/issues/15526#issuecomment-182... [2]:…

comment by n8henrie · 2023-11-26 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

…how it became much more likely to happen recently, even though it has existed for a very long time: https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by veidr · 2023-11-26 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

▲ 4

CKSUM and WRITE errors with 2.2.1 stable, when vdevs are atop LUKS

story by l2dy · 2023-11-26 · 0 comments

It seems that this doesn't really fixe the bug [0] and also enables another one [1][2] [0] https://github.com/openzfs/zfs/issues/15526#issuecomment-182... [1] https://github.com/openzfs/zfs/issues/15526#issuecomment-182... [2]…

comment by qwertox · 2023-11-25 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

…rruption/ [2]: https://gist.github.com/masonmark/03c7cb08e22968b1f2feb1a6ac... [3]: https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by veidr · 2023-11-25 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

Apply this patch, it appears to be the real fix. https://github.com/openzfs/zfs/pull/15571/files?diff=split&w...

comment by keep_reading · 2023-11-25 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

Nope, somebody managed to reproduce this issue even with zfs_dmu_offset_next_sync=0 https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by fortani · 2023-11-24 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

RobN has opened a PR consisting of the patch he asked people to test in the issue. https://github.com/openzfs/zfs/pull/15571 Pretty crazy the bug might date back 10 years.

comment by AndrewDavis · 2023-11-24 · in ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

▲ 101

ZFS silent corruption bug found: replaces chunks inside copied files by zeroes

story by csdvrx · 2023-11-24 · 40 comments

…predating bclone Edit: yep, it's an older bug. Set zfs_dmu_offset_next_sync=0 to save your data https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by keep_reading · 2023-11-24 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

https://github.com/openzfs/zfs/issues/15526#issuecomment-182...

comment by jiripospisil · 2023-11-23 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

Don't forget how `zfs send | zfs receive` could cause both pools to be corrupted, reported in - https://github.com/openzfs/zfs/issues/15140 : supposed to be from flushing largepages - https://github.com/openzfs/zfs/issues/15275 fixed by…

comment by csdvrx · 2023-11-22 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

Here's an example of a nasty data corruption bug in ZFS from not that long ago: https://github.com/openzfs/zfs/issues/7401 Corresponding HN discussion at the time: https://news.ycombinator.com/item?id=16797644

comment by antongribok · 2023-11-22 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

…more frequent with ZFS on Linux, especially if you use more fringe features like encryption. [0]: https://github.com/openzfs/zfs/issues/14290 [1]: https://github.com/atuinsh/atuin/issues/952

comment by mastax · 2023-11-22 · in ZFS 2.2.1: Block Cloning disabled due to data corruption

▲ 135

ZFS 2.2.1: Block Cloning disabled due to data corruption

story by turrini · 2023-11-22 · 64 comments

…providing significant performance improvements. Post-2.2 OpenZFS has RAID-Z expansion committed: * https://github.com/openzfs/zfs/discussions/15232 Also committed to FreeBSD -HEAD/development: * https://github.com/freebsd/freebsd-src/commit…

comment by throw0101a · 2023-11-20 · in FreeBSD 14.0-Release

Actual link is https://github.com/openzfs/zfs/pull/15022#issuecomment-18024... but HN's dup detection links to a story from 83 days ago. @dang et al, would be nice to consider anchor text in the duplication feature for such occasions.

comment by cookiecaper · 2023-11-11 · in Raid-Z expansion merged to master, targeting OpenZFS 2.3 release

▲ 2

Raid-Z expansion merged to master, targeting OpenZFS 2.3 release

story by cookiecaper · 2023-11-11 · 1 comment

Great work, though note that it will be available on 2.3 release estimated in 2024 https://github.com/openzfs/zfs/pull/15022#issuecomment-18024...

comment by fomine3 · 2023-11-10 · in OpenZFS Lands Raidz Expansion Feature

…a whole new RAID-Z group (typically doubling the number of disks)." Here's the commit message https://github.com/openzfs/zfs/pull/15022/commits/c3f8a291b1...

comment by sillywalk · 2023-11-09 · in OpenZFS Lands Raidz Expansion Feature