Hacker GitHub

← All repos

wesm/feather

View on GitHub ↗ ★ 2,757 JavaScript

Feather: fast, interoperable binary data frame storage for Python, R, and more powered by Apache Arrow

11 mentions on Hacker News by 10 people: 1 story, 10 comments · first 2016-03-30 · latest 2021-12-14

Mentions per year 11 mentions · busiest year 2016 (5)
20082026
AllStoriesComments NewestTopOldest
  1. Also Feather: https://github.com/wesm/feather
    comment by Evidlo · 2021-12-14 · in Fun with File Formats
  2. …rather than in memory, but I'd still be interested in performance and use case comparisons. [1] https://github.com/wesm/feather [2] https://www.fstpackage.org/fst/ [3] https://diskframe.com/ [4] https://duckdb.org/
    comment by phillc73 · 2021-01-19 · in Vineyard: An open-source in-memory data manager
  3. …than Parquet ( https://parquet.apache.org/ -- index, columnar data split across files), Feather ( https://github.com/wesm/feather -- which has first class R support or FST ( https://www.fstpackage.org/ -- Also first class R support)?
    comment by aroch · 2019-10-11 · in Show HN: Disk.frame, a larger-than-RAM data manipulation package
  4. …to build it on top of Arrow (in exactly the same way that Feather is based on top of Arrow https://github.com/wesm/feather ).
    comment by sandGorgon · 2017-09-07 · in Facebook and Microsoft introduce ecosystem for interchangeable AI frameworks
  5. …and loading that in-memory format to and from disk efficiently and in an interoperable way. ( https://github.com/wesm/feather ) Also of note is parquet, which has similar goals to HDF and feather, but the continuum / dask people have been…
    comment by makmanalp · 2017-04-12 · in Show HN: Kim – A Python serialization and marshaling framework
  6. …criticism of the language. [1] https://cran.r-project.org/web/views/HighPerformanceComputin... [2] https://github.com/wesm/feather [3] https://github.com/fstpackage/fst [4] https://github.com/antirez/redis-doc/pull/798/files [5]…
    comment by phillc73 · 2017-02-24 · in Ask HN: Learn Python, R? Or something else?
  7. …of pickle, take a look at feather [1] It's not a drop in replacement but it's very effective 1 - https://github.com/wesm/feather
    comment by EwanToo · 2016-06-06 · in Exploiting Misuse of Python's “Pickle”
  8. ▲ 3
    Feather: fast, interoperable binary data frame storage for Python, R, and more
    story by ptoniato · 2016-05-06 · 0 comments
  9. > Wes -- does the Python library for Feather already release the GIL? Checking out the code: https://github.com/wesm/feather/blob/master/python/feather/l... So the actual reading from and writing to disk should be with a released GIL if…
    comment by masklinn · 2016-03-30 · in Feather: A Fast On-Disk Format for Data Frames for R and Python
  10. Is there a spec somewhere, or is the existing implementation the spec? Edit: https://github.com/wesm/feather/blob/master/doc/FORMAT.md Seems a bit sparse/incomplete still (as would be expected for a brand new project).
    comment by jacobolus · 2016-03-30 · in Feather: A Fast On-Disk Format for Data Frames for R and Python
  11. …support a number of pandas features (but these are features that R doesn't really support, either): https://github.com/wesm/feather/blob/master/python/README.md (not comprehensive)
    comment by wesm · 2016-03-30 · in Feather: A Fast On-Disk Format for Data Frames for R and Python