Hacker GitHub

← All repos

BurntSushi/xsv

View on GitHub ↗ ★ 10,750 Rust archived

A fast CSV command line toolkit written in Rust.

103 mentions on Hacker News by 76 people: 7 stories, 96 comments · first 2015-02-22 · latest 2026-01-19

Mentions per year 103 mentions · busiest year 2019 (18)
20082026
AllStoriesComments NewestTopOldest
  1. …is https://news.ycombinator.com/item?id=8908462 ). Right now the data scanning is just a fork of https://github.com/BurntSushi/xsv/ running in a container with plenty of ram, and we've handled files in the ~20GB range with no problem. I…
    comment by stevepike · 2020-02-25 · in Launch HN: Syndetic (YC W20) – Software for explaining datasets
  2. …I'm sure this could be accomblished with enough code, but is there quick / easy way to do it? [0]: https://github.com/BurntSushi/xsv#a-whirlwind-tour
    comment by fumplethumb · 2019-12-31 · in Doing a database join with CSV files
  3. Some commands are benchmarked here: https://github.com/BurntSushi/xsv/blob/master/BENCHMARKS.md
    comment by DasIch · 2019-12-31 · in Doing a database join with CSV files
  4. not sql, but xsv is awesome: https://github.com/BurntSushi/xsv
    comment by cgarvis · 2019-12-20 · in You Suck at Excel (2015) [video]
  5. I just use `xsv` for this. `xsv concatenate` and `xsv join` do a pretty good job. Blazing fast: https://github.com/BurntSushi/xsv
    comment by arjie · 2019-12-17 · in Show HN: CSV file merging
  6. …https://github.com/BatchLabs/charlatan https://github.com/dinedal/textql https://github.com/BurntSushi/xsv https://github.com/dbohdan/sqawk https://stedolan.github.io/jq/ https://github.com/benbernard/RecordStream
    comment by dima55 · 2019-11-23 · in An introduction to data processing on the Linux command line
  7. I use XSV: A fast CSV command line toolkit written in Rust. https://formulae.brew.sh/formula/xsv https://github.com/BurntSushi/xsv
    comment by kjpatel · 2019-11-05 · in How To Open and Manipulate Large CSV Files On A Mac
  8. You could get interested in: https://github.com/BurntSushi/xsv
    comment by mamcx · 2019-11-05 · in How To Open and Manipulate Large CSV Files On A Mac
  9. …I've worked with some really large csv files that I don't date open in most editors with xsv. https://github.com/BurntSushi/xsv
    comment by PudgePacket · 2019-10-05 · in Sqlite 3.30.0
  10. …great. I've shoved a CSV into sqlite many times before for this sort of thing. Some related tools: https://github.com/BurntSushi/xsv/ http://ebay.github.io/tsv-utils/
    comment by mcpherrinm · 2019-09-20 · in Show HN: cq – Query CSVs using SQL
  11. This is addressed in the xsv readme: https://github.com/BurntSushi/xsv#motivation We can't stop, because it's a de facto standard format for exchange with spreadsheet programs. So long as that's ubiquitous, we might as well write tools to…
    comment by burntsushi · 2019-09-01 · in TSV Utilities: Command line tools for large, tabular data files
  12. …and pipe out, get stats on contents of columns, samples, etc). It's one of my other goto things https://github.com/BurntSushi/xsv
    comment by IanCal · 2019-09-01 · in TSV Utilities: Command line tools for large, tabular data files
  13. …https://github.com/BatchLabs/charlatan https://github.com/dinedal/textql https://github.com/BurntSushi/xsv https://github.com/dbohdan/sqawk https://stedolan.github.io/jq/ https://github.com/benbernard/RecordStream
    comment by dima55 · 2019-08-31 · in TSV Utilities: Command line tools for large, tabular data files
  14. …is notable because it's written in D lang by a mega corp. Some useful cli data wrangling tools -- https://github.com/BurntSushi/xsv https://github.com/dinedal/textql https://github.com/n3mo/data-science https://stedolan.github.io/jq/…
    comment by JimmyRuska · 2019-08-31 · in TSV Utilities: Command line tools for large, tabular data files
  15. Anything by burntsushi, but especially xsv and ripgrep: xsv: https://github.com/BurntSushi/xsv ripgrep: https://github.com/BurntSushi/ripgrep His code typically has extensive tests, helpful comments, and logical structure. It was fun…
    comment by ekidd · 2019-07-29 · in Ask HN: What are the “best” codebases that you've encountered?
  16. https://github.com/BurntSushi/xsv is all you need here, not a mess of sort commands. xsv join enrollments.csv courses.csv | xsv table Uses an index as well.
    comment by orf · 2019-06-16 · in There's a Relational Database in Your Unix CLI
  17. …or persisted to disk, a great tool for analyzing datasets up to the low 10s of gigs. 2. XSV, https://github.com/BurntSushi/xsv
    comment by sitkack · 2019-06-15 · in Ask HN: What can I do to accelerate scientific research?
  18. …- https://csvkit.readthedocs.io/ - https://github.com/johnkerl/miller - https://github.com/BurntSushi/xsv - https://github.com/eBay/tsv-utils-dlang - https://stedolan.github.io/jq/ - http://harelba.github.io/q/ - https://github.co
    comment by dima55 · 2019-05-20 · in Show HN: UXY – adding structure to Unix tools
  19. I know this is not a "official" unix tool, but for join/comm specifically for CSV I love this tool: https://github.com/BurntSushi/xsv/releases/tag/0.13.0 xsv help: https://i.imgur.com/yS8cen7.png
    comment by lerax · 2019-03-07 · in Seven Unix Commands Every Data Scientist Should Know
  20. …it's already been processed, it just needs to be clearer to understand than raw CSV/JSON/XML: https://github.com/BurntSushi/xsv (link has examples of pretty-printed CSV)
    comment by lsh · 2018-12-19 · in Comma-Separated Tree
  21. …inspired by @burntsushi's rg, you might be interested in xsv for CSV viewing (and manipulation): https://github.com/BurntSushi/xsv
    comment by ComputerGuru · 2018-11-20 · in Ask HN: Best Command-Line Applications?
  22. And to round out the set, xsv ( https://github.com/BurntSushi/xsv/ ) is a powerful toolkit for CSV.
    comment by CJKerr · 2018-11-19 · in Ask HN: Best Command-Line Applications?
  23. …in a cli. This tool makes use of SQL syntax much more than xsv, so there isn't 100% overlap here. https://github.com/BurntSushi/xsv
    comment by cbcoutinho · 2018-11-14 · in Q: Run SQL Directly on CSV Files
  24. …of ripgrep) to a coding duel, bragging that I could get LuaJIT to match his XSV performance ( https://github.com/BurntSushi/xsv ) It took hours to figure out how to implement this in rust: https://github.com/sctb/lumen/blob/master/bin/lumen…
    comment by shawn · 2018-09-10 · in Why Rust closures are somewhat hard
  25. …would have failed with the same errors. If you like, you can download static binaries from github: https://github.com/BurntSushi/xsv/releases
    comment by burntsushi · 2018-09-09 · in XSV: A fast CSV command-line toolkit written in Rust
  26. rust-csv compiled and ran flawlessly. xsv had an error: https://github.com/BurntSushi/xsv/issues/139 Also loved this: // OMG I HATE BYTE STRING LITERALS SO MUCH. fn b(s: &str) -> &[u8] { s.as_bytes() } EDIT: Aha, it was user error. Brew…
    comment by shawn · 2018-09-09 · in XSV: A fast CSV command-line toolkit written in Rust
  27. …isn't the full story. [1] - https://github.com/BurntSushi/rust-csv/blob/546291a0095a2537... [2] - https://github.com/BurntSushi/xsv/blob/9574d89634031259802dd...
    comment by burntsushi · 2018-09-09 · in XSV: A fast CSV command-line toolkit written in Rust
  28. …the past, but these days I’d say that xsv > csvkit for working with CSV files on the command-line. https://github.com/BurntSushi/xsv
    comment by flother · 2018-08-30 · in CLI: Improved
  29. Sounds like xsv might be a nice complement to your toolkit https://github.com/BurntSushi/xsv
    comment by nicoburns · 2018-06-16 · in Learn just a little Awk (2010)
  30. https://github.com/BurntSushi/xsv is a must if you do anything with CSV.
    comment by silasb · 2018-05-07 · in Ask HN: What are your favorite terminal programs?
  31. …analyzing, splitting and joining CSV files", from Andrew Gallant (burntsushi of Go and Rust fame): https://github.com/BurntSushi/xsv
    comment by kibwen · 2018-04-07 · in TextQL: Execute SQL Against CSV or TSV
  32. I've been using https://github.com/BurntSushi/xsv which is quite nice and has a few other very handy csv tools.
    comment by bfrog · 2018-01-05 · in Show HN: Command Line Tool to Sort CSV and TSV Files by Multiple Headings in Go
  33. …Thinking of stuff like fd and: ripgrep: https://github.com/BurntSushi/ripgrep (grep/ag alt) xsv: https://github.com/BurntSushi/xsv (csv tool) exa: https://the.exa.website/ (ls) una: https://github.com/jwiegley/una (multi-compression utils…
    comment by coldtea · 2017-10-08 · in Show HN: A simple, fast and user-friendly alternative to find, written in Rust
  34. don't forget to checkout xsv ! its the missing piece between standard unix tools and SQL, I love it. https://github.com/BurntSushi/xsv
    comment by chaosfox · 2017-06-10 · in Rust and CSV parsing
  35. …handle different file encodings. Life would be so much simpler if everyone just used UTF-8. [0] https://github.com/BurntSushi/xsv
    comment by TheAceOfHearts · 2017-05-31 · in Tad, a tabular data viewer
  36. …-l 100 googlebooks-eng-all-1gram-20120701-0.tsv 5.19s user 0.06s system 351% cpu 1.490 total [1] https://github.com/BurntSushi/xsv
    comment by gregwebs · 2017-05-25 · in Faster Command Line Tools in D
  37. …specific data. [1] https://github.com/gelisam/hawk [2] https://stedolan.github.io/jq/manual/ [3] https://github.com/BurntSushi/xsv/blob/master/README.md
    comment by gregwebs · 2017-05-01 · in FuncShell – A Haskell-based alternative to awk
  38. I think the GP was asking about xsv, not ripgrep. There are binary releases for xsv though: https://github.com/BurntSushi/xsv/releases
    comment by burntsushi · 2016-09-24 · in Ripgrep – A new command line search tool
  39. From the Benchmarks section of the README: https://github.com/BurntSushi/xsv/blob/master/BENCHMARKS.md
    comment by doomrobo · 2016-09-23 · in xsv: A fast CSV toolkit written in Rust
  40. Using xsv ( https://github.com/BurntSushi/xsv ): cargo install xsv xsv search -s ZIPCODE <zipcode> -d $'\t' UCMR3_ZipCodes.txt xsv search -s PWSID <pwsid> -d $'\t' UCMR3_All.txt | xsv search -s AnalyticalResultsSign = | xsv select…
    comment by twr · 2016-08-11 · in Unsafe levels of toxic chemicals found in drinking water for 6M Americans
  41. xsv for doing queries against CSV files probably belongs to the list too: https://github.com/BurntSushi/xsv
    comment by zokier · 2016-05-07 · in A list of command line tools for manipulating structured text data
  42. …command just pulls out the second column from the CSV file, which is also one of my creations: https://github.com/BurntSushi/xsv --- but a simple Python script should do nicely as well). xsv select 2 20*.csv > urls-unsorted And then remove…
    comment by burntsushi · 2015-11-12 · in Finite state machines as data structure for representing ordered sets and maps
  43. There's also https://github.com/BurntSushi/xsv which is fairly similar in how it works to Miller, though it can also index a CSV file and then future operation will be sped up by utilizing the index.
    comment by lambda · 2015-08-16 · in Miller is like sed, awk, cut, join, and sort for name-indexed data such as CSV
  44. There's also xsv: https://github.com/BurntSushi/xsv
    comment by justhjkust · 2015-08-16 · in Miller is like sed, awk, cut, join, and sort for name-indexed data such as CSV
  45. See the "Motivation" section: https://github.com/BurntSushi/xsv#motivation There's a line somewhere between "conveniently play with large CSV data on the CLI" and "the full power of a RDBMS." It's blurry and we won't all agree on where it…
    comment by burntsushi · 2015-02-23 · in XSV – A fast CSV toolkit in Rust
  46. …I do have them available for Linux though, so you don't have to install Rust in order to try xsv: https://github.com/BurntSushi/xsv/releases Otherwise, you could try using rustle[1], which should install `xsv` in one command (but it…
    comment by burntsushi · 2015-02-22 · in XSV – A fast CSV toolkit in Rust