BurntSushi/xsv on Hacker News

…the path most people should take, but I didn't want to write table definitions. I ended up using https://github.com/BurntSushi/xsv (I am not affiliated with the project in any way). It's a command-line tool written in Rust that performs…

comment by alphanumeric0 · 2020-08-06 · in Scientists rename human genes to stop MS Excel from misreading them as dates

…crate [1]. xsv in particular is the best CLI csv tool I've ever used. And I've used them all. [0] https://github.com/BurntSushi/xsv [1] https://github.com/BurntSushi/rust-csv

comment by VWWHFSfQ · 2020-05-15 · in So you want to write your own CSV code (2014)

…so it's one binary - no runtime dependencies, and will happily chunk through multi-gigabyte files. https://github.com/BurntSushi/xsv

comment by nicoburns · 2020-05-15 · in So you want to write your own CSV code (2014)

…is https://news.ycombinator.com/item?id=8908462 ). Right now the data scanning is just a fork of https://github.com/BurntSushi/xsv/ running in a container with plenty of ram, and we've handled files in the ~20GB range with no problem. I…

comment by stevepike · 2020-02-25 · in Launch HN: Syndetic (YC W20) – Software for explaining datasets

…I'm sure this could be accomblished with enough code, but is there quick / easy way to do it? [0]: https://github.com/BurntSushi/xsv#a-whirlwind-tour

comment by fumplethumb · 2019-12-31 · in Doing a database join with CSV files

Some commands are benchmarked here: https://github.com/BurntSushi/xsv/blob/master/BENCHMARKS.md

comment by DasIch · 2019-12-31 · in Doing a database join with CSV files

not sql, but xsv is awesome: https://github.com/BurntSushi/xsv

comment by cgarvis · 2019-12-20 · in You Suck at Excel (2015) [video]

I just use `xsv` for this. `xsv concatenate` and `xsv join` do a pretty good job. Blazing fast: https://github.com/BurntSushi/xsv

comment by arjie · 2019-12-17 · in Show HN: CSV file merging

…https://github.com/BatchLabs/charlatan https://github.com/dinedal/textql https://github.com/BurntSushi/xsv https://github.com/dbohdan/sqawk https://stedolan.github.io/jq/ https://github.com/benbernard/RecordStream

comment by dima55 · 2019-11-23 · in An introduction to data processing on the Linux command line

I use XSV: A fast CSV command line toolkit written in Rust. https://formulae.brew.sh/formula/xsv https://github.com/BurntSushi/xsv

comment by kjpatel · 2019-11-05 · in How To Open and Manipulate Large CSV Files On A Mac

You could get interested in: https://github.com/BurntSushi/xsv

comment by mamcx · 2019-11-05 · in How To Open and Manipulate Large CSV Files On A Mac

…I've worked with some really large csv files that I don't date open in most editors with xsv. https://github.com/BurntSushi/xsv

comment by PudgePacket · 2019-10-05 · in Sqlite 3.30.0

…great. I've shoved a CSV into sqlite many times before for this sort of thing. Some related tools: https://github.com/BurntSushi/xsv/ http://ebay.github.io/tsv-utils/

comment by mcpherrinm · 2019-09-20 · in Show HN: cq – Query CSVs using SQL

This is addressed in the xsv readme: https://github.com/BurntSushi/xsv#motivation We can't stop, because it's a de facto standard format for exchange with spreadsheet programs. So long as that's ubiquitous, we might as well write tools to…

comment by burntsushi · 2019-09-01 · in TSV Utilities: Command line tools for large, tabular data files

…and pipe out, get stats on contents of columns, samples, etc). It's one of my other goto things https://github.com/BurntSushi/xsv

comment by IanCal · 2019-09-01 · in TSV Utilities: Command line tools for large, tabular data files

…https://github.com/BatchLabs/charlatan https://github.com/dinedal/textql https://github.com/BurntSushi/xsv https://github.com/dbohdan/sqawk https://stedolan.github.io/jq/ https://github.com/benbernard/RecordStream

comment by dima55 · 2019-08-31 · in TSV Utilities: Command line tools for large, tabular data files

…is notable because it's written in D lang by a mega corp. Some useful cli data wrangling tools -- https://github.com/BurntSushi/xsv https://github.com/dinedal/textql https://github.com/n3mo/data-science https://stedolan.github.io/jq/…

comment by JimmyRuska · 2019-08-31 · in TSV Utilities: Command line tools for large, tabular data files

Anything by burntsushi, but especially xsv and ripgrep: xsv: https://github.com/BurntSushi/xsv ripgrep: https://github.com/BurntSushi/ripgrep His code typically has extensive tests, helpful comments, and logical structure. It was fun…

comment by ekidd · 2019-07-29 · in Ask HN: What are the “best” codebases that you've encountered?

https://github.com/BurntSushi/xsv is all you need here, not a mess of sort commands. xsv join enrollments.csv courses.csv | xsv table Uses an index as well.

comment by orf · 2019-06-16 · in There's a Relational Database in Your Unix CLI

…or persisted to disk, a great tool for analyzing datasets up to the low 10s of gigs. 2. XSV, https://github.com/BurntSushi/xsv

comment by sitkack · 2019-06-15 · in Ask HN: What can I do to accelerate scientific research?

…- https://csvkit.readthedocs.io/ - https://github.com/johnkerl/miller - https://github.com/BurntSushi/xsv - https://github.com/eBay/tsv-utils-dlang - https://stedolan.github.io/jq/ - http://harelba.github.io/q/ - https://github.co

comment by dima55 · 2019-05-20 · in Show HN: UXY – adding structure to Unix tools

I know this is not a "official" unix tool, but for join/comm specifically for CSV I love this tool: https://github.com/BurntSushi/xsv/releases/tag/0.13.0 xsv help: https://i.imgur.com/yS8cen7.png

comment by lerax · 2019-03-07 · in Seven Unix Commands Every Data Scientist Should Know

…it's already been processed, it just needs to be clearer to understand than raw CSV/JSON/XML: https://github.com/BurntSushi/xsv (link has examples of pretty-printed CSV)

comment by lsh · 2018-12-19 · in Comma-Separated Tree

…inspired by @burntsushi's rg, you might be interested in xsv for CSV viewing (and manipulation): https://github.com/BurntSushi/xsv

comment by ComputerGuru · 2018-11-20 · in Ask HN: Best Command-Line Applications?

And to round out the set, xsv ( https://github.com/BurntSushi/xsv/ ) is a powerful toolkit for CSV.

comment by CJKerr · 2018-11-19 · in Ask HN: Best Command-Line Applications?

…in a cli. This tool makes use of SQL syntax much more than xsv, so there isn't 100% overlap here. https://github.com/BurntSushi/xsv

comment by cbcoutinho · 2018-11-14 · in Q: Run SQL Directly on CSV Files

…of ripgrep) to a coding duel, bragging that I could get LuaJIT to match his XSV performance ( https://github.com/BurntSushi/xsv ) It took hours to figure out how to implement this in rust: https://github.com/sctb/lumen/blob/master/bin/lumen…

comment by shawn · 2018-09-10 · in Why Rust closures are somewhat hard

…would have failed with the same errors. If you like, you can download static binaries from github: https://github.com/BurntSushi/xsv/releases

comment by burntsushi · 2018-09-09 · in XSV: A fast CSV command-line toolkit written in Rust

rust-csv compiled and ran flawlessly. xsv had an error: https://github.com/BurntSushi/xsv/issues/139 Also loved this: // OMG I HATE BYTE STRING LITERALS SO MUCH. fn b(s: &str) -> &[u8] { s.as_bytes() } EDIT: Aha, it was user error. Brew…

comment by shawn · 2018-09-09 · in XSV: A fast CSV command-line toolkit written in Rust

…isn't the full story. [1] - https://github.com/BurntSushi/rust-csv/blob/546291a0095a2537... [2] - https://github.com/BurntSushi/xsv/blob/9574d89634031259802dd...

comment by burntsushi · 2018-09-09 · in XSV: A fast CSV command-line toolkit written in Rust

▲ 609

XSV: A fast CSV command-line toolkit written in Rust

story by tosh · 2018-09-08 · 188 comments

…the past, but these days I’d say that xsv > csvkit for working with CSV files on the command-line. https://github.com/BurntSushi/xsv

comment by flother · 2018-08-30 · in CLI: Improved

Sounds like xsv might be a nice complement to your toolkit https://github.com/BurntSushi/xsv

comment by nicoburns · 2018-06-16 · in Learn just a little Awk (2010)

https://github.com/BurntSushi/xsv is a must if you do anything with CSV.

comment by silasb · 2018-05-07 · in Ask HN: What are your favorite terminal programs?

…analyzing, splitting and joining CSV files", from Andrew Gallant (burntsushi of Go and Rust fame): https://github.com/BurntSushi/xsv

comment by kibwen · 2018-04-07 · in TextQL: Execute SQL Against CSV or TSV

I've been using https://github.com/BurntSushi/xsv which is quite nice and has a few other very handy csv tools.

comment by bfrog · 2018-01-05 · in Show HN: Command Line Tool to Sort CSV and TSV Files by Multiple Headings in Go

…Thinking of stuff like fd and: ripgrep: https://github.com/BurntSushi/ripgrep (grep/ag alt) xsv: https://github.com/BurntSushi/xsv (csv tool) exa: https://the.exa.website/ (ls) una: https://github.com/jwiegley/una (multi-compression utils…

comment by coldtea · 2017-10-08 · in Show HN: A simple, fast and user-friendly alternative to find, written in Rust

▲ 4

A fast CSV toolkit written in Rust

story by tosh · 2017-09-04 · 0 comments

don't forget to checkout xsv ! its the missing piece between standard unix tools and SQL, I love it. https://github.com/BurntSushi/xsv

comment by chaosfox · 2017-06-10 · in Rust and CSV parsing

…handle different file encodings. Life would be so much simpler if everyone just used UTF-8. [0] https://github.com/BurntSushi/xsv

comment by TheAceOfHearts · 2017-05-31 · in Tad, a tabular data viewer

…-l 100 googlebooks-eng-all-1gram-20120701-0.tsv 5.19s user 0.06s system 351% cpu 1.490 total [1] https://github.com/BurntSushi/xsv

comment by gregwebs · 2017-05-25 · in Faster Command Line Tools in D

…specific data. [1] https://github.com/gelisam/hawk [2] https://stedolan.github.io/jq/manual/ [3] https://github.com/BurntSushi/xsv/blob/master/README.md

comment by gregwebs · 2017-05-01 · in FuncShell – A Haskell-based alternative to awk

I think the GP was asking about xsv, not ripgrep. There are binary releases for xsv though: https://github.com/BurntSushi/xsv/releases

comment by burntsushi · 2016-09-24 · in Ripgrep – A new command line search tool

From the Benchmarks section of the README: https://github.com/BurntSushi/xsv/blob/master/BENCHMARKS.md

comment by doomrobo · 2016-09-23 · in xsv: A fast CSV toolkit written in Rust

▲ 37

xsv: A fast CSV toolkit written in Rust

story by ehudla · 2016-09-22 · 2 comments

Using xsv ( https://github.com/BurntSushi/xsv ): cargo install xsv xsv search -s ZIPCODE <zipcode> -d $'\t' UCMR3_ZipCodes.txt xsv search -s PWSID <pwsid> -d $'\t' UCMR3_All.txt | xsv search -s AnalyticalResultsSign = | xsv select…

comment by twr · 2016-08-11 · in Unsafe levels of toxic chemicals found in drinking water for 6M Americans

xsv for doing queries against CSV files probably belongs to the list too: https://github.com/BurntSushi/xsv

comment by zokier · 2016-05-07 · in A list of command line tools for manipulating structured text data

…command just pulls out the second column from the CSV file, which is also one of my creations: https://github.com/BurntSushi/xsv --- but a simple Python script should do nicely as well). xsv select 2 20*.csv > urls-unsorted And then remove…

comment by burntsushi · 2015-11-12 · in Finite state machines as data structure for representing ordered sets and maps

There's also https://github.com/BurntSushi/xsv which is fairly similar in how it works to Miller, though it can also index a CSV file and then future operation will be sped up by utilizing the index.

comment by lambda · 2015-08-16 · in Miller is like sed, awk, cut, join, and sort for name-indexed data such as CSV

There's also xsv: https://github.com/BurntSushi/xsv

comment by justhjkust · 2015-08-16 · in Miller is like sed, awk, cut, join, and sort for name-indexed data such as CSV