Hacker GitHub

← All repos

johnkerl/miller

View on GitHub ↗ ★ 10,055 Go

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

83 mentions on Hacker News by 31 people: 35 stories, 48 comments · first 2015-08-17 · latest 2026-07-04

Mentions per year 83 mentions · busiest year 2021 (14)
20082026
AllStoriesComments NewestTopOldest
  1. …pipeline tools which are also line/row oriented. For CLI tools, I’m also a big fan of Miller ( https://github.com/johnkerl/miller ) to filter/modify CSV and other data sources.
    comment by leonim · 2025-04-01 · in A love letter to the CSV format
  2. I recently came across miller ( https://github.com/johnkerl/miller ). I don't know how these tools compare.
    comment by mike-the-mikado · 2025-03-30 · in XAN: A Modern CSV-Centric Data Manipulation Toolkit for the Terminal
  3. Not exactly what you're looking for, but you'd probably like looking at miller / mlr. https://github.com/johnkerl/miller
    comment by dmd · 2024-12-19 · in Half My Life with Perl
  4. related: https://github.com/johnkerl/miller I am wondering who really uses these tools and for what since there are R and python data science tools available?
    comment by foehrenwald · 2023-12-23 · in Qsv: Efficient CSV CLI Toolkit
  5. One of my coworkers really likes Miller: https://github.com/johnkerl/miller The idea is that you get awk/grep like commands for operating on structured data.
    comment by jrockway · 2023-11-29 · in Jaq – A jq clone focused on correctness, speed, and simplicity
  6. …Miller is like awk, sed, cut, join, and sort for data formats such as CSV, TSV, JSON, JSON https://github.com/johnkerl/miller
    comment by defrost · 2023-09-24 · in Modern Linux Tools vs. Unix Classics: Which Would I Choose?
  7. jq and miller[1] are essential parts of my toolbelt, right up there with awk and vim. [1]: https://github.com/johnkerl/miller
    comment by paradox460 · 2023-09-07 · in jq 1.7
  8. …[2] when I want to do queries. These are useful for working with data in simple shell scripts. [1] https://github.com/johnkerl/miller [2] https://github.com/simonw/sqlite-utils
    comment by leonim · 2023-06-28 · in Using command line to process CSV files (2022)
  9. …https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller
    comment by lot3oo · 2023-03-25 · in icsp – Command-line iCalendar (.ics) to CSV parser
  10. I submitted a ticket: https://github.com/johnkerl/miller/issues/1235
    comment by avodonosov · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  11. And https://github.com/johnkerl/miller/pull/1131
    comment by john_kerl · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  12. See also https://github.com/johnkerl/miller/issues/1119
    comment by john_kerl · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  13. …retention of memory, taking more memory than one would have expected. Some gains were made on https://github.com/johnkerl/miller/pull/1133 and https://github.com/johnkerl/miller/pull/1132
    comment by john_kerl · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  14. …https://github.com/kellyjonbrazil/jc https://github.com/TomWright/dasel https://github.com/johnkerl/miller https://stedolan.github.io/jq https://github.com/harelba/q ...
    comment by guilhas · 2023-03-13 · in Nushell.sh ls | where size > 10mb | sort-by modified
  15. …data cleanup options. Works on streams so (most operations) are not limited by memory. [0]: https://github.com/johnkerl/miller
    comment by db65edfc7996 · 2022-05-12 · in Modernizing AWK, a 45-year old language, by adding CSV support
  16. …one Unix tool that should have - and, more to the point, COULD have - been written long ago is mlr. https://github.com/johnkerl/miller "Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON."…
    comment by dmd · 2022-04-16 · in Moreutils: A collection of Unix tools that nobody thought to write long ago
  17. …document explaining the rationale behind the porting that answered all my questions and a lot more: https://github.com/johnkerl/miller/blob/main/README-go-port.... . Thought other miller/mlr fans (that don't follow its development) might…
    comment by ratrocket · 2022-03-08 · in Select, put and delete data from JSON, TOML, YAML, XML and CSV files
  18. Reminds me of https://github.com/johnkerl/miller which is also a go based tool cloning features from tools like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
    comment by barakplasma · 2022-03-08 · in Select, put and delete data from JSON, TOML, YAML, XML and CSV files
  19. Miller Csv can process json in record format and has a much saner DSL in my experience. https://github.com/johnkerl/miller
    comment by awild · 2021-12-23 · in Fq: Jq for Binary Formats
  20. …is now a snap. Now `mlr.exe` takes it rightful place alongside the Linux and Mac executables ( https://github.com/johnkerl/miller/releases/tag/v6.0.0-beta ). Go+Windows is heavenly & I'll never need to tweak MSYS2/Appveyor/DLLs/etc again.…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  21. …and left analysis/optimization (even low-hanging fruit like output-buffering) until the very end -- https://github.com/johnkerl/miller/pull/786 for example merged just a couple days ago.
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  22. …some real low-hanging fruit) until last. The 10x number was indeed the case pre-optimization ... on https://github.com/johnkerl/miller/pull/786 you can see tabulated results where Miller 6 is now on par with Miller 5, and in some cases is…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  23. The 10x number was before improvements on https://github.com/johnkerl/miller/pull/786 et al. The earlier negative perf results were my fault, not Go's -- I was focusing initially on the port and feature development, leaving benchmarking…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  24. Indeed -- that was before final optimization work on https://github.com/johnkerl/miller/pull/786 et al., thanks to which Miller 6 performance is now on par with Miller 5 for simple processing, and far better than Miller 5 for complex…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  25. …released. Hopefully in a month or so. The most important release blocker (now resolved) is https://github.com/johnkerl/miller/pull/786 et al., thanks to which Miller 6 performance is now on par with Miller 5 for simple processing, and far…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  26. …The README talks a bit more the performance comparison and the C version's strength, but still. [1] https://github.com/johnkerl/miller/tree/main/c [2] https://github.com/johnkerl/miller/tree/main/go
    comment by flakiness · 2021-08-25 · in Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSON
  27. If you work with JSON and CSV data regularly, I'd also recommend checking out Miller: https://github.com/johnkerl/miller From the project's description: Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV,…
    comment by jabo · 2021-08-25 · in An Introduction to JQ
  28. …heard about a tool called Miller that helps convert between JSON and CSV among other formats: https://github.com/johnkerl/miller mlr --c2j cat documents.csv > documents.jsonl Converts a CSV file to a JSONL file
    comment by jabo · 2021-06-03 · in Show HN: Transform a CSV into a JSON and vice versa
  29. …for working with structured data, but I haven't used them. - https://github.com/saulpw/visidata - https://github.com/johnkerl/miller - https://github.com/nushell/nushell
    comment by leonim · 2021-03-12 · in What tools in your day to day give the largest productivity boost?
  30. I'll add to that list: https://github.com/johnkerl/miller Also, I like using VisiData already mentioned.
    comment by leonim · 2021-03-09 · in Ask HN: What was that texted based CSV data analysis tool?
  31. …"like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON" [0]: https://github.com/johnkerl/miller
    comment by luckman212 · 2021-01-17 · in Show HN: Simplql - Query csv, xls and json files with SQL
  32. …on Unix. Csv is a beast. My tools of choice ultimately was miller, an absolutely underrated tool: https://github.com/johnkerl/miller
    comment by jhoechtl · 2020-10-18 · in How to Clean Text Data at the Command Line
  33. …https://www.gnu.org/software/datamash/ https://csvkit.readthedocs.io/ https://github.com/johnkerl/miller https://github.com/eBay/tsv-utils-dlang http://harelba.github.io/q/ https://github.com/BatchLabs/charlatan https://github.c
    comment by dima55 · 2019-11-23 · in An introduction to data processing on the Linux command line
  34. Miller https://github.com/johnkerl/miller I'd normally pass but this is written in D so I'm looking forward to try it out.
    comment by petre · 2019-09-02 · in TSV Utilities: Command line tools for large, tabular data files
  35. https://github.com/johnkerl/miller Miller (mlr) is now my goto tool for csv/tsv manipulation. I've used it from time to time during the past year and it's been a joy to use. I must admit that I did not try any other tool for the purpose so…
    comment by mooss · 2019-09-01 · in TSV Utilities: Command line tools for large, tabular data files
  36. …a MAJOR usability improvement. Other tools in no particular order: https://csvkit.readthedocs.io/ https://github.com/johnkerl/miller https://github.com/eBay/tsv-utils-dlang http://harelba.github.io/q/ https://github.com/BatchLabs/charlatan…
    comment by dima55 · 2019-08-31 · in TSV Utilities: Command line tools for large, tabular data files
  37. …variable envisioned use cases: - https://github.com/dkogan/vnlog - https://csvkit.readthedocs.io/ - https://github.com/johnkerl/miller - https://github.com/BurntSushi/xsv - https://github.com/eBay/tsv-utils-dlang -…
    comment by dima55 · 2019-05-20 · in Show HN: UXY – adding structure to Unix tools
  38. …- jq for JSON manipulation: https://stedolan.github.io/jq/ - Miller for CSV/TSV: https://github.com/johnkerl/miller I would imagine you have already scoured the "awesome" lists: https://github.com/agarrharr/awesome-cli-apps#terminal-utili.
    comment by artwr · 2018-11-19 · in Ask HN: Best Command-Line Applications?
  39. There is miller. But it's a CLI tool, not s library. Maybe it comes bundled with a library? https://github.com/johnkerl/miller
    comment by petre · 2018-09-09 · in XSV: A fast CSV command-line toolkit written in Rust
  40. Or Miller: https://github.com/johnkerl/miller
    comment by shabbyrobe · 2018-05-04 · in We’re happy with SQLite and not urgently interested in a fancier DBMS (2016)
  41. An indispensable tool for the command line is miller https://github.com/johnkerl/miller
    comment by jhoechtl · 2018-01-27 · in Data Science at the Command Line
  42. Linkfix https://github.com/johnkerl/miller/releases/tag/v5.3.0
    comment by john_kerl · 2018-01-07 · in Miller 5.3.0 – data comments, documentation improvements, and bug fixes
  43. …is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON. https://github.com/johnkerl/miller#readme
    comment by mdaniel · 2018-01-05 · in Show HN: Command Line Tool to Sort CSV and TSV Files by Multiple Headings in Go
  44. regarding binaries -- at https://github.com/johnkerl/miller/releases/tag/v5.0.0 there are now macosx, linux i686 static, and linux x86_64 static binaries
    comment by john_kerl · 2017-03-01 · in Miller v5.0.0: Autodetected line-endings, in-place mode, user-defined functions
  45. docs updated at http://johnkerl.org/miller-releases/miller-5.0.0/doc/build.h... and, https://github.com/johnkerl/miller/issues/131
    comment by john_kerl · 2017-03-01 · in Miller v5.0.0: Autodetected line-endings, in-place mode, user-defined functions
  46. …and sort for name-indexed data such as CSV, TSV, and tabular JSON http://johnkerl.org/miller/doc https://github.com/johnkerl/miller
    comment by IanCal · 2017-02-28 · in Miller v5.0.0: Autodetected line-endings, in-place mode, user-defined functions
  47. https://github.com/johnkerl/miller/releases/tag/v2.0.0
    comment by john_kerl · 2015-08-30 · in Miller is like sed, awk, cut, join, and sort for name-indexed data such as CSV
  48. Several feedbacks incorporated at https://github.com/johnkerl/miller/commit/a1d117d3b299bbf273... https://github.com/johnkerl/miller/commit/7aead02c71a76fb281... Also there is one issue closed (thanks epilanthanomai!) and two open.…
    comment by john_kerl · 2015-08-17 · in Miller is like sed, awk, cut, join, and sort for name-indexed data such as CSV