Hacker GitHub

← All repos

johnkerl/miller

View on GitHub ↗ ★ 10,055 Go

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

83 mentions on Hacker News by 31 people: 35 stories, 48 comments · first 2015-08-17 · latest 2026-07-04

Mentions per year 83 mentions · busiest year 2021 (14)
20082026
AllStoriesComments NewestTopOldest
  1. ▲ 4
    Miller 6.20.2: Miller and AI, bash/zsh tab-completion, bytes datatype
    story by john_kerl · 2026-07-04 · 1 comment
  2. ▲ 1
    Miller 6.17.0: YAML and DCF file formats; performance improvements; bugfixes
    story by john_kerl · 2026-02-21 · 0 comments
  3. …pipeline tools which are also line/row oriented. For CLI tools, I’m also a big fan of Miller ( https://github.com/johnkerl/miller ) to filter/modify CSV and other data sources.
    comment by leonim · 2025-04-01 · in A love letter to the CSV format
  4. I recently came across miller ( https://github.com/johnkerl/miller ). I don't know how these tools compare.
    comment by mike-the-mikado · 2025-03-30 · in XAN: A Modern CSV-Centric Data Manipulation Toolkit for the Terminal
  5. Not exactly what you're looking for, but you'd probably like looking at miller / mlr. https://github.com/johnkerl/miller
    comment by dmd · 2024-12-19 · in Half My Life with Perl
  6. related: https://github.com/johnkerl/miller I am wondering who really uses these tools and for what since there are R and python data science tools available?
    comment by foehrenwald · 2023-12-23 · in Qsv: Efficient CSV CLI Toolkit
  7. One of my coworkers really likes Miller: https://github.com/johnkerl/miller The idea is that you get awk/grep like commands for operating on structured data.
    comment by jrockway · 2023-11-29 · in Jaq – A jq clone focused on correctness, speed, and simplicity
  8. …Miller is like awk, sed, cut, join, and sort for data formats such as CSV, TSV, JSON, JSON https://github.com/johnkerl/miller
    comment by defrost · 2023-09-24 · in Modern Linux Tools vs. Unix Classics: Which Would I Choose?
  9. jq and miller[1] are essential parts of my toolbelt, right up there with awk and vim. [1]: https://github.com/johnkerl/miller
    comment by paradox460 · 2023-09-07 · in jq 1.7
  10. …[2] when I want to do queries. These are useful for working with data in simple shell scripts. [1] https://github.com/johnkerl/miller [2] https://github.com/simonw/sqlite-utils
    comment by leonim · 2023-06-28 · in Using command line to process CSV files (2022)
  11. …https://github.com/BurntSushi/xsv https://github.com/wireservice/csvkit https://github.com/johnkerl/miller
    comment by lot3oo · 2023-03-25 · in icsp – Command-line iCalendar (.ics) to CSV parser
  12. I submitted a ticket: https://github.com/johnkerl/miller/issues/1235
    comment by avodonosov · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  13. And https://github.com/johnkerl/miller/pull/1131
    comment by john_kerl · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  14. See also https://github.com/johnkerl/miller/issues/1119
    comment by john_kerl · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  15. …retention of memory, taking more memory than one would have expected. Some gains were made on https://github.com/johnkerl/miller/pull/1133 and https://github.com/johnkerl/miller/pull/1132
    comment by john_kerl · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
  16. ▲ 318
    Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON
    story by ingve · 2023-03-16 · 104 comments
  17. …https://github.com/kellyjonbrazil/jc https://github.com/TomWright/dasel https://github.com/johnkerl/miller https://stedolan.github.io/jq https://github.com/harelba/q ...
    comment by guilhas · 2023-03-13 · in Nushell.sh ls | where size > 10mb | sort-by modified
  18. ▲ 470
    Ask HN: Programs that saved you 100 hours? (2022 edition)
    story by zJayv · 2022-12-20 · 559 comments
  19. …data cleanup options. Works on streams so (most operations) are not limited by memory. [0]: https://github.com/johnkerl/miller
    comment by db65edfc7996 · 2022-05-12 · in Modernizing AWK, a 45-year old language, by adding CSV support
  20. …one Unix tool that should have - and, more to the point, COULD have - been written long ago is mlr. https://github.com/johnkerl/miller "Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON."…
    comment by dmd · 2022-04-16 · in Moreutils: A collection of Unix tools that nobody thought to write long ago
  21. …document explaining the rationale behind the porting that answered all my questions and a lot more: https://github.com/johnkerl/miller/blob/main/README-go-port.... . Thought other miller/mlr fans (that don't follow its development) might…
    comment by ratrocket · 2022-03-08 · in Select, put and delete data from JSON, TOML, YAML, XML and CSV files
  22. Reminds me of https://github.com/johnkerl/miller which is also a go based tool cloning features from tools like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
    comment by barakplasma · 2022-03-08 · in Select, put and delete data from JSON, TOML, YAML, XML and CSV files
  23. Miller Csv can process json in record format and has a much saner DSL in my experience. https://github.com/johnkerl/miller
    comment by awild · 2021-12-23 · in Fq: Jq for Binary Formats
  24. …is now a snap. Now `mlr.exe` takes it rightful place alongside the Linux and Mac executables ( https://github.com/johnkerl/miller/releases/tag/v6.0.0-beta ). Go+Windows is heavenly & I'll never need to tweak MSYS2/Appveyor/DLLs/etc again.…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  25. …and left analysis/optimization (even low-hanging fruit like output-buffering) until the very end -- https://github.com/johnkerl/miller/pull/786 for example merged just a couple days ago.
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  26. …some real low-hanging fruit) until last. The 10x number was indeed the case pre-optimization ... on https://github.com/johnkerl/miller/pull/786 you can see tabulated results where Miller 6 is now on par with Miller 5, and in some cases is…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  27. The 10x number was before improvements on https://github.com/johnkerl/miller/pull/786 et al. The earlier negative perf results were my fault, not Go's -- I was focusing initially on the port and feature development, leaving benchmarking…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  28. Indeed -- that was before final optimization work on https://github.com/johnkerl/miller/pull/786 et al., thanks to which Miller 6 performance is now on par with Miller 5 for simple processing, and far better than Miller 5 for complex…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  29. …released. Hopefully in a month or so. The most important release blocker (now resolved) is https://github.com/johnkerl/miller/pull/786 et al., thanks to which Miller 6 performance is now on par with Miller 5 for simple processing, and far…
    comment by john_kerl · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON
  30. …The README talks a bit more the performance comparison and the C version's strength, but still. [1] https://github.com/johnkerl/miller/tree/main/c [2] https://github.com/johnkerl/miller/tree/main/go
    comment by flakiness · 2021-08-25 · in Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSON
  31. If you work with JSON and CSV data regularly, I'd also recommend checking out Miller: https://github.com/johnkerl/miller From the project's description: Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV,…
    comment by jabo · 2021-08-25 · in An Introduction to JQ
  32. ▲ 273
    Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSON
    story by jabo · 2021-08-25 · 66 comments
  33. …heard about a tool called Miller that helps convert between JSON and CSV among other formats: https://github.com/johnkerl/miller mlr --c2j cat documents.csv > documents.jsonl Converts a CSV file to a JSONL file
    comment by jabo · 2021-06-03 · in Show HN: Transform a CSV into a JSON and vice versa
  34. …for working with structured data, but I haven't used them. - https://github.com/saulpw/visidata - https://github.com/johnkerl/miller - https://github.com/nushell/nushell
    comment by leonim · 2021-03-12 · in What tools in your day to day give the largest productivity boost?
  35. I'll add to that list: https://github.com/johnkerl/miller Also, I like using VisiData already mentioned.
    comment by leonim · 2021-03-09 · in Ask HN: What was that texted based CSV data analysis tool?
  36. …"like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON" [0]: https://github.com/johnkerl/miller
    comment by luckman212 · 2021-01-17 · in Show HN: Simplql - Query csv, xls and json files with SQL
  37. ▲ 2
    Miller 5.10.0: sort-within-records, unsparsify -f, misc updates; Go-port beta
    story by john_kerl · 2020-11-29 · 0 comments
  38. …on Unix. Csv is a beast. My tools of choice ultimately was miller, an absolutely underrated tool: https://github.com/johnkerl/miller
    comment by jhoechtl · 2020-10-18 · in How to Clean Text Data at the Command Line
  39. ▲ 1
    Miller 5.9.1: Security update: disallow –prepipe in .mlrrc
    story by john_kerl · 2020-09-03 · 0 comments
  40. ▲ 1
    Miller 5.9.0: .mlrrc, and fix Windows build
    story by john_kerl · 2020-08-19 · 0 comments
  41. ▲ 1
    Miller 5.8.0: Better environment-variable support, new 'count' verb, bugfixes
    story by john_kerl · 2020-08-04 · 0 comments
  42. ▲ 1
    Miller 5.7.0 – ports, bugfixes, and keystroke-savers
    story by john_kerl · 2020-03-17 · 0 comments
  43. …https://www.gnu.org/software/datamash/ https://csvkit.readthedocs.io/ https://github.com/johnkerl/miller https://github.com/eBay/tsv-utils-dlang http://harelba.github.io/q/ https://github.com/BatchLabs/charlatan https://github.c
    comment by dima55 · 2019-11-23 · in An introduction to data processing on the Linux command line
  44. ▲ 1
    Miller 5.6.1: mobile-friendly docs at HTTP://johnkerl.org/miller/doc
    story by john_kerl · 2019-09-17 · 0 comments
  45. ▲ 1
    Miller 5.6.0: System calls / external commands, ASV/USV, bulk numeric formatting
    story by john_kerl · 2019-09-13 · 0 comments
  46. Miller https://github.com/johnkerl/miller I'd normally pass but this is written in D so I'm looking forward to try it out.
    comment by petre · 2019-09-02 · in TSV Utilities: Command line tools for large, tabular data files
  47. https://github.com/johnkerl/miller Miller (mlr) is now my goto tool for csv/tsv manipulation. I've used it from time to time during the past year and it's been a joy to use. I must admit that I did not try any other tool for the purpose so…
    comment by mooss · 2019-09-01 · in TSV Utilities: Command line tools for large, tabular data files
  48. ▲ 2
    Miller 5.5.0: Positional indexing and other data-cleaning features
    story by john_kerl · 2019-09-01 · 0 comments
  49. …a MAJOR usability improvement. Other tools in no particular order: https://csvkit.readthedocs.io/ https://github.com/johnkerl/miller https://github.com/eBay/tsv-utils-dlang http://harelba.github.io/q/ https://github.com/BatchLabs/charlatan…
    comment by dima55 · 2019-08-31 · in TSV Utilities: Command line tools for large, tabular data files
  50. …variable envisioned use cases: - https://github.com/dkogan/vnlog - https://csvkit.readthedocs.io/ - https://github.com/johnkerl/miller - https://github.com/BurntSushi/xsv - https://github.com/eBay/tsv-utils-dlang -…
    comment by dima55 · 2019-05-20 · in Show HN: UXY – adding structure to Unix tools