dkogan/vnlog on Hacker News

…most people do most of the time) doing this on the commandline gets you there faster. I use vnlog ( https://github.com/dkogan/vnlog/ ). By the time you fired up your editor to write your Python code, I already have analyses and plots ready.

comment by dima55 · 2023-12-23 · in Qsv: Efficient CSV CLI Toolkit

An incomplete list of other similar tools: https://github.com/dkogan/vnlog/#description

comment by dima55 · 2023-12-23 · in Qsv: Efficient CSV CLI Toolkit

Alternative very appropriate for some uses cases: `vnl-join` from the vnlog toolkit ( https://github.com/dkogan/vnlog ). Uses the `join` tool from coreutils (works well, has been around forever), and `vnlog` for nice column labelling

comment by dima55 · 2023-10-19 · in Joining CSV Data Without SQL: An IP Geolocation Use Case

Lots of tools do this sort of thing. An incomplete list is in the vnlog docs: https://github.com/dkogan/vnlog/#description

comment by dima55 · 2023-06-28 · in Using command line to process CSV files (2022)

There's also https://github.com/dkogan/vnlog/ which is a wrapper around the existing coreutils, so all the options work, and there's nothing to learn

comment by dima55 · 2023-03-16 · in Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSON

…wrappers are available to operate on field names, while retaining the internals of the core tools: https://github.com/dkogan/vnlog/

comment by dima55 · 2023-01-15 · in Awk equivalents to SQL query data manipulation

…but they're really close to being just right for a LOT of applications. The vnlog toolkit ( https://github.com/dkogan/vnlog ) adds just a little bit of syntactic sugar to the usual commandline tools to make processing scripts robust and…

comment by dima55 · 2023-01-06 · in Learn to Process Text in Linux Using Grep, Sed, and Awk

…one that repurposes the extends the standard unix tools to know about comments and column labels: https://github.com/dkogan/vnlog/

comment by dima55 · 2021-12-22 · in Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSON

…tools to just work with those labels. Your awk use case is quite literally "vnl-filter --eval" https://github.com/dkogan/vnlog/

comment by dima55 · 2021-09-30 · in Understanding Awk

Similar, but using the ACTUAL awk, sed, join, sort tools you already have and know about: https://github.com/dkogan/vnlog/

comment by dima55 · 2021-08-25 · in Miller CLI – Like Awk, sed, cut, join, and sort for CSV, TSV and JSON

vnlog: https://github.com/dkogan/vnlog/ Magic comment with field labels is required, and you can then use the usual unix tools for processing. It's magical.

comment by dima55 · 2021-08-20 · in A straightforward way to extend CSV with metadata

I use https://github.com/dkogan/vnlog/ and feedgnuplot for $WORK and it strikes a wonderful balance of simplicity and effectiveness for both quick data exploration and shell scripted data analysis and report generation. What took me a bit…

comment by vietjtnguyen · 2021-07-18 · in Feedgnuplot – plotting standard input in the shell

If you're massaging and plotting tabular text data, take a look at vnlog too: https://github.com/dkogan/vnlog/ Works wonderfully in the shell, in conjunction with feedgnuplot for plotting.

comment by dima55 · 2021-07-18 · in Feedgnuplot – plotting standard input in the shell

And yet another set of tools is vnlog ( https://github.com/dkogan/vnlog ). It assumes you have whitespace-separated data, with a legend comment, then you can do the above thing with < data.vnl vnl-filter -p thiscolumn,thatcolumn…

comment by dima55 · 2021-06-07 · in Q – Run SQL Directly on CSV or TSV Files

…tools to filter, and then plotting using feedgnuplot have covered most of my visualization needs. https://github.com/dkogan/vnlog https://github.com/dkogan/feedgnuplot

comment by vietjtnguyen · 2021-03-05 · in Ask HN: What data visualization tools do you use?

…variable your file location) The text file is structured with space-delimited text, like this: https://github.com/dkogan/vnlog My current structure for tracking a contribution to an OKR item (e.g. "meditate") by date (e.g., 2020-01-15) and…

comment by jvanderbot · 2021-01-02 · in Setting up personal OKR (objectives and key-results)

…a quarterly basis. I had simple markdown files at first, then vnl-log files, and now R notebooks ( https://github.com/dkogan/vnlog ) to read / plot. It may seem like overhead, and there's some snark in this thread about how it's project /…

comment by jvanderbot · 2021-01-02 · in Setting up personal OKR (objectives and key-results)

Not the parent, but this is what the vnl-filter tool in the vnlog toolkit does: https://github.com/dkogan/vnlog It is indeed mind-blowingly useful in countless contexts. Disclaimer: I'm the author

comment by dima55 · 2020-05-20 · in The State of the AWK

…with other tools to provide filtering and manipulation. For instance (the first one is mine): https://github.com/dkogan/vnlog https://www.gnu.org/software/datamash/ https://csvkit.readthedocs.io/ https://github.com/johnkerl/miller…

comment by dima55 · 2019-11-23 · in An introduction to data processing on the Linux command line

…munge data on the command line and/or plot it. For instance: https://github.com/dkogan/feedgnuplot/ https://github.com/dkogan/vnlog/

comment by dima55 · 2019-10-07 · in R is a joy if you treat it like Awk

…that are similar in a very general way, but have widely different design choices. My tookit is https://github.com/dkogan/vnlog It's tsv-utils-like, but is strictly a wrapper around existing tools. So filtering and transformations are…

comment by dima55 · 2019-08-31 · in TSV Utilities: Command line tools for large, tabular data files

There're already numerous ways to do this without rewriting the world. For instance https://github.com/dkogan/vnlog#powershell-style-filtering-o...

comment by dima55 · 2019-08-25 · in Introducing nushell

…tools that make slightly different design choices and that have variable envisioned use cases: - https://github.com/dkogan/vnlog - https://csvkit.readthedocs.io/ - https://github.com/johnkerl/miller - https://github.com/BurntSushi/xsv -…

comment by dima55 · 2019-05-20 · in Show HN: UXY – adding structure to Unix tools

There's also this: https://github.com/dkogan/vnlog This is effectively a set of wrappers around awk, sort, join, etc that knows about field names, and lets you use the vanilla shell tools in a much nicer way. It's exactly what you want for…

comment by dima55 · 2018-11-15 · in Q: Run SQL Directly on CSV Files

Google doesn't know about qawk. A more general toolkit that does the same thing and (presumably) more: http://github.com/dkogan/vnlog

comment by dima55 · 2018-06-15 · in Learn just a little Awk (2010)