THthunderbong·Feb 20, 2024Submission
Vnlog: Process labelled tabular ASCII data using normal Unix tools
2 points · Open discussiondkogan
vnlog
Perl2018–2024
dkogan / vnlog
vnlog
Process labelled tabular ASCII data using normal UNIX tools
6Distinct people
33Mentions
0Explicit recommenders
177GitHub stars
What to know before exploring
What it is
Process labelled tabular ASCII data using normal UNIX tools
GitHub
Where it is used
The source check is incomplete. Verified examples will appear here.
What people are saying
No recommendation phrase was found in the indexed comments.
No classified warning is attached to this page. Read the discussions before treating silence as approval.
Also in these discussions
- batchlabs/charlatan · linked in 3 of the same discussions
- burntsushi/xsv · linked in 3 of the same discussions
- dbohdan/sqawk · linked in 3 of the same discussions
Mentioned in the same Hacker News threads. That is not proof they are substitutes.
This week on Hacker News
Nov 7–Nov 14 UTC · Direct repository links and separately labeled related project stories. Indexed through 11/14/2026, 1:49:46 PM UTC.
No direct repository links were found in the indexed HN discussions over the past seven days. Older discussions are available below.
Mentions over time
HN mentions by year33 dated mentions
Observed mentions: 2018-06-15 23:31:30 UTC to 2024-02-20 02:11:42 UTC.
Counts come from the repository’s dated source evidence. Index cutoff: 2026-11-02 08:16:59 UTC.
View mention counts and date ranges
| Period | Start (UTC) | End (exclusive, UTC) | Mentions | Submissions | Comments |
|---|---|---|---|---|---|
| 2018 | 2018-01-01 00:00:00 UTC | 2019-01-01 00:00:00 UTC | 4 | 2 | 2 |
| 2019 | 2019-01-01 00:00:00 UTC | 2020-01-01 00:00:00 UTC | 5 | 0 | 5 |
| 2020 | 2020-01-01 00:00:00 UTC | 2021-01-01 00:00:00 UTC | 1 | 0 | 1 |
| 2021 | 2021-01-01 00:00:00 UTC | 2022-01-01 00:00:00 UTC | 12 | 2 | 10 |
| 2022 | 2022-01-01 00:00:00 UTC | 2023-01-01 00:00:00 UTC | 1 | 1 | 0 |
| 2023 | 2023-01-01 00:00:00 UTC | 2024-01-01 00:00:00 UTC | 9 | 2 | 7 |
| 2024 | 2024-01-01 00:00:00 UTC | 2025-01-01 00:00:00 UTC | 1 | 1 | 0 |
What Hacker News says
33 sourcesProcess tabular data with Unix tools
4 points · Open discussionFor simple analyses (i.e. what most people do most of the time) doing this on the commandline gets you there faster. I use vnlog (https://github.com/dkogan/vnlog/). By the time you fired up your editor to write your Python code, I already have analyses and plots ready.
In Qsv: Efficient CSV CLI ToolkitAn incomplete list of other similar tools: https://github.com/dkogan/vnlog/#description
In Qsv: Efficient CSV CLI ToolkitAlternative very appropriate for some uses cases: `vnl-join` from the vnlog toolkit (https://github.com/dkogan/vnlog). Uses the `join` tool from coreutils (works well, has been around forever), and `vnlog` for nice column labelling
In Joining CSV Data Without SQL: An IP Geolocation Use CaseLots of tools do this sort of thing. An incomplete list is in the vnlog docs: https://github.com/dkogan/vnlog/#description
In Using command line to process CSV files (2022)There's also https://github.com/dkogan/vnlog/ which is a wrapper around the existing coreutils, so all the options work, and there's nothing to learn
In Miller: Like Awk, sed, cut, join, and sort for CSV, TSV, and tabular JSONIf you want to run joins on text tables, the coreutils have a "join" tool. You already have it installed:
https://www.gnu.org/software/coreutils/manual/html_node/join...
And to improve the ergonomics, the vnlog wrappers are available to operate on field names, while retaining the internals of the core tools:
https://github.com/dkogan/vnlog/
In Awk equivalents to SQL query data manipulationVnlog: Making Awk, grep, sort and join smarter
15 points · Open discussionI sorta, kinda agree. Tools written in AWK (and friends) are indeed somewhat unmaintainable, but they're really close to being just right for a LOT of applications. The vnlog toolkit (https://github.com/dkogan/vnlog) adds just a little bit of syntactic sugar to the usual commandline tools to make processing scripts robust and easy to read and write. This was not my intent initially, but I now do most of my data processing with the shell and vnl-wrapped awk (and sort and join, ...) It's really nice. If you write stuff in awk, you should check it out. (Disclaimer: I'm the author)
In Learn to Process Text in Linux Using Grep, Sed, and AwkExtending Awk with Field Labels
1 points · Open discussionLots of them out there. Here's one that repurposes the extends the standard unix tools to know about comments and column labels: https://github.com/dkogan/vnlog/
In Miller – tool for querying, shaping, reformatting data in CSV, TSV, and JSONVnlog: Manipulate labeled tabular data with standard Unix tools
3 points · Open discussionIf you want to do that, use vnlog instead. You're 90% there already. It formalizes the idea of a header to label columns, and allows normal unix data-processing tools to just work with those labels. Your awk use case is quite literally "vnl-filter --eval"
https://github.com/dkogan/vnlog/
In Understanding AwkVnlog: Manipulate labeled tabular data with standard Unix tools
5 points · Open discussionShowing the 15 most recent of 33 sources. Enable JavaScript to search and browse every indexed mention.