xan

I've been using https://github.com/medialab/xan for anything csv. It's the best tool there is for reading and analyzing csv files, but not for writing them. Something like cell-sheet-tui would fit my workflow very well, since I am using neovim to edit csv files manually (as well as some csv merging features offered by xan to simplify the process). The reason why I find your software promising is because dealing with csv in plain text is very disorienting with the inconsistent horizontal cell space. A csv-aware text editor would help a lot there with two issues in particular: - not having to set commas manually, especially not having to count them between empty cells - being able to navigate using h/j/k/l between cells instead of having to get creative with vim-motions on plain text OP, if you're reading this: I would greatly appreciate if

TL;DR: Seeker struct from simd-csv Rust crate knows how to perform approximate random access in a CSV file [1] The `xan` command line tool is therefore able to use it to perform single-pass map-reduce parallelization over CSV files and also binary search within sorted CSV data! [2] [1]: https://docs.rs/simd-csv/latest/simd_csv/struct.Seeker.html [2]: https://github.com/medialab/xan/

xan, the CSV magician https://github.com/medialab/xan

Certainly I love CSV, too and agree with most of the reasons put forth in the blog post But I tried the group's "CSV magician" program and was not impressed https://github.com/medialab/xan The table output seems very similar to sqlite3 It's a 20MB musl dynamically-linked executable (cf. 1.7MB statically-linked sqlite3 executable) Most of the "suite" of subcommands seemed to be aimed at accomplishing the same stuff I can do with sqlite3, and, if necessary, flex There seemed no obvious way too disable color The last straw was it messed up the console First freezing it and the pid was not visible with ps so I had to kill the shell Then leaving me with no up/down or tab action Yes I can fix this but I should not have to I really want to keep an open mind and to believe in these rust console programs But every time I try one it is a huge execu

Previously: A love letter to the CSV format (https://github.com/medialab/xan/blob/master/docs/LOVE_LETTER...) 708 points | 5 months ago | 698 comments (https://news.ycombinator.com/item?id=43484382)

https://news.ycombinator.com/item?id=43494894 discusses xan https://github.com/medialab/xan readme says this tool is originally a fork of BurntSushi's xsv, but has been nearly entirely rewritten at that point, to fit SciencesPo's médialab use-cases, rooted in web data collection and analysis geared towards social sciences (you might think CSV is outdated by now, but read our love letter to the format before judging too quickly). xan therefore goes beyond typical data manipulation and expose utilities related to lexicometry, graph theory and even scraping.

The post does mention it, as a positive: https://github.com/medialab/xan/blob/master/docs/LOVE_LETTER...

A good way to parallelize CSV processing is to split datasets into multiple files, kinda like manual sharding. xan has a parallel command able to perform a wide variety of map-reduce tasks on splitted files. https://github.com/medialab/xan

I would add xan to this list: https://github.com/medialab/xan But of course, I am partial ;)