YAML to XLSX pipeline πŸ™ˆ

This was fun, but I don't want to do it again.

curl -s https://raw.githubusercontent.com/AKVorrat/dearmep/refs/heads/main/server/dearmep/example-config.yaml \
| uvx yq '(.l10n.strings + .l10n.frontend_strings) | to_entries | map(select(.value | type == "object")) | map({id: .key} + .value)' \
| uvx --from csvkit in2csv -f json > strings.csv \
&& libreoffice --headless --infilter=CSV:44,34,76,1 --convert-to xlsx strings.csv

#YAML #CSV #XSLX #jq #yq #CSVKit #LibreOffice #CLI #ShellScript #bash

@hamatti I'm also appreciating #csvkit! Its csvstat summarization tool recently helped me solve a problem where I had to find duplicate values in a csv, and it did so very quickly!
Maybe #qsv #xsv or #csvkit are suitable tools for this? Though a solution based on R would be neat...

Wanna query your CSV data with SQL? You don't need to build a database for that.

csvsql is one of the tools in the brilliant csvkit toolbox.

With it, you can query your CSV files with SQL queries directly from your command line.

https://hamatti.org/posts/use-sql-to-query-your-csv-files/

#csv #sql #csvkit #data #query #CommandLine #cli

Use SQL to query your CSV files

You don’t need to store your data in database just to be able to query it with SQL. You can use csvsql instead!

Juha-Matti Santala - Community Builder. Dreamer. Adventurer.
2021-09-25 - Seve | Severino Tessarin

RT @[email protected]

I have the feeling that especially #datascientists who used to work with #python tools are moving to @[email protected].

Current artefact: @[email protected]'s csvzip which was inspired by #csvkit:

https://github.com/PopulateTools/csvzip

πŸ¦πŸ”—: https://twitter.com/alexanderadam__/status/1262357931519066117

PopulateTools/csvzip

A standalone CLI tool to reduce CSVs size by converting categorical columns in a list of unique integers. - PopulateTools/csvzip

RT alexanderadam (@alexanderadam__)
https://twitter.com/alexanderadam__/status/1262357931519066117
I have the feeling that especially #datascientists who used to work with #python tools are moving to @crystalLanguage.

Current artefact: @populate_'s csvzip which was inspired by #csvkit:

https://github.com/PopulateTools/csvzip

alexanderadam on Twitter

β€œI have the feeling that especially #datascientists who used to work with #python tools are moving to @CrystalLanguage. Current artefact: @populate_'s csvzip which was inspired by #csvkit: https://t.co/AIise1U8Zp”

Twitter

RT alexanderadam (@alexanderadam__)
https://twitter.com/alexanderadam__/status/1262357931519066117
I have the feeling that especially #datascientists who used to work with #python tools are moving to @crystalLanguage.

Current artefact: @populate_'s csvzip which was inspired by #csvkit:

https://github.com/PopulateTools/csvzip

alexanderadam on Twitter

β€œI have the feeling that especially #datascientists who used to work with #python tools are moving to @CrystalLanguage. Current artefact: @populate_'s csvzip which was inspired by #csvkit: https://t.co/AIise1U8Zp”

Twitter

#csvkit is a suite of #CSV processing tools.

csvkit is a collection of utilities which modify and translate data in the comma separated values (CSV) format. csvkit includes tools to translate to CSV (including from #SQL, #JSON, spreadsheets), for modifying CSV (cleaning, joining, sorting), and for output/analysis (SQL searching, JSON output, Markdown).

Website πŸ”—οΈ: https://github.com/wireservice/csvkit

apt πŸ“¦οΈ: csvkit

#free #opensource #foss #fossmendations

GitHub - wireservice/csvkit: A suite of utilities for converting to and working with CSV, the king of tabular file formats.

A suite of utilities for converting to and working with CSV, the king of tabular file formats. - wireservice/csvkit

GitHub

I reckon, with the minimum of fuss you can use #csvkit to manage a database setup (even relational) from the command line.

I'm amazed at the power you have with piping a few tools (csvcut,csvjoin,csvgrep) with tailored options to massage, query and output the data in a tabled view (csvlook) in your terminal.

Well impressed.

I was investigating AWK for the same functionality, but this suite of tools seems much easier to jump in with right away.

https://csvkit.readthedocs.io/en/latest/#

#linux #data #csv

csvkit 2.2.0 documentation