Munquet 0.2.1 just landed on Flathub ๐
Fixed a small race condition when canceling a conversion โ turns out the process could finish right before you clicked โYesโ ๐
Two lines laterโฆ all good.
https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet
#Flatpak #GTK4 #OpenSource #Parquet #DataScience #Linux #Python #PyArrow
Munquet is now officially on Flathub ๐
A native Linux app to convert datasets into Apache Parquet using PyArrow backend. Perfect for data science workflows, analytics, and anyone needing fast local conversions.
Get it here: https://flathub.org/en/apps/io.gitlab.zulfian1732.munquet
@gnome @xfce @kde @GTK @linux @flathub
#apache #pyarrow #datascience #parquet #csv #OpenSource #Python #GNOME #GTK4 #Adwaita
๐ Munquet โ Convert, merge, rename & validate tabular data into Parquet, fully offline & batch-ready.
GitLab: https://gitlab.com/zulfian1732/munquet
Featured in: @severo 's Awesome Parquet: https://github.com/severo/awesome-parquet ๐
๐ Sneak peek Munquet!
Convert, merge, rename, and validate tabular data safely into Parquet. Works offline, with batch processing and progress feedback.
GitLab repo:
https://gitlab.com/zulfian1732/munquet
Flathub release coming soon!
#Python #GTK4 #GNOME #PyArrow #Parquet #DataScience #Libadwaita
Released scrapy-contrib-bigexporter 1.0.0 (https://codeberg.org/ZuInnoTe/scrapy-contrib-bigexporters) - additional export formats for the webscraping framework Scrapy.
Migrated parquet export from fastparquet to pyarrow as fastparquet is deprecated (https://docs.dask.org/en/stable/changelog.html#fastparquet-engine-deprecated)
Migrated orc export from pyorc to pyarrow to reduce the number of dependencies
#scrapy #crawling #python #parquet #orc #pyarrow #webcrawling #scraping
#Python and CLI tools #QuackOSM and #OvertureMaestro offer easier access to data from #OpenStreetMap (#OSM) and the Overture Maps Foundation (#OMF) through #PyArrow, #GeoParquet, or #DuckDB. These tools can simplify large-scale geospatial data tasks for seamless data engineering and analysis.
#Python and CLI tools #QuackOSM and #OvertureMaestro offer easier access to data from #OpenStreetMap (#OSM) and the Overture Maps Foundation (#OMF) through #PyArrow, #GeoParquet, or #DuckDB. These tools can simplify large-scale geospatial data tasks for seamless data engineering and analysis.
#TalkPythonToMe 503: The #PyArrow Revolution
Episode webpage: https://talkpython.fm/episodes/show/503/the-pyarrow-revolution
Media file: https://talkpython.fm/episodes/download/503/the-pyarrow-revolution.mp3
Pandas is at a the core of virtually all data science done in Python, that is virtually all data science. Since it's beginning, Pandas has been based upon numpy. But changes are afoot to update those internals and you can now optionally use PyArrow. PyArrow comes with a ton of benefits including it's columnar format which makes answering analytical questions faster, support for a range of high performance file formats, inter-machine data streaming, faster file IO and more. Reuven Lerner is here to give us the low-down on the PyArrow revolution.
Zulfian
Jรถrn Franke
Kai
Spatialists
Alexandre B A Villares ๐
Nic Crane