🚀 New Blosc blog post: one selective query, 24.3M taxi trips, five tools.

⚡ Cold cache: CTable/.b2z beats DuckDB by ~1.9x (and pandas by 9.4x)
🎯 Block-level indexes prune ~90% of the data — never read, never decompressed
🤝 Warm cache: dead heat with DuckDB
💾 All for just a 2% storage premium over Parquet
🐍 Results are NumPy arrays, no conversion tax

Fully reproducible benchmark inside:
https://blosc.org/posts/ctable-b2z-queries/

#Python #DuckDB #Parquet #OpenSource

#duckdb ist eines der elegantesten Stücke Software-Design der letzten Jahre. In-Process, kein zusätzlicher Server, sehr performant. Die Analyse läuft dort, wo dein Code läuft: #python #go #java #Node #rust oder direkt im #cli.

Das Elegante daran ist die Vektorisierung. Wer große Datenmengen lokal analysieren will, sollte sich DuckDB unbedingt mal anschauen.

https://duckdb.org/

#db #dev

An in-process SQL OLAP database management system

DuckDB is an in-process SQL OLAP database management system. Simple, feature-rich, fast & open source.

DuckDB

DuckDB Storage Engine for MariaDB. When the Sea Lion Learns to Quack.

https://mariadb.org/duckdb-storage-engine-for-mariadb-when-the-sea-lion-learns-to-quack/

#mariadb #duckdb

DuckDB Storage Engine for MariaDB. When the Sea Lion Learns to Quack. - MariaDB.org

An early look at the DuckDB storage engine for MariaDB — columnar, vectorized analytics that live right next to your transactional tables. The problem MariaDB’s InnoDB is excellent at what it was built for: transactions. … Continue reading "DuckDB Storage Engine for MariaDB. When the Sea Lion Learns to Quack."

MariaDB.org

Oh my! #DuckDB materialized views as generated #markdown tables for #obsidian. And as a plugin!? This is brilliant! 😍

I actually was doing something similar... but... outputting as a query I had to remember to output to DuckDB. 😅

https://motherduck.com/blog/obsidian-vault-duckdb-ai-agents/

Your Obsidian Vault Can Now Run SQL (and Your Agent Can Read It)

Run DuckDB SQL inside your Obsidian notes and freeze the results as plain markdown tables, local files or MotherDuck cloud data alike. Your vault becomes a local knowledge base your AI agent can read without ever querying the warehouse | Reading time: 6 min read

MotherDuck

I dislike Obsidian but I know alot of folks here like and use it. This is some neat #DuckDB functionality for it (and the "AI" detractors can skip the "agentic" stuff altogether — at least I think so on first glance read.)

https://motherduck.com/blog/obsidian-vault-duckdb-ai-agents/

Your Obsidian Vault Can Now Run SQL (and Your Agent Can Read It)

Run DuckDB SQL inside your Obsidian notes and freeze the results as plain markdown tables, local files or MotherDuck cloud data alike. Your vault becomes a local knowledge base your AI agent can read without ever querying the warehouse | Reading time: 6 min read

MotherDuck

Did something change in #DuckDB v1.5.3 in how the import filename works? If you did a `.cd` to the folder with the files and imported files using `READ_CSV ... filename=true` normally you got just the basename - now it seems to be like `.\FILE_DATA_20260602.csv`

🤔

#Database

Gosh I love the creativity of the #DuckDB ecosystem folks.

This DuckDB OpenTelemetry Extension seems pretty spiffy.

https://smithclay.github.io/duckdb-otlp/

DuckDB OpenTelemetry Extension

duckdb-otlp: query OpenTelemetry traces, logs, and metrics with DuckDB.

DuckDB OpenTelemetry Extension

if i can do almost all of that without looking at the cheat-sheet, have i become a Data Analyst already ?

#linux #python #sql #perl #sqlite #duckdb

Duckle is an open-source project created by Sourav Roy. It is currently in public beta at v0.0.12, dual-licensed under MIT and Apache-2.0. https://hackernoon.com/what-the-heck-is-duckle #duckdb
What the Heck is Duckle? | HackerNoon

Duckle is an open-source project created by Sourav Roy. It is currently in public beta at v0.0.12, dual-licensed under MIT and Apache-2.0.