Cold data is read-only - that's the assumption baked into basically every tiering solution on the market. ColdFront breaks it.

UPDATE & DELETE on archived rows work through standard SQL. A GDPR deletion on five-year-old events is a single DELETE statement. No restore cycle.

DuckDB in-process, Apache Iceberg on any S3. Stock unpatched #PostgreSQL 16/17/18. Beta now, PostgreSQL License. Led by Jimmy Angelakos.

📖 https://github.com/pgEdge/coldfront

#OpenSource #DataEngineering #ApacheIceberg #DuckDB

⚡ Hai un CSV da 2 GB e vuoi interrogarlo in SQL senza installare niente.
DuckDB lo carica, lo analizza e si aggancia a pandas in tre righe. 👇
https://gomoot.com/duckdb-analizza-file-csv-json-e-parquet-senza-server-ne-configurazione/

#dati #duckdb #opensource #sql

pdo_duckdb: a native PDO driver for DuckDB, the in-process analytical database. Query DuckDB's columnar engine through the standard PDO API, with a native appender for bulk loads and optional result streaming for big scans.

https://github.com/iliaal/pdo_duckdb
Write-up: https://ilia.ws/blog/pdo-duckdb-a-pdo-driver-for-duckdb

#php #duckdb #pdo

ElePHPants now also love Ducks! 🐘 💓 🦆

After using DuckDB for many years successfully in production, I've decided to build a native PHP DuckDB PDO driver:

https://github.com/thomas-0816/pdo-duckdb-php

#php #duckdb

DuckDB Internals Part 1

https://www.greybeam.ai/blog/duckdb-internals-part-1

#ai #duckdb

pgEdge ColdFront: #PostgreSQL data tiering. Hot data in the heap, cold to Apache Iceberg on S3 - up to 90% lower storage cost.

The cold tier is writable. UPDATE & DELETE on cold rows work in standard SQL. No restore cycle, no rehydration. No app changes.

DuckDB runs in-process. No daemon, no sidecar. PostgreSQL License, beta now. Led by @vyruss.

Press release: 👉 https://www.pgedge.com/press-releases/pgedge-announces-coldfront-for-postgresql

GitHub: 🔗 https://github.com/pgEdge/coldfront

#OpenSource #DataEngineering #ApacheIceberg #DuckDB

why sqlite is often overlooked as a data-exchange format.

https://www.reibenschuh.info/a-case-for-sqlite-as-a-file-format

#sqlite #duckdb #parquet #arrow #csv #excel

Everything seems to be turning columnar. It's not just parquet, but also Arrow and DuckDB.

I'm still trying to grasp how it works, but it's an interesting development.

#columnar #parquet #arrow #duckdb

DuckDB Internals: Why Is DuckDB Fast? (Part 1)

https://www.greybeam.ai/blog/duckdb-internals-part-1

#HackerNews #DuckDB #Fast #Internals #Database #Performance #Data #Analytics