InfoQMay 26

1 Billion Row Challenge creator Gunnar Morling is back with #Hardwood - a zero-dependency, ultra-fast #Java parser for #ApacheParquet.

• Uses page-level parallelization with Java Virtual Threads to maximize CPU core usage & scalable concurrency
• Built AI-natively, where strong documentation accelerated development - while human oversight remained critical for code quality, API design & regression prevention

🎧 Listen to the #InfoQ #podcast to learn more about Hardwood’s architecture, parallelization & performance optimization ⇨ https://bit.ly/4wP8jlR

#SoftwareEngineering #AI

InfoQMay 14

Every #TimeSeriesDatabase is just a set of storage decisions:
➡️ Row layout
➡️ Compression timing
➡️ Partitioning strategy

These choices often impact cost and query performance more than the database you pick.

This #InfoQ article breaks down these fundamentals from first principles using #PostgreSQL & #ApacheParquet ⇨ https://bit.ly/4fkDHlV

#BigData #TimeSeriesData #Database

Antoine PitrouMay 6

Announcing the first ever Apache Arrow and Parquet meetup in Paris, kindly hosted by @datadoghq .

If you’re using Arrow or Parquet, looking for insights, or wanting to meet other community members, this meetup is for you. Please register if you plan to attend!

https://luma.com/6ed1oko1

#apachearrow #apacheparquet

Apache Arrow / Parquet - June 2026 meetup in Paris · Luma

Details We’re excited to announce the first ever Apache Arrow and Parquet meetup in Paris! This meetup will be hosted on June 18th by Datadog, in their…

Hacker NewsMar 1

Hardwood: A New Parser for Apache Parquet

https://www.morling.dev/blog/hardwood-new-parser-for-apache-parquet/

#HackerNews #Hardwood #ApacheParquet #DataProcessing #OpenSource #TechNews

Hardwood: A New Parser for Apache Parquet

Today, it’s my great pleasure to announce the first public release of Hardwood, a new parser for the Apache Parquet file format, optimized for minimal dependencies and great performance. Hardwood is …

Gunnar Morling
RonanOct 2, 2025

https://dipankar-tnt.medium.com/apache-parquet-vs-newer-file-formats-btrblocks-fastlanes-lance-vortex-cdf02130182c

#data #DataEngineering #ApacheParquet

Apache Parquet vs. Newer File Formats (BtrBlocks, FastLanes, Lance, Vortex)

For over a decade, Apache Parquet has been the cornerstone of analytical data storage. Parquet emerged in the Hadoop era as an open…

Medium
arabiccolaSep 20, 2025

https://github.com/evidence-dev/evidence/pull/3201

#evidence #opensource #reporting #apacheparquet #universalsql #postgres

Feature: disable HMR/watchers in the CLI, with other useful development features by diraneyya · Pull Request #3201 · evidence-dev/evidence

Summary This PR enhances Evidence's development experience and proxy support with several improvements to CLI options, configuration, and developer workflows. Key changes Proxy Support: Added ...

GitHub
RonanAug 25, 2025

https://blog.ronandev.ovh/apache-parquet/

Apache Parquet est le format de stockage colonnaire incontournable pour le Big Data. Optimisé pour la performance et la compression, il accélère les requêtes et réduit les coûts. Intégré à Spark, Iceberg et les architectures lakehouse, Parquet offre interopérabilité et efficacité.

#ApacheParquet #dataengineering

Apache Parquet : Le format de stockage incontournable pour le Big Data

Apache Parquet est le format de stockage colonnaire incontournable pour le Big Data. Optimisé pour la performance et la compression, il accélère les requêtes et réduit les coûts. Intégré à Spark, Iceberg et les architectures lakehouse, Parquet offre interopérabilité et efficacité.

Le blog de Ronan | Data Engineer
RonanJul 28, 2025

https://github.com/cwida/FastLanes

#ApacheParquet #FastLanes #Data

GitHub - cwida/FastLanes: Next-Gen Big Data File Format

Next-Gen Big Data File Format. Contribute to cwida/FastLanes development by creating an account on GitHub.

GitHub
N-gated Hacker NewsJul 14, 2025
Ah, yes, the riveting saga of cramming "user-defined indexes" into Apache Parquet files. 😴 Because who doesn’t love a story about exploiting footer metadata to do something nobody asked for? Next time, tell us how to alphabetize your sock drawer using ForestDB. 🧦📚
https://datafusion.apache.org/blog/2025/07/14/user-defined-parquet-indexes/ #userdefinedindexes #apacheparquet #footermetadata #techhumor #dataengineering #HackerNews #ngated
Embedding User-Defined Indexes in Apache Parquet Files - Apache DataFusion Blog

Hacker NewsJul 14, 2025

Embedding User-Defined Indexes in Apache Parquet

https://datafusion.apache.org/blog/2025/07/14/user-defined-parquet-indexes/

#HackerNews #Embedding #User-Defined #Indexes #in #Apache #Parquet #ApacheParquet #UserDefinedIndexes #DataFusion #BigData #Analytics

Embedding User-Defined Indexes in Apache Parquet Files - Apache DataFusion Blog