Recce - Trust, Verify, ShipMar 3

Wes McKinney built pandas in a mouse-infested NYC apartment on founder hours. Now he runs parallel Claude Code sessions and says AI is forcing "radical accountability" on every software vendor shipping mediocre products. Full conversation: https://youtu.be/Uso8-yaERkE

#DataRenegades #pandas #ApacheArrow

PositMar 2
What happens after you outgrow your memory limits? 🤔
Creator of pandas and Apache Arrow, Wes McKinney, takes the stage at #positconf 2026 to discuss the next frontier of analytical computing and agentic software engineering. 🏗️
Don't just use the tools—meet the person building the foundation of the modern data stack.
👉 Grab your spot: pos.it/conf
#positconf #DataScience #ApacheArrow #Ibis #Python
Andrew PadillaFeb 27
So Apache Arrow is a wrapper around mmap with a data format? #ApacheArrow
R ConsortiumJan 28

R Consortium webinar: Scale up data analysis in R with Arrow—fast, memory-efficient analytics without a DB or cluster.

With Dr Nic Crane (Arrow R maintainer, Apache Arrow PMC).

Register: https://r-consortium.org/webinars/scaling-up-data-analysis-in-r-with-arrow.html

#rstats #apachearrow

Alex MercedNov 10

Will I see you at the Subsurface Lakehouse Conference Nov 13th?

Register at Dremio.com/subsurface

#DataLakehouse #ApacheIceberg #ApacheArrow #ApachePolaris

A stranger in a familier landOct 8
I may have fallen down the rabbit hole here but...
#apacheArrow had my curiosity but now had my attention...
And I'm building wal2arrow for #postgres and #mysql...
It's kind of awesome not to have json /avro around in the hot paths.
Dewey DunningtonOct 7

I'm aiming for a weekly Apache Sedona DB drop...this week's edition: wrangling some uncooperative input data into clean GeoParquet output using SedonaDB's excellent ApacheArrow interop. Bonus: learn about the postage stamps of farm field dotting the prairies are organized! #GISChat #ApacheArrow

https://dewey.dunnington.ca/post/2025/geodata-cleaning-with-arrow-and-sedonadb/

(Geo)Data cleaning with Arrow and SedonaDB | Dewey Dunnington

Last week I had the pleasure of being a guest on a Cloud Native Geospatial webinar with my colleagues Jia Yu and Matt Forrest where we talked SedonaDB. In the webinar Matt demoed a fantastic blog post comparing a real-world workflow on SedonaDB, DuckDB, and PostGIS.

Dewey Dunnington
InfoQSep 11, 2025

𝐒𝐨𝐦𝐞𝐭𝐢𝐦𝐞𝐬, 𝐭𝐡𝐞 𝐛𝐞𝐬𝐭 𝐰𝐚𝐲 𝐭𝐨 𝐦𝐨𝐯𝐞 𝐟𝐨𝐫𝐰𝐚𝐫𝐝 𝐢𝐬 𝐭𝐨 𝐬𝐭𝐚𝐫𝐭 𝐨𝐯𝐞𝐫.

In this #InfoQ article, Paul Dix shares the story of #𝐈𝐧𝐟𝐥𝐮𝐱𝐃𝐁’𝐬 𝐜𝐨𝐦𝐩𝐥𝐞𝐭𝐞 𝐫𝐞𝐰𝐫𝐢𝐭𝐞, moving to #RustLang and a new stack -Apache Flight, Data Fusion, Apache Arrow & Parquet (FDAP).

He explores:
✅ The mechanics of the rewrite
✅ The benefits of the new architecture
✅ The different product versions

🔗 Read now: https://bit.ly/46eSvMV

#SoftwareArchitecture #ApacheArrow #Databases

amoebaSep 2, 2025
Ruby on Rails (ActiveRecord) now supports ADBC with a new adapter written by Sutou Kouhei. Check out the blog post (in Japanese): https://www.clear-code.com/blog/2025/8/21/activerecord-adbc-adapter.html The gem is available at https://rubygems.org/gems/activerecord-adbc-adapter. #apachearrow #rubyonrails
Active Record ADBC adapter - ADBCで大量データを高速移動！Ruby on RailsアプリからDuckDBも使えるよ! - 2025-08-21 - ククログ

Ruby用のデータ処理ツールを提供するプロジェクトRed Data Toolsをやっている須藤です。 数年前からRuby on RailsアプリケーションでADBCを使えるとよさそうだなぁと思っていた（証拠1、証拠2）のですが、ついにそれが動くようになったのでactiverecord-adbc-adapterとしてリリースしました。 ADBCとはArrow Database Connectivityの略で、Apache Arrowを使ってDBと高速に大量データをやりとりするための仕組みです。Active RecordでADBCを使えるようになると、Ruby on Railsアプリケーションでの大量データのやりとりが速くなります。また、Active Record経由でDuckDBも使えるようになります。DuckDBもADBCをサポートしているからです。

クリアコード
PositJul 11, 2025

Next Tuesday, get ready to meet the mind behind #Pandas & #ApacheArrow !

Wes McKinney shares his origin story (Part 1) on #TheTestSet. From speedruns to shaping the data stack, this is one you won't want to miss.

Mark your calendar for Tuesday & subscribe at https://thetestset.co!

#DataScience #Python