agentdero went live on Twitch. Catch up on their Science & Technology VOD now.
The next #PyData #Helsinki #meetup is on 19 March 2026 at Elisa, Ratavartijankatu 5.
On the menu: optimisation problems in electricity markets, a deep dive into #DeltaLake read performance without a cluster, two lightning talks, and an intro to Data & AI at our sponsor Elisa.
And of course our already traditional quiz, where the main challenge is understanding how answers are scored.
https://www.meetup.com/pydatahelsinki/events/313128987/?isFirstPublish=true
My most frequently asked question in 2025 was: how do you design for
high-throughput ingestion with #deltalake
Over the last week I took the time to write down exactly how I design for throughput in this blog post: https://www.buoyantdata.com/blog/2026-01-02-design-for-throughput.html
Delta Lake allows for building high-throughput applications, especially for append-only workloads as part of a medallion architecture. In this post we review the high-throughput data ingestion architecture deployed by Buoyant Data using oxbow. Separating write and transaction management for efficiency when bringing data into the bronze layer.
Spark SQL for Data Engineering 1 : I am going to start spark sql sessions as series. #sparksql
Spark SQL Part 1 : I am going to start spark sql sessions as series. #sparksql #deltalake #pyspark ' Databricks Notebooks code for ... source
🎉 Excited to Share a Milestone!
I’m thrilled to announce that I’ve successfully earned the Databricks Academy Platform Administrator accreditation! This achievement validates my ability to manage and administer the Databricks Lakehouse Platform effectively.
Looking forward to continuing to explore advanced analytics, AI/ML integration, and generative AI workflows within Databricks.
#Databricks #DataEngineering #Spark #DeltaLake #UnityCatalog
https://credentials.databricks.com/bb9c88f7-d446-4a30-9115-b7bf5df5567c#acc.XmSM63zT
^ Less then a day to sign up and get our take on #SAP Business Data Cloud and the Delta Sharing ecosystem
#databricks #businessdatacloud #deltalake #deltasharing #dremio #webinar
kafka-delta-ingest was the project that spawned the development of #deltalake for #rustlang, also known as delta-rs.
Last week I decommissioned the last of those processes. I have since made our
ingestion even cheaper but kafka-delta-ingest will always hold a spot in our history
https://brokenco.de/2025/10/30/kafka-delta-ingest-was-fun.html
Linux power-users tend to have strong opinions about two things: distribution and systemd. The bazaar of distributions means competing implementations or different perspectives end up expressed through the curation of the packaged software. systemd ended up so contentious because it’s a decent piece of technology which suffers from persistent scope creep that became a foundational component in a lot of distributions. The drama du jour is that systemd is somehow implicated in “age verification laws.”
Tomorrow at 7am PT (14:00 UTC) I'll be doing some #deltalake hacking with some other 🦀 folks on #deltalive!
📣I wrote a blog 🚀📰:
The Data Surrender Trap: How Enterprises Are Losing Control in the AI Gold Rush—and the Simple Fix 👇
https://www.softinio.com/post/the-data-surrender-trap/
#AI #Deltalake #DataEngineering #DataGovernance #ArtificialIntelligence
rtyler
PyData Helsinki
R Tyler Croy 🦀
Python Job Support
Qiita - 人気の記事
Albert David
NextLytics AG
Salar Rahmanian 
