🚀 Big Data meets AI—powered by Iceberg, Spark & LLMs

At #ArcOfAI, Pratik Patel shows how to build a real architecture that lets users query massive datasets with natural language—no dashboards, no SQL, just questions & insights.

https://www.arcofai.com/speaker/1c241471d7f04018a0da70efffd35b32

🎟️ Get tickets: https://arcofai.com

#ArtificialIntelligence #BigData #DataArchitecture #ApacheSpark #ApacheIceberg #LLM #GenAI #EventStreaming #Kafka #Flink #AIEngineering #TechLeadership

Every step feels like movement. But look around — same view, slightly different altitude.

Pilot projects that never scale. Dashboards nobody uses. The same problem solved three different ways by three different teams. That's what happens without fixing the foundation.

A spiral staircase only takes you somewhere if you commit to the full climb. Build data infrastructure that compounds — not standalone efforts that reset every cycle.

Stop circling. Start building.

#DataArchitecture #Industry40

My new post analyzes Formula 1 telemetry 🏎️ using Oracle Converged Database with 6 workloads: ✅ Relational ✅ JSON ✅ Time Series ✅ Spatial ✅ Graph ✅ Vector

Full breakdown & code: https://buckenhofer.com/2026/01/one-database-six-workloads/

#DataEngineering #Oracle #SQL #F1 #DataArchitecture #ConvergedDatabase

Why There’s No Single Best Way To Store Information | Quanta Magazine

The math of data structures helps us understand how different storage systems come with different trade-offs between resources such as time and memory.

Quanta Magazine

"🚨 Thiết kế hệ thống doanh nghiệp cho AI: Yếu tố bị bỏ quên!

AI cần tiếp cận lượng lớn 'vi-dữ liệu' (micro-data) như logs, sự kiện, thay đổi trạng thái để tạo 'bản sao số' phản ánh ngữ cảnh doanh nghiệp - thứ phần mềm truyền thống không cung cấp đủ.

Liệu kiến trúc hệ thống hiện tại đã đủ cho AI, hay cần thiết kế lại từ đầu?

#AI #EnterpriseSoftware #DataArchitecture
#TríTuệNhânTạo #PhầnMềmDoanhNghiệp #KiếnTrúcDữLiệu"

https://www.reddit.com/r/SaaS/comments/1q2ftxu/preparing_enterprise

What happens when a conflict cannot be resolved in a distributed database system, such as when there's network or hardware failures?

Here, Paul Rothrock discusses how pgEdge handles duplicate or missing primary keys, and missed DDL statements.

Curious to know more about the snowflake sequences extension mentioned in the video? Find it on GitHub: https://github.com/pgEdge/snowflake

Find the full video on YouTube: https://youtu.be/prkMkG0SOJE

#programming #postgres #postgresql #dataarchitecture #software

🚀 Introducing the latest in tech gymnastics: the "Frozen DuckLakes" 🦆✨—where you can build a "high-performance" data lake with no moving parts, except for all the parts that need to move. 🤔 Apparently, Mark Harrison has found a way to freeze time and logic to make #serverless data access *magically* complex. 🧊🔮
https://ducklake.select/2025/10/24/frozen-ducklake/ #techinnovation #dataengineering #computing #dataarchitecture #magictech #HackerNews #ngated
Frozen DuckLakes for Multi-User, Serverless Data Access

We show how you can build high-performance data lakes with no moving parts.

DuckLake

Are you building yesterday’s information architecture tomorrow? 🏗️

It's a question worth asking as the pace of AI adoption transforms how we interact with data. While we're diligently building robust data platforms and dashboards, a seismic shift is underway: enterprise users increasingly demand direct answers, not just static displays, powered by #ConversationalAI.

This means adopting an #AIFirst paradigm for your entire #DataArchitecture.

https://www.linkedin.com/pulse/you-building-yesterdays-information-architecture-allan-engelhardt-ioame
🧵 1/2

Is outdated data architecture stalling your GenAI progress?

Zhamak Dehghani, Founder and CEO @Nextdata, presents a new framework for the AI-native era at QCon AI New York.

Learn the foundational capabilities: embedded semantics, policy enforcement, and agent-centric discovery.

Rethink your data for GenAI: https://bit.ly/48vRfb0

#QConAI #DataMesh #GenAI #DataArchitecture