I am now listening to Be Here by Small Pond #SmallPond
https://www.last.fm/music/Small+Pond/_/Be+Here
Be Here — Small Pond | Last.fm

Read about Be Here by Small Pond and see the artwork, lyrics and similar artists.

Last.fm
I am now listening to Be Here by Small Pond #SmallPond
https://www.last.fm/music/Small+Pond/_/Be+Here
Be Here — Small Pond | Last.fm

Read about Be Here by Small Pond and see the artwork, lyrics and similar artists.

Last.fm

#TIL about #smallpond, a lightweight #data processing framework from #deepseek that uses #duckdb and #3fs

https://github.com/deepseek-ai/smallpond

GitHub - deepseek-ai/smallpond: A lightweight data processing framework built on DuckDB and 3FS.

A lightweight data processing framework built on DuckDB and 3FS. - deepseek-ai/smallpond

GitHub

DuckDB goes distributed? DeepSeek’s smallpond takes on Big Data

Link

📌 Summary:
DeepSeek 推出名為 smallpond 的分散式運算框架,基於 DuckDB 開發,能處理高達 100TB 以上的資料。這套系統使用 Ray Core 在 Python 層級實現分散式處理,透過 DAG 執行模型和懶惰評估策略最佳化效能。與其他框架相比,smallpond 專注於簡單性,以整個分區為單位分配工作,而非在查詢層級分解操作,提供了一種 DuckDB 從單節點擴展至分散式環境的解決方案。

🎯 Key Points:
- DeepSeek 的 smallpond 能在 30 分鐘內處理 110.5TiB 資料,平均效能達 3.66TiB/分鐘
- 其架構採用懶惰評估方式構建邏輯計劃,只在需要時才執行計算
- 使用 Ray Core 實現分散式處理,支援雜湊、均勻和隨機分區策略
- 運算分散在 Python 層級,每個分區獨立使用單獨的 DuckDB 實例
- 效能測試使用 DeepSeek 自家的 3FS 檔案系統進行,該系統針對 AI 訓練工作負載優化
- 相比 Spark/Daft 等框架,smallpond 分散整個分區而非單獨操作,架構更簡單
- DuckDB 擴展方式多元:向上擴展(單機大資源)、向外擴展(增加節點)或透過 AWS Lambda 等無伺服器函式處理

🔖 Keywords:
#DuckDB #分散式運算 #smallpond #DeepSeek #Ray

DuckDB goes distributed? DeepSeek’s smallpond takes on Big Data

DeepSeek is pushing DuckDB beyond its single-node roots with smallpond, a new, simple approach to distributed compute. But does it solve the scalability challenge—or introduce new trade-offs?

Mehdio's Tech (Data) Corner
DuckDB goes distributed? DeepSeek’s smallpond takes on Big Data

DeepSeek is pushing DuckDB beyond its single-node roots with smallpond, a new, simple approach to distributed compute. But does it solve the scalability challenge—or introduce new trade-offs?

Mehdio's Tech (Data) Corner
Smallpond – A lightweight data processing framework built on DuckDB and 3FS — https://github.com/deepseek-ai/smallpond
#HackerNews #Smallpond #DuckDB #DataProcessing #Framework #Lightweight #3FS #OpenSource
GitHub - deepseek-ai/smallpond: A lightweight data processing framework built on DuckDB and 3FS.

A lightweight data processing framework built on DuckDB and 3FS. - deepseek-ai/smallpond

GitHub
Wow, "DeepSeek Drops Distributed DuckDB"—a saga of tech buzzword salad so dense, it could stop a bullet. 🦆💨 Apparently, if you squint hard enough, #smallpond and #3FS are here to revolutionize databases...for the three people who can figure out what they're for. 🚀💀
https://www.definite.app/blog/smallpond #DeepSeek #DistributedDuckDB #TechBuzzwords #DatabaseRevolution #HackerNews #ngated
Definite: Understanding smallpond and 3FS: A Clear Guide

Definite: A concise breakdown of what smallpond and 3FS are, how to use them, and if they're suitable for your data processing needs.

Definite.app
Scrying Gem by Eris And AI

Scrying Gem by Eris And AI

Eris And AI - Artist Website

Hey all! We are back - not only with new shows, but also with a new name and concept. We are super excited!
Starting with European Tour of Varsity Star and Inwards in May presented by Small Pond and us.
Both our website https://12354.art and social media will keep you posted.
We will be posting weekly reports and announcements. So, stay tuned!
Bands who want to get in touch: Email us at [email protected]
Cheerio

#tour #concert #leipzig #dresden #mainz #music #smallpond #12354 #diy

12354 – 12354 is a community of art lovers promoting music and art in Leipzig