Hacker NewsJan 13

Open sourcing Dicer: Databricks's auto-sharder

https://www.databricks.com/blog/open-sourcing-dicer-databricks-auto-sharder

#HackerNews #OpenSourcing #Dicer #Databricks #AutoSharder #DataEngineering #BigData

Open Sourcing Dicer: Databricks’ Auto-Sharder

Open sourcing Dicer, Databricks’ auto sharder. Learn why auto sharding matters, how Dicer works, and how it keeps Unity Catalog and SQL fast through restarts.

Databricks