InfoQMar 28

Check out Google's tiered storage for #Spanner – its distributed SQL database on Google Cloud!

With this tiered storage, you can store older data on HDDs - 80% cheaper than SSDs - without the hassle of traditional migrations.

Learn more on #InfoQ 👉 https://bit.ly/43NM5ov

#CloudComputing #GoogleCloud #CostOptimization #HDD #DistributedData

Google Cloud Introduces HDD Tier for Spanner Database, Cutting Cold Storage Costs by 80%

Google has recently introduced tiered storage for Spanner, its distributed SQL database on Google Cloud. This tiered storage is based on a new HDD storage option that is 80% cheaper than the existing

InfoQ
InfoQMar 20

How do you create & operate planet-scale data storage solutions for derived data?

How do you decide on the pieces that must be fitted to ensure a resilient operating system?

🎧 Listen to the #InfoQ podcast with Felix GV, Principal Staff Engineer at LinkedIn, and discover the answers: https://bit.ly/41Fxw3A

📄 #transcript included

#database #DataStorage #DistributedData

Building LinkedIn’s Resilient Data Storage: A Deep Dive into Derived Data Storage with Felix GV

In this podcast, Felix GV, Principal Staff Engineer at LinkedIn, discusses how to create and operate planet-scale data storage solutions for derived data.

InfoQ
InfoQMar 6

The #opensource distributed storage system #CubeFS has reached graduation status!

CubeFS supports multiple access protocols, including POSIX, HDFS, S3 & its own REST API.

Its key platform targets?
➡️Big data
➡️AI/LLM applications
➡️container platforms
➡️databases

Learn more: https://bit.ly/3F7d2sQ

#DistributedData #DevOps #InfoQ

Cloud-Native Distributed Storage System CubeFS Graduates from CNCF

The Cloud Native Computing Foundation (CNCF) has announced that the open-source distributed storage system CubeFS has reached graduation status. CubeFS is a storage solution supporting multiple acc

InfoQ
Show threadGLACIATION EUOct 16, 2024
Developed as part of the GLACIATION EU project, this research highlights how nature-inspired algorithms are revolutionizing distributed data systems. 🌍🔗

#GLACIATION #AntsConference #KnowledgeGraphs #DistributedData #LakesideLabs #OpenResearch #ResearchInAction

Melanie Schranz - Aidan O Mahony
DataLadJul 18, 2024

We are running a #blog on #DataLad and #DistributedData now!

https://blog.datalad.org/posts/start/

A blog on data management and DataLad

On starting a blog after more than a decade of working on DataLad.

InfoQMay 22, 2024

In our new #InfoQ #podcast, Deepthi Sigireddi dives deep into the architecture of cloud-native distributed databases, sharding, replication, and failover.

🎧 Listen now 👉 https://bit.ly/3QRUXSD

#CloudNativeArchitecture #Database #DistributedData #Sharding

Deepthi Sigireddi on Distributed Database Architecture in the Cloud Native Era

In this podcast, Vitess CNCF project technical lead Deepthi Sigireddi discusses the architecture of cloud native distributed databases, sharding, replication, and failover.

InfoQ
ModConFlexApr 16, 2024

#ModConFlex #MSCA researcher Ziqi Wang is a co-author of "FedADMM-InSa: An Inexact and Self-Adaptive ADMM for Federated Learning" Federated learning (FL) emerges as a promising framework for #Learning from #DistributedData while preserving privacy. It is useful in the #WindEnergy sector. For instance, it enables #CollaborativeTraining of #WindPower #ForecastingModels among multiple #WindFarms, overcoming challenges associated with #DataPrivacy and #CommercialCompetition.

https://arxiv.org/pdf/2402.13989.pdf

InfoQMar 4, 2024

Uncover the secrets of CacheFront – Uber’s innovative #caching solution for its in-house distributed database, Docstore!

Learn how it achieves over 40M reads per second & significant latency reductions: https://bit.ly/3T0l7mf

#InfoQ #DistributedCache #Database #SQL #DistributedData #ChangeDataCapture

Uber's CacheFront: Powering 40M Reads per Second with Significantly Reduced Latency

Uber developed an innovative caching solution, CacheFront, for its in-house distributed database, Docstore. CacheFront enables over 40M reads per second from online storage and achieves substantial performance improvements, including a 75% reduction in P75 latency and over 67% reduction in P99.9 latency, demonstrating its effectiveness in enhancing system efficiency and scalability.

InfoQ
InfoQJun 28, 2023

Curious about #DistributedFileSystems?

#InfoQ brings you an insightful article by Changjian Gao, exploring the design principles, innovations & challenges behind 3 representative systems:
1️⃣ #GoogleFileSystem
2️⃣ #Tectonic
3️⃣ #JuiceFS

Gain valuable insights: https://bit.ly/3pvnNxt

#DistributedData #BigData

Comparative Analysis of Major Distributed File System Architectures: GFS vs. Tectonic vs. JuiceFS

Distributed file systems have emerged as dynamic and scalable storage solutions. We explore the architectures of three distributed file systems: Google File System (GFS), Tectonic, and JuiceFS.

InfoQ