More good stuff from Grab - this time writing about how they are building a realtime datalake with tools including #apacheFlink, #apacheHudi, #apacheSpark and #TrinoDB

https://engineering.grab.com/enabling-near-realtime-data-analytics

#dataEngineering #dataArchitectures #openSource

Enabling near real-time data analytics on the data lake

As the data lake landscape matures over the years, it presents opportunities to unlock more business value from the data. This correlates with the increased demand for flexible ad-hoc usage of fresh data. This article explores how we implemented data ingestion in Hudi table formats using Flink to meet this business demand.

Grab Tech
Technology Radar | Guide to technology landscape

The Technology Radar is an opinionated guide to today's technology landscape. Read the latest here.

Thoughtworks

.@[email protected] and @[email protected] talking to Justin Borgman about Starburst, #trinodb, and data access patterns and querying https://roundup.getdbt.com/p/ep-27-to-move-or-not-to-move-data

#datadon #podcasts #dataengineering

Ep 27: "To Move, or Not to Move" (Data). That is the Question.

Diving into the possibilities of distributed query engines + the data mesh architecture with Justin Borgman of Trino / Starburst.

The Analytics Engineering Roundup