Software engineer @ Decodable · Ex-lead of Debezium · Spec lead of Bean Validation 2.0 · Creator of JfrUnit, kcctl and MapStruct · Java Champion · 🚴
#DataEngineering #Java #OpenSource
Excellent post from @gunnarmorling about the outbox pattern - what it is, addressing common questions and challenges, and what the alternatives are.
I am only an infrequent visitor to LinkedIn, but today I discovered a valuable tip from @gunnarmorling about the new Kafka Native Docker image. Thank you!
Look, what was in the mail today… Didn't expect to land the printed copy of #DuckDB in Action so soon. #Happy
Thanks to Jordan Tigani, Pramod Sadalage, Qiusheng Wu and @gunnarmorling for endorsing us.
Do you know SQL? Exactly!
Most databases and data processing tools support SQL for exactly that reason. And we see a strong movement for all of them to get closer to the standard, day by day.
In this weeks episode of the Cloud Commute podcast, our host @noctarius2k talks with @gunnarmorling from #Decodable about the benefits of #SQL, how #CDC (change data capture) works and why Decodable uses #ApacheFlink as the underlying technology for its #StreamProcessing offering.
✍️Blogged: Flink SQL—Misconfiguration, Misunderstanding, and Mishaps
🫖 Pull up a comfy chair, grab a mug of tea, and settle in to read about my adventures troubleshooting some gnarly #ApacheFlink problems ranging from the simple to the ridiculous…
🔗 https://dcbl.link/troubleshooting-flinksql2
👉 Topics include:
🤔 What's Running Where? (Fun with Java Versions)
🤨 What's Running Where? (Fun with JAR dependencies)
😵 What's Running Where? (Not So Much Fun with Hive MetaStore)
A wondrous walk through some examples of troubleshooting Flink SQL. From ClassNotFoundException problems to S3 configuration and JDBC drivers, this blog post provides a valuable reference for understanding how to approach your next Flink SQL error message.
Also new today: The last chapters added to the #MEAP for #DuckDB in Action, including the appendix in which I wrote a bit about using DuckDB from #Java. I used the #1BRC by @gunnarmorling as an example.
https://www.manning.com/books/duckdb-in-action
Now the whole things just need to make its way through the print production.
Dive into DuckDB and start processing gigabytes of data with ease—all with no data warehouse.</b> DuckDB is a cutting-edge SQL database that makes it incredibly easy to analyze big data sets right from your laptop. In DuckDB in Action</i> you’ll learn everything you need to know to get the most out of this awesome tool, keep your data secure on prem, and save you hundreds on your cloud bill. From data ingestion to advanced data pipelines, you’ll learn everything you need to get the most out of DuckDB—all through hands-on examples. Open up DuckDB in Action</i> and learn how to: Read and process data from CSV, JSON and Parquet sources both locally and remote</li> Write analytical SQL queries, including aggregations, common table expressions, window functions, special types of joins, and pivot tables</li> Use DuckDB from Python, both with SQL and its "Relational"-API, interacting with databases but also data frames</li> Prepare, ingest and query large datasets</li> Build cloud data pipelines</li> Extend DuckDB with custom functionality</li> </ul> Pragmatic and comprehensive, DuckDB in Action</i> introduces the DuckDB database and shows you how to use it to solve common data workflow problems. You won’t need to read through pages of documentation—you’ll learn as you work. Get to grips with DuckDB's unique SQL dialect, learning to seamlessly load, prepare, and analyze data using SQL queries. Extend DuckDB with both Python and built-in tools such as MotherDuck, and gain practical insights into building robust and automated data pipelines.
Awesome #java / #jvm savvy accounts to follow:
👋🏼 Rashidi Zin - @rashidi
👋🏼 Frank Delporte - @frankdelporte
👋🏼 John Burns - @wakingrufus
👋🏼 Moritz Halbritter - @mhalbritter
👋🏼 Gunnar Morling - @gunnarmorling
More updates like this? Follow me or #JavaBubbleOrgAccountsRefresher
Source: #javabubble (javabubble.org)
Botdev: @moelholm
Introduced MapStruct by @gunnarmorling into my new customer project. This is still the best solution I know to map between layers in Java. Especially when the project uses hexagonal architecture, which has layers. Layers everywhere...
It also supports mapping from two different sources, mapping into an existing object and deep clones. Thanks for this fine piece of software, Gunnar and friends.
rmoff 🏃🏻 🍺 🥓
Franz van Betteraey
Michael Simons
simplyblock
René Schwietzke
Thomas Wuerthinger
Java Bubble
Arnold Franke