Igor De Souza

@igfasouza
11 Followers
44 Following
671 Posts
Software Engineer in a Data Engineer team 🇧🇷🇮🇪 Views are my own
•Java •Kafka •Raspberry PI •Maker

Apache Kafka 4.3.0 Update: What’s New in Kafka 4.3.0

#apachekafka

https://www.zeliot.in/blog/apache-kafka-4-3-0-update-whats-new

Apache Kafka 4.3.0 Update: What’s New in Kafka 4.3.0

Explore what’s new in Apache Kafka 4.3.0 including KRaft, tiered storage, consumer groups, security, and operational improvements.

Kafka Streams Dead Letter Queue in Spring Kafka 4.1

Introduction Spring Kafka 4.1 raises the Apache Kafka baseline to 4.2.0. With this release, it introduces Spring-friendly integration for Kafka Streams KIP-1033 (processing exception handling) and KIP-1034 (dead letter queue in Kafka Streams), both originally proposed by Michelin and available respectively since Apache Kafka 3.9 and

Michelin IT Engineering Blog
Kafka Compute Is Cheap. Network Is Not

Cross-AZ network transfer often costs more than compute. Here's why it's invisible and what...

DEV Community

Why Diskless Kafka must be 100% compatible with Kafka

#apachekafka

https://www.automq.com/blog/diskless-kafka-compatibility

Why Diskless Kafka must be 100% compatible with Kafka | AutoMQ Blog

Diskless Kafka can lower Kafka costs only if existing clients, tools, and semantics keep working. Full compatibility determines migration risk and production readiness.

AutoMQ
Kafka® to Iceberg: Build a queryable data lake with ClickHouse®

That’s ClickHouse below querying an Iceberg table on S3 within 0.31 seconds to read metadata and return the first rows. No Spark job, no data movement, and no separate warehouse layer to manage. By the end of this article, you’ll have the full pipeline running and understand why each component exists—not just how to configure......

NetApp Instaclustr
The Ultimate Guide to LEDs for Raspberry Pi: Types, Colors, Resistors and Fun Facts

Story Horse? LEDs are everywhere. From the tiny status LEDs on a Raspberry Pi to massive displays...

DEV Community

Super interesting idea ...
BlobShuffle

#apachekafka

Cost-effective repartitioning for Kafka Streams via cloud object storage

https://github.com/dynatrace-research/BlobShuffle

GitHub - dynatrace-research/BlobShuffle: Cost-effective repartitioning for Kafka Streams via cloud object storage.

Cost-effective repartitioning for Kafka Streams via cloud object storage. - dynatrace-research/BlobShuffle

GitHub
Kafka Schema Registry doesn’t guarantee compatibility (and what actually does)

Back in 2022, I wrote a couple of posts exploring contract testing with Kafka, Schema Registry and PACT. At the time, the thinking was fairly straightforward: Schema Registry ensures that messages …

Andy Muir's Blog.

Kafka’s quiet observability superpower — Kafka Interceptors

#apachekafka

https://thej3.com/kafkas-quiet-observability-superpower-kafka-interceptors-aca88c33867e

Kafka’s quiet observability superpower — Kafka Interceptors

Every superhero needs a sidekick. Apache Flink is the perfect partner because Interceptors are the collectors, and Flink is the interpreter

Medium
GitHub - redpanda-data/skills: Agent Skills for Redpanda Products

Agent Skills for Redpanda Products. Contribute to redpanda-data/skills development by creating an account on GitHub.

GitHub