Senior/Staff DevOps Engineer, Trading Technology at Binance

Binance is hiring Senior/Staff DevOps Engineer, Trading Technology

Kafka: Queue & Pub-Sub Together 📨

Queue (1-to-1):
1 consumer group, consumers = partitions
Each message → 1 consumer only

Pub-Sub (1-to-many):
Multiple consumer groups
Each group → all messages

Traditional systems need separate tools.
Kafka does both natively!

#Kafka #MessageQueue #PubSub #DevOps

Throughput vs Storage: Kafka vs Database 📊

Database:
• High Storage (billions of records)
• Low Throughput (writes/sec limited)
• Complex queries possible ✓

Kafka:
• Very High Throughput (millions/sec!)
• Low Storage (temporary)
• No queries (only sequential)

They don't compete. They complement each other.

Use database for storage, Kafka for streaming.

#Kafka #Database #SystemDesign

What is Kafka? 📦

Apache Kafka = Distributed Event Streaming Platform

Unlike traditional message queues:
✅ Messages persist on disk
✅ Replay events anytime
✅ Scale horizontally
✅ Fault tolerant

Use cases: Real-time analytics, log aggregation, metrics, microservices communication.

Think: LinkedIn's real-time activity streams (where Kafka was born!). 🚀

#Kafka #DataStreaming #DevOps

Esta es la lista con los capítulos del tutorial de "Introducción a #Kafka":

https://www.youtube.com/playlist?list=PLtdeXn2f7ZbMfoKvZ95r1mpmJzka2B6g9

Suscríbete a mi canal.

#Programacion #Tutorial #Gratis #SiguemeYTeSigo #Followback

Nota: imagen generada con IA.

Our client engagements often start with workshops on architecting the optimal setup for #Kafka clusters.

Michał Matłoka wrote down some of the basics of the process - still a long read, but who said disaster recovery is easy?

https://softwaremill.com/guide-to-apache-kafka-disaster-recovery-and-multi-region-architectures/

Guide to Apache Kafka Disaster Recovery and Multi-Region Architectures

Using Apache Kafka? Then, a disaster recovery plan and multiregion architectures are not “nice to have” capabilities but core elements of business continuity strategy.

SoftwareMill
Solutions Architect at MongoDB

MongoDB is hiring Solutions Architect

Senior Software Engineer - Backend & Infrastructure (f/m/d) at Contentful

Contentful is hiring Senior Software Engineer - Backend & Infrastructure (f/m/d)

Software Engineer, Safety Experience at Discord

Discord is hiring Software Engineer, Safety Experience

Spring, kafka, неблокирующий retry, лаги

История об особенностях использования механизмов retry , которые дает spring-kafka из коробки и проблемах с производительностью. Есть нужно сделать асинхронный retry сообщений на топике, который бы не блокировал основной поток сообщений «легко и быстро» — вам сюда😊 (А потом после «легко и быстро» несколько дней дебажить 🤔 )

https://habr.com/ru/articles/1018174/

#java #springboot #kafka #retry #scheduler

Spring, kafka, неблокирующий retry, лаги

Всем привет! Хочу рассказать об особенностях использования механизмов retry, которые дает spring для kafka из коробки. У нас java-21 , spring-boot-3.2 , kafka-3.7 , spring-kafka-3.1.x Сразу должен...

Хабр