#Confluent introduces a new approach in #ApacheKafka that moves schema IDs from message payloads to record headers.
✅ Simplify schema governance & evolution.
✅ Improve compatibility across serialization formats
✅ Reduce coupling between data & metadata in event-driven architectures
Read the deep dive on #InfoQ ⇨ https://bit.ly/4tF7Fot
#ML #EventStreamProcessing #ProtocolBuffers #DataPipelines #DataAnalytics
#Uber introduces a new tiered storage feature in #ApacheKafka!
Added in version 3.6.0 (and currently in early access), this feature aims to solve the scalability and efficiency challenges faced by organizations running large Kafka clusters.
Details on #InfoQ 👉 https://bit.ly/4dssQ5P
#DevOps #DistributedSystems #EventStreamProcessing #SoftwareArchitecture
#CaseStudy - How does HubSpot avoid the build-up in the consumer group lag & prioritize the processing of real-time traffic?
By using multiple #Kafka topics called 'swimlanes': https://bit.ly/3RaA4Bc
Insights on #InfoQ!
#RealTimeData #SOA #SoftwareArchitecture #EventStreamProcessing #ApacheKafka
HubSpot adopted routing messages over multiple Kafka topics (called swimlanes) for the same producer to avoid the build-up in the consumer group lag and prioritize the processing of real-time traffic. Using a combination of automatic and manual detection of traffic spikes, the company ensures the majority of customers’ workflows execute without delays.
#EventStreamProcessingMarket is expected to grow from USD 612.7 million in 2018 to USD 1,663.0 million by 2023, at a CAGR of 22.1% during the forecast period, 2018–2023.
https://www.marketresearchfuture.com/reports/event-stream-processing-market-7491
#EventStreamProcessing #EventStreamProcessingIndustry #MRFR #MarketResearchFuture
InfoQ
vilasmrf