Nine years ago, my amazing former boss and mentor Ajith Kumar, asked me to do an impact analysis on replacing ActiveMQ with Kafka in our integration layer. It was part of a broader product overhaul. We took the plunge and adopted Kafka across the sta...
Introduction Apache Kafka has become the backbone of modern real-time systems — enabling everything from sensor telemetry and financial transactions to personalized customer experiences. But Kafka, by itself, is complex to deploy, scale, and operate ...
As event-driven architectures gain traction, the combination of Apache Kafka and NestJS has emerged as a compelling solution for building scalable, decoupled microservices. In this guide, we’ll explore how to integrate Kafka with NestJS using the bui...
Apache Kafka has evolved into the de facto standard for building real-time data pipelines and streaming applications. However, standing up a reliable Kafka system involves more than just Kafka brokers. Components like Zookeeper, Kafka Clusters, Confl...
Hey data folks! 👋 Apache Kafka offers a robust ecosystem for handling high-speed data streams and is widely used in various industries for applications such as event-driven architectures, real-time analytics, and data integration. In this blog, we w...
Designing and implementing a notification system that can send various types of notifications (e.g., email, SMS, push notifications) based on user preferences. Quick Links:System Design VideoProject Demonstration VideoIt is recommended to go through ...
I almost gave up trying to configure Custom Partitioner Class using application.properties. spring.kafka.producer.partitioner.class=classPath Does not work after trying a hell lot of things. The partitioner.class remained null everytime. I even trie...
As a cybersecurity master's student at Manchester Metropolitan University, I embarked on a life-changing journey by attending the Kafka Summit London 2024 on a student scholarship by Danica Fin. This conference, expertly organized by Confluent, becam...
We've got some great news to share with the Squid community! Squid AI now seamlessly integrates with Confluent, a popular Apache Kafka Cloud service, to bring you a new powerful feature: Squid Queues. This integration simplifies how you handle data s...
Introduction In this tutorial, we will explore how to create a custom Kafka serializer in Java. We'll implement a serializer that adds "hello" to the beginning of every message. This can be a handy tool if you want to isolate logic from your app and ...
