As event-driven architectures gain traction, the combination of Apache Kafka and NestJS has emerged as a compelling solution for building scalable, decoupled microservices. In this guide, we’ll explore how to integrate Kafka with NestJS using the bui...
Apache Kafka has evolved into the de facto standard for building real-time data pipelines and streaming applications. However, standing up a reliable Kafka system involves more than just Kafka brokers. Components like Zookeeper, Kafka Clusters, Confl...
Hey data folks! 👋 Apache Kafka offers a robust ecosystem for handling high-speed data streams and is widely used in various industries for applications such as event-driven architectures, real-time analytics, and data integration. In this blog, we w...
Designing and implementing a notification system that can send various types of notifications (e.g., email, SMS, push notifications) based on user preferences. Quick Links:System Design VideoProject Demonstration VideoIt is recommended to go through ...
I almost gave up trying to configure Custom Partitioner Class using application.properties. spring.kafka.producer.partitioner.class=classPath Does not work after trying a hell lot of things. The partitioner.class remained null everytime. I even trie...
As a cybersecurity master's student at Manchester Metropolitan University, I embarked on a life-changing journey by attending the Kafka Summit London 2024 on a student scholarship by Danica Fin. This conference, expertly organized by Confluent, becam...
We've got some great news to share with the Squid community! Squid AI now seamlessly integrates with Confluent, a popular Apache Kafka Cloud service, to bring you a new powerful feature: Squid Queues. This integration simplifies how you handle data s...
Introduction In this tutorial, we will explore how to create a custom Kafka serializer in Java. We'll implement a serializer that adds "hello" to the beginning of every message. This can be a handy tool if you want to isolate logic from your app and ...
Introduction In This Article, we'll look into How we can build a streaming data pipeline using Confluent Kafka and Spark Structured Streaming on Dataproc(GCP). Objective: Create a Confluent Kafka Topic and Stream events from Kafka to Google cloud sto...
If you're working with databases, you've probably heard of Kafka, Kafka Connect, and connectors. In a nutshell, Kafka is a distributed streaming platform that allows you to publish and subscribe to streams of records, while Kafka Connect is a framewo...
