Hey data folks! 👋 Apache Kafka offers a robust ecosystem for handling high-speed data streams and is widely used in various industries for applications such as event-driven architectures, real-time analytics, and data integration. In this blog, we w...
Designing and implementing a notification system that can send various types of notifications (e.g., email, SMS, push notifications) based on user preferences. Quick Links:System Design VideoProject Demonstration VideoIt is recommended to go through ...
I almost gave up trying to configure Custom Partitioner Class using application.properties. spring.kafka.producer.partitioner.class=classPath Does not work after trying a hell lot of things. The partitioner.class remained null everytime. I even trie...
As a cybersecurity master's student at Manchester Metropolitan University, I embarked on a life-changing journey by attending the Kafka Summit London 2024 on a student scholarship by Danica Fin. This conference, expertly organized by Confluent, becam...
We've got some great news to share with the Squid community! Squid AI now seamlessly integrates with Confluent, a popular Apache Kafka Cloud service, to bring you a new powerful feature: Squid Queues. This integration simplifies how you handle data s...
Introduction In this tutorial, we will explore how to create a custom Kafka serializer in Java. We'll implement a serializer that adds "hello" to the beginning of every message. This can be a handy tool if you want to isolate logic from your app and ...
Introduction In This Article, we'll look into How we can build a streaming data pipeline using Confluent Kafka and Spark Structured Streaming on Dataproc(GCP). Objective: Create a Confluent Kafka Topic and Stream events from Kafka to Google cloud sto...
If you're working with databases, you've probably heard of Kafka, Kafka Connect, and connectors. In a nutshell, Kafka is a distributed streaming platform that allows you to publish and subscribe to streams of records, while Kafka Connect is a framewo...
Rules of Thumb We're taught early and often that any I/O Bound operations should be done Asynchronously. A general rule of thumb is that anything that takes more than 50ms should be done async. While this is quite true in most cases, sometimes, just ...
Confluent a leading data streaming specialist company has signed a definitive agreement to acquire Immerok – a leading Apache Flink cloud provider for building powerful cloud-native Apache Flink offerings. As per LinkedIn, Confluent was founded in th...
