High Level Design RocksDB is a high-performance embedded database for key-value data, designed for fast storage. In this post, I'll show you how to create a simple master-follower replication setup using RocksDB's backup and restore functionality. P...
When discussing system design, it is not uncommon to find multiple closely related terms that can be muddled up or conflated, one with the other. Two such terms are Replication and Redundancy. In good system design, it is important that a system is h...
What is ISR? ISR (In-Sync Replicas) is a fundamental concept in Kafka that represents a set of replicas that are in sync with the leader partition. This set includes the leader replica itself and all follower replicas that are actively syncing with t...
Websites are inherently read heavy. There are various technologies that help to serve content from CDNs to application level caching. Databases can also be configured with read only replicas. Read queries can routed to these servers alleviating the l...
Two-site stretch cluster: Handling Failures. In Part 2, we explored the hands-on deployment of a two-site IBM Storage Ceph cluster with a tie-breaker node using a custom service definition file, CRUSH rules, and proper service placements. In this fin...
Get Processing Range error Timeout Reason: It's because you have a CDC transaction not committed yet. Solution:Run DBCC OPENTRANIdentify the active sessions running the program: MSXDBCDC$OracleCDCService1$xxxxYourCDC Database End the sessionsReru...
Streaming replication in PostgreSQL ensures high availability and scalability by maintaining multiple copies of a database and continuously synchronizing standby nodes with the primary node. This guide walks you through setting up asynchronous stream...
Introduction When considering Replication, Disaster Recovery, Backup, and Restore, we choose from multiple strategies with varying SLAs for data and application recovery: Recovery Time Objective (RTO) and Recovery Point Objective (RPO). Synchronous r...
Thank you for coming to my blog post. I believe you would learn a thing or two at the end of reading and following through with my post. I have taken my time to document step-by-step details with pictorial evidence of how you can create a blob storag...
Need for Scaling Databases We have understood the importance of databases and how their various properties simplify life and make systems highly dependent on them. However, databases have fixed storage capacity, and as data grows, we need to increase...