Zerodha's Tech Magic: How They Cut Processing Time from 8 Hours to 25 Minutes!

Curious for more details?

Check out the full story here and get ready to be wowed by the tech journey of Zerodha!

Hey there finance enthusiasts! Today, we're diving into the tech world of Zerodha, the cool company that's making waves with their impressive engineering skills. They recently pulled off something amazing – slashing the time it takes to process a whopping 1.5+ million PDF contract notes from 8 hours to just 25 minutes. Now, that's some serious efficiency!

So, here's the lowdown on how they did it. Imagine having to deal with tons of contract notes that need to be sent out to customers every day after executing stocks. It used to take Zerodha ages, like 7 to 8 hours, to get this done. Why? Well, their old system was running on this giant server that handled everything in one go. Not the fastest or smartest way to get things done.

Now, picture this: Zerodha's new setup is like a superhero – fast, smart, and elastic. They switched to a horizontally scalable system, which means they can tackle tasks independently and way more efficiently. Amazon's S3 storage does the heavy lifting, processing files with each worker node managing different parts of the job.

They brought in Redis, not just for storing job info, but also to act as a kind of traffic cop, making sure each worker knows what it needs to do. EC2 instances take care of the nitty-gritty, writing results to shared storage on S3. And here's where the magic happens – they use Nomad and Terraform to orchestrate everything, setting up clusters with auto-scaling groups for different tasks like making PDFs, sending emails, and signing PDFs.

For the behind-the-scenes admin stuff, Zerodha uses Rundeck, a handy tool that keeps everything in check. Once the heavy lifting is done, they clean up shop using a monitoring system and Redis. The result? A process that used to take 8 hours is now a blink-and-you'll-miss-it 25 minutes.

Zerodha's tech makeover not only sped things up but also made the whole system more flexible and cost-effective. It's another win for the wizards at Zerodha, who never fail to impress with their engineering prowess.

#zerodha #devopschallenge #DevOps