Diljit’s Abode

Web URL Scraping: Designing a High-Throughput URL Crawler with Efficient Storage

Web scraping at scale presents significant challenges, especially when dealing with millions of hyperlinks per request and handling 10,000+ requests per…

Mar 16 • 

Diljit

Mastering System Design Interviews: A Simple Framework to Ace the Process

System design interviews can be some of the most challenging parts of the hiring process for any technical role.

Mar 14 • 

Diljit

February 2025

BRIN vs B-Tree Index in PostgreSQL: When to Use Which

Indexes are essential for optimizing query performance in PostgreSQL.

Feb 2 • 

Diljit

September 2024

Categorizing Tests in JUnit 5 and Running Different Categories with Gradle

Improving build time by categorising the tests and running them concurrently

Sep 13, 2024 • 

Diljit

Using Merkle Trees to Detect Data Variance Between Two Data Stores

In distributed systems, ensuring data consistency across multiple data stores is crucial.

Sep 2, 2024 • 

Diljit

Building and running a distributed data variance tool successfully in production at Wayfair

Fixing data sync issues during data movement in a large scale distributed system.

Sep 1, 2024 • 

Diljit

 and 

Gitesh Jain

1

August 2024

Applying better interview aesthetics.

Let’s talk about interviewing, particularly in the context of engineering interviews, and my journey to becoming better at it, including the skills I…

Aug 8, 2024 • 

Diljit

Tshark, Wireshark’s sibling – the power of command line.

You might have heard about tool called Wireshark which is a popular network analyser. While whileshark gives you the user interface to do most of the…

Aug 8, 2024 • 

Diljit

Running a 3 node home lab cluster from refurbished Lenovo ThinkCenter.

I’ve been running this gig since over 3 years, so thought why not write a blog that describes the setup and what it takes to build and operate one.

Aug 8, 2024 • 

Diljit

Envoy Fundamentals

What is Envoy?

Aug 8, 2024 • 

Diljit

Building a real time streamable online FM radio player for fun!

I always wanted to play around with how real-time streaming protocol works and I did dive into modern protocols like HLS, RTMP, DASH/MPEG-DASH, and HDS…

Aug 8, 2024 • 

Diljit

1

How Airline Reservation System works under the hood?

Have you ever wondered what goes when you go book a flight on your favourite application in the likes of Expedia, Booking.com, Agoda or several others?

Aug 8, 2024 • 

Diljit