Engineering – Coffee Break

July 14, 2025

Improving Query Performance via PostgreSQL Table Partitioning – Part II

Welcome to Part II series of exploring postgresql partitioning. If you haven’t already checked out Part I, it has some pre-requisite information. This helps you find out if partitioning is the right solution for you, as it did for me. Table of Contents Key Information To Know Before Starting Partitioned Table Characteristics In addition, I…

Code Snippets, Engineering

#database, #partitioning, #postgresql, #python, #sql
July 13, 2025

Improving Query Performance via PostgreSQL Table Partitioning – Part I

Intro: At work I created a new set of tables to fulfill the business needs. Unfortunately for the first time around, I couldn’t set aside the time consider maintenance of the tables as it was premature to even consider if the business idea would be successful. So, I decided to work on it another time.…

Code Snippets, Engineering

#database, #partitioning, #postgresql, #sql
May 6, 2023

Rendezvous Hashing – alternative to Consistent Hashing

Rendezvous Hashing (Also known as Highest Random Weight Hashing) Python Snippet With the above explanation, it seems the use of rendezvous hashing is quite limited. Below are some real world examples: Other Hashing Algos References:

Engineering

#architectures, #hashing, #load-balancer, #systems-design
April 17, 2023

What is Consistent Hashing?

Hash Ring Concept Consistent Hash Pitfalls Data stores that uses Consistent Hashing Alternatives References:

Engineering

#architectures, #database, #hashing, #systems-design
March 20, 2023

Why Pinterest Moved to HTTP/3?

Features HTTP/1.1 HTTP/2 HTTP/3 Request-response model Client sends one request, server sends one response Client sends multiple requests, server responds with multiple responses Client sends multiple requests, server responds with multiple responses Multiplexing No, each request-response pair requires a separate connection Yes, multiple requests and responses can be sent over a single connection Yes, similar…

Engineering

#http, #http/3, #pinterest
March 7, 2023

Raft – the most popular distributed database consensus algorithm

Concepts of Raft Rules for Safety in the Raft protocol The Raft protocol guarantees the following safety against consensus malfunction by virtue of its design : Raft Alternatives Fault ScenariosQ: What happens when one of the nodes have network issues for extended amount of time? A: Assuming a majority consensus consistency is still able to commit…

Engineering

#architectures, #cockroach-db, #kafka, #raft
February 8, 2023

Monoliths to Microservices @ Khan Academy

Choosing the New Programming Language Planning Work To Be Done Migration Strategy Takeaways: References:

Engineering

#khan-academy, #microservices, #monoliths
February 1, 2023

Do I Need Kubernetes?

Intro Costs Management Costs and Learning Curve Migration Costs Monetary Costs/Opportunities A side note, Netflix built something similar called “Titus” looking to solve similar use cases like large scale deployments and orchestration. See below Titus Architecture – look somewhat similar. Kubernetes Titus References:

Engineering

#architectures, #k8s, #kubernetes
January 23, 2023

Data Mesh @ Netflix

Takeaways: Ref:

Engineering

#etl, #flink, #kafka, #netflix
January 20, 2023

Git Internals Part I

Object Store Differences between Git and Relational DBs Ref:

Engineering

#git, #github

Category: Engineering