Context: Options for Horizontally scalable databases (to be performant as datasize becomes larger) Decided at the time that Cockroach DB was the best solution. Migration steps required Rewriting incompatible SQL code Load testing Migration When to use CockroachDB? Who uses CockroachDB? Special mentions: Ref:
categories:
tags:
The Traditional Approaches are below Testing Requirements: SLATE Tools to support SLATE testing Takeaways: Ref:
categories:
Below: Netflix’s A/B test Tooling back in 2001 Takeways: Ref: Original Blog Netflix Culture Netflix AB Testing
categories:
tags:
Logging Architecture How CLP Works CLP Implementation in Hadoop Environment Invented Custom Floating Point Encoding Finally: Ref: Original Blog Lossless vs lossy compression Zstandard
categories:
OLTP OLAP Final Data ingestion pipeline Personally not sure about the reason for introducing Kafka. Maybe there are other clients besides MySQL Implemented Client side out of order message updates: Takeaways: Ref:
categories:
RabbitMQ RabbitMQ implementation looks like a separation of concern however, when there are any issues during the operation, there is a synchronous failure on many parties. Hence RabbitMQ is not exactly an ideal distributed queue system. Bad things happen when a failure occurs: Three ways a failure can occur: Network issues happen very frequently, I
categories:
Post Dates:
Categories:
Tags:
#agile (1) #amazon (1) #architectures (4) #chatgpt (1) #clp (1) #cockroach-db (2) #communication (3) #data (3) #database (3) #decision-making (1) #edx (1) #ethos (1) #etl (1) #explicit-learnings (4) #FAANGs (1) #facebook (1) #fasting (1) #flink (1) #ghilbi-films (1) #git (1) #github (1) #hashing (2) #http (1) #http/3 (1) #influence (1) #k8s (1) #kafka (4) #kanban (1) #khan-academy (1) #kubernetes (1) #load-balancer (1) #logging (1) #logos (1) #memq (1) #meta (1) #microservices (1) #microsoft (1) #monoliths (1) #netflix (2) #one-signal (1) #open-ai (1) #opinion (1) #pandas (2) #partitioning (2) #pathos (1) #persuasion (1) #pinterest (2) #poems (1) #postgresql (4) #project-management (1) #pubsub (1) #python (3) #rabbitmq (1) #raft (1) #redis (1) #scrum (1) #sql (2) #storj-labs (1) #systems-design (2) #testing (1) #trello (1) #uber (2) dynamodb (1) grab (1) mysql (1) olap (1) oltp (1)