Coffee Break

Tag: #kafka

March 7, 2023

Raft – the most popular distributed database consensus algorithm

Concepts of Raft Rules for Safety in the Raft protocol The Raft protocol guarantees the following safety against consensus malfunction by virtue of its design : Raft Alternatives Fault ScenariosQ: What happens when one of the nodes have network issues for extended amount of time? A: Assuming a majority consensus consistency is still able to commit…

Engineering

#architectures, #cockroach-db, #kafka, #raft
January 23, 2023

Data Mesh @ Netflix

Takeaways: Ref:

Engineering

#etl, #flink, #kafka, #netflix
January 13, 2023

MemQ Pub/Sub + Kafka @ Pinterest

Data Flow MemQ Components Storage MemQ Data format Takeaways: References:

Engineering

#kafka, #memq, #pinterest, #pubsub
December 31, 2022

Why Trello Chose Kafka over RabbitMQ?

RabbitMQ RabbitMQ implementation looks like a separation of concern however, when there are any issues during the operation, there is a synchronous failure on many parties. Hence RabbitMQ is not exactly an ideal distributed queue system. Bad things happen when a failure occurs: Three ways a failure can occur: Network issues happen very frequently, I…

Engineering

#kafka, #rabbitmq, #redis, #trello