The story comes from Pinterest in Mid 2020 that used Kafka to publish Logging data to interested parties. Data Flow Systems generating data –> Producer Logging Platform –> Pub/Sub (Kafka) –> Consumer Logging platform–> Extract data from related systems Separating storage and serving components which may have different parameters and requirement Custom replications and rebalancing…