Technology Deep Dive

1:00 PM - 1:35 PM, PT , Wed Jun 16

Replicated Subscriptions: Taking Geo-Replication to the Next Level

Replicated subscriptions is a powerful feature that was recently added to Pulsar. It allows for applications to implement very sophisticated cluster-level failover strategies, by keeping the subscription status in-sync across different clusters.
With replicated subscriptions, a consumer can switch to a different cluster and resume the consumption from a position very close to where it left off before.
This session will explore various patterns of cluster failover, when it is appropriate to use them and the different tradeoffs of each approach.
After that, we will dive into the implementation of the replicated subscriptions mechanism, to show how using a distributed protocol, Pulsar is able to establish associations for a given message across multiple different data-centers, while exchanging control messages through the replication data path.

Speaker

Matteo Merli

Pulsar PMC Chair and CTO, StreamNative

Matteo Merli is the PMC Chair of Apache Pulsar and CTO at StreamNative. He is co-creator of Pulsar while at Yahoo!, co-founder of Streamlio, Committer and PMC of Apache Pulsar and Apache BookKeeper. He works for The Apache Software Foundation for 4+ years, and has rich experience in distributed pub-sub messaging platform.