Ecosystem

1:30pm-2:10pm UTC+8 , November 29

Apache Pulsar + Flink: the Path to Unified Batch and Streaming

Apache Flink is a framework and distributed processing engine for stateful computations over unbounded and bounded data streams. Although Apache Flink supports unified batch processing and streaming computing, most streaming storage systems are not able to support it. The unique design of Apache Pulsar is combined with some new features currently under development to solve this problem. In this talk, I will introduce the new features brought by batch and stream integration, such as parallel batch reading using batch processing workload, Key_Shared subscription, etc.

Speaker

Jia Zhai

Jia is the core engineer of StreamNative, as well as PMC member of Apache BookKeeper and Apache Pulsar. He contributes to Apache BookKeeper, Apache Pulsar and Apache DistributedLog continually. Before his work at StreamNative, Jia worked as the core engineer at Streamlio, the Principal Engineer and technical leader at EMC Beijing. He mainly focused on distributed storage service, and big data infrastructure.

View Videos

Sign up for the Data Streaming Newsletter

© Copyright 2020 - 2026 StreamNative. All rights reserved

Apache, Apache Pulsar, Apache Kafka, Apache BookKeeper, Apache Flink, and associated open source project names are trademarks of the Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event.