Ecosystem

15:45-16:30, UTC+8 , January 15

Design, Development, and Use of the New Flink-based Pulsar Connector

Pulsar Flink Connector provides an ideal solution for unified batch and streaming with Apache Pulsar and Apache Flink. In the latest Apache Flink 1.14 version, Flink added the Apache Pulsar Connector. The Pulsar connector reads data from Pulsar topics and supports both streaming and batch execution modes. With the support of the transaction functionality (introduced in Pulsar 2.8.0), the Pulsar connector provides exactly-once delivery semantic to ensure that a message is delivered exactly once to a consumer, even if a producer retries sending that message.
This session will be focusing on illustrating that how does Apache Pulsar, a cloud-native message and streaming data platform, integrates with the Apache Flink Unified APIs? We'll walk you through the design, implementation, and use of the new Pulsar Connector.

Speaker

Yufan Sheng

Apache Pulsar/Flink Contributor, StreamNative Software Engineer

View Videos

Sign up for the Data Streaming Newsletter

© Copyright 2020 - 2025 StreamNative. All rights reserved

Apache, Apache Pulsar, Apache Kafka, Apache BookKeeper, Apache Flink, and associated open source project names are trademarks of the Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event.