AI

11:40 AM - 12:30 PM, PST , October 29

Making Kafka Connectors Dance with Apache Pulsar

In this presentation, we introduce our cutting-edge framework designed to run Kafka connectors natively on Apache Pulsar without relying on the traditional Kafka Connect Herder deployment. Our solution leverages a serverless model and fully integrated with Kubernetes for scheduling, ensuring a fully cloud-native experience. This approach not only broadens the robust ecosystem of Pulsar to include Kafka streaming processes but also enables the seamless reuse of existing Kafka connectors within Pulsar.
We'll explore the architecture, technical challenges, and performance optimizations involved in building this integration. Expect practical demonstrations, real-world use cases, and an in-depth look at how our solution can revolutionize your stream processing pipelines. Whether you're a Kafka enthusiast looking to modernize or a Pulsar advocate seeking enhanced functionality, this session offers invaluable insights into orchestrating streamlined, scalable, and efficient streaming pipeline in a cloud-native environment.

Speaker

Jobin George

Partner Engineering Lead, Google Cloud

Neng Lu

Director of Platform, StreamNative

Rui Fu

Staff Software Engineer, StreamNative

View Videos

Sign up for the Data Streaming Newsletter

© Copyright 2020 - 2025 StreamNative. All rights reserved

Apache, Apache Pulsar, Apache Kafka, Apache BookKeeper, Apache Flink, and associated open source project names are trademarks of the Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation. The Apache Software Foundation has no affiliation with and does not endorse, or review the materials provided at this event.