Keynote

1:20 PM - 1:50 PM, CEST , October 6

Pulsar in the Lakehouse: Apache Pulsar™ with Apache Spark™ and Delta Lake

In this session, we provide an overview of the “Lakehouse” architecture and how Apache Pulsar™ can be used to support this architecture through integrations with the Apache Spark™ and Delta Lake to build your reliable data lake. We will also discuss the current state of Pulsar + Spark & Delta Lake connectors and discuss real world use cases and present the roadmap on what you can expect in the future of integrations between Spark, Delta Lake, and Pulsar communities.

Speaker

Addison Higham

Chief Architect and Head of Cloud Engineering, StreamNative

Addison Higham has deep experience with streaming technologies such as Flink and Spark. Seeking a new stream storage technology for his previous company, Instructure, Addison discovered Pulsar and quickly became a Pulsar champion and drove the company’s adoption of the technology. Addison then joined StreamNative, where he leads development of StreamNative Cloud and helps customers to successfully adopt Pulsar. Addison lives in Salt Lake City, Utah.

Ryan Zhu

Apache Spark PMC Member and Committer, RxJava Committer, Staff Software Engineer, Databricks

Ryan Zhu is a Tech Lead of Delta Ecosystem team, a Staff Software Engineer at Databricks, an Apache Spark committer and a member of the Apache Spark PMC. He is one of the core developers of Delta Lake and Structured Streaming.