Keynote

9:50 AM - 10:20 AM, CEST , May 23

Challenges of Hosting a Pulsar-as-a-Service Platform Under a Shared Responsibility Model

We are collaborating with StreamNative to host Pulsar as a service platform that is used across different domains at the LEGO Group. However, even with the great help from our partners we still have to address number of challenges to enable and manage this platform for our end users. To do so our engineering teams have developed an internal platform for managing discoverability and access control for enabling Pulsar across product teams. In this talk we will describe how we leverage OAuth2 for authentication and manage Pulsar resources and their permissions through our fully self-service management platform. Additionally, we will present our tooling for observability where we utilize off the shelf cloud native tools such as Prometheus and OTel collectors as well as internally developed tools for gathering metrics from Pulsar and collecting all our observability data into a shared ELK stack. Lastly, we will mention on how we help our end users with the best practices when using Pulsar clients implemented in different programming languages such as C#, Python, JavaScript and Rust as well as exploring new ways of producing and consuming without using Pulsar protocol which opens up new possibilities for using serverless technologies.

Speaker

Edgaras Petovradzius

Sr. Engineer, the LEGO Group

Mathias Ravn

Engineer, the LEGO Group