Ecosystem

3:45 PM - 4:15 PM, CEST , May 23

Documentation as Configuration for Management of Apache Pulsar

We are collaborating with StreamNative to host Pulsar as a service platform that is used across different domains at the LEGO Group. The way our users use this is through a documentation-based approach where they don't have access to the management console themselves, but rather rely on uploading AsyncAPI specifications defining the topics they want and settings they want, to our platforms. Documentation as Configuration has a number of challenges regarding parsing and interpreting the specs, not to mention effectuating them on the broker, but we believe the advantages far outweigh the challenges. In this talk we'll cover the advantages and disadvantages of utilizing documentation based configuration, including the challenges in configuring Pulsar for this use case. We'll cover tying Apache Pulsar and AsyncAPI specs together, including our work to move from specification extensions ("X-" properties) to creating proper Apache Pulsar bindings for AsyncAPI, including a C# library (https://github.com/LEGO/AsyncAPI.NET ) to support this. Finally we'll cover how we create the managed infrastructure from the spec in practice and how various properties from AsyncAPI are reflected in terms of namespaces, topics and subscriptions in Pulsar.

Speaker

Alexander Wichmann

Sr. Engineer, the LEGO Group

Ulrik Boll Djurtoft

Sr. IT Engineer, the LEGO Group