Use Case

3:00 PM - 3:30 PM, CEST , October 6

Writing Custom Sink Connectors for Pulsar I/O

You currently have massive amounts of data sitting on Apache Pulsar and likely — even more data coming in every second. But part of your project requires this data to be sent to some system to explore the dataset further. You look into the Pulsar website for built-in connectors to that particular system and realize that there are none. What a bummer.
But you don't have to give up on Pulsar because of this. You can write custom sink connectors for Pulsar I/O that work just like the built-in ones, and all you will need is a bit of Java development experience and creativity. The rest you can leave to this talk. This talk will explain how to start developing your custom connector, show how the code looks like, demonstrate how to deploy, and discuss some of the design decisions that your custom connector may need to address.

Speaker

Ricardo Ferreira

Principal Developer Advocate, Elastic

Ricardo is Principal Developer Advocate at Elastic — the company behind the Elastic Stack (ElasticSearch, Logstash, Kibana, Beats) and Elastic Cloud, where he does community advocacy for North America. With +20 years of experience he specializes in Streaming Data, Big Data, Analytics, NoSQL, and Cloud. Prior to Elastic he worked for other vendors such as Confluent, Oracle, and Red Hat, as well as several consulting firms. While not working he loves barbecuing on his backyard with his family and friends, where he gets the chance to talk about anything that is not IT related. He lives in North Carolina, USA with his wife and son. Follow Ricardo on Twitter: @riferrei.