Technology Deep Dive

12:30 PM - 1:05 PM, PT , Thur Jun 17

How Big Is Too Big? Message Size in Pulsar

Send big files is always tricky when working with brokers. Pulsar has several options depending on the use case, size of the message and frequency of big files. In this talk, we'll review the different options (increment MaxMessageSize, PIP-37 chunking feature or send them to blob storage) identifying their trade-offs of each one and the optimal message sizes for each use case.

Speaker

Antón Rodríguez

Principal Software Engineer, Galiglobal

Antón is Principal Software Engineer focused on Data Streaming. He has experience working with different message brokers, event streaming platforms and stream processing frameworks. During his career, he specialized in building internal SaaS in big corporations to make complex technologies easily used and adopted by engineering teams.