Use Case
2:00 PM, UTC+8; 10:00 PM, UTC-8; 11:30 AM, UTC+5:30 , November 20
Keeping on top of hybrid cloud usage with Pulsar
This presentation will cover how we force controls on an application over a hybrid cloud infrastructure built from a combination of different clouds that could include private and public clouds. For instance, you could deploy your microservice in AWS but use BigTable as your data store.
Every cloud or on-premise infrastructure provider provides monitoring, alerting, metering, audit trail etc. In a hybrid cloud use case, the IT team needs a single view of the usage across the cloud providers. Such a platform needs to combine the data sourcing of these utilities from different infrastructure providers, parse them into a common format and build an integrated data sink. Adding to it the challenge of each data source evolving its data formats, volume, velocity, throughput, latency etc. You have a challenging task to understand data from varied sources and present it in one view.
We will present an architecture that has been battle-tested in production for over five years. The components include Pulsar, Flink, PostgreSQL, Redis, Neo4J DB, rule/ML engine etc., to name a few technologies.
After this presentation, you will learn more about
1. Combining infrastructure from multiple clouds and on-premise providers to build your application.
2. Appreciate the need for lambda architecture.
3. How to stream ever-evolving multi-schema data using pulsar
4. How to write custom rules over a stream analytics framework to make your application.
Speaker
Shivji Kumar Jha
Staff Engineer at Nutanix
Shiv is a an architect at Nutanix and heads the cloud data platform team helping Nutanix products with data storage- databases, messaging, analytics etc. With a team of 6, Shiv works on making apache pulsar, nats-server, druid, debezium, presto etc available as a platform for all of nutanix cloud products.<br />Shiv loves spending time on Data storage and MLOps related research and has contributed to MySQL and pulsar codebases. Shiv is an avid reader (tech, fiction, economics etc) and is always looking at ways to simplify software architectures.
Tarun Annapareddy
MTS-3 at Nutanix
Tarun is a developer at Nutanix and worked on building and maintaining the Flow Security Central product. In addition, Tarun developed a backend for the Security Planning feature for Nutanix Cloud users, allowing users to categorize their Virtual Machines and apply security policies. This architecture includes distributed systems like Apache Pulsar, Flink, and Druid. Tarun also writes articles on various open-source software developers use daily, such as Postgres.
