AI

4:10 PM - 4:30 PM, PST , October 29

VERA: The Engine Revolutionizing Apache Flink

Apache Flink is one of the most popular stream processing frameworks in the world, used by nearly 2k companies for real-time analytics and applications. But since the publication of State Management in 2017, workloads, deployments, and storage models have changed, evolving significantly, while the State Management architecture has stayed relatively the same.
Enter VERA: the cloud-native engine built to adapt OS Flink into the modern era, specifically to address those evolving changes and advancements in workloads, deployments, and storage models.
In this talk, we’ll explore what VERA is, how VERA helps to democratize stream processing, how VERA addresses OS Flink limitations and how VERA ultimately helps businesses to solve both batch and streaming use cases.
We’ll explore the three core pieces (pillars) of VERA: Streaming Data Movement, Real-time Stream Processing, and Streaming on a Lakehouse, and how they are tailored for seamless support of data ingestion (connectors), stream processing in real time (Flink), and streaming Lakehouse architecture.
Specifically, we’ll discuss how VERA tackles the challenges of:
* Evolving Apache Flink to run natively in modern cloud environments
* Providing updated fault tolerance; i.e Flink’s checkpointing
* And how VERA solves inherent challenges with large stateful applications
By the end of this session, you’ll understand what VERA is, why it was built, and how VERA revolutionizes Apache Flink.

Speaker

Ben Gamble

Field CTO, Ververica