Exactly-Once Processing in Apache Flink
Вставка
- Опубліковано 28 чер 2024
- Learn how Apache Flink® can handle hundreds or even thousands of compute nodes running 24/7 and still produce correct results.
Try Flink without worrying about the setup or configuration in Confluent Cloud: cnfl.io/4bhZZiQ
RELATED RESOURCES
► Apache Flink 101: cnfl.io/4b206zA
► Streaming Joins in Apache Flink: • How To Use Streaming J...
► Original paper on state management in Apache Flink from comments below: www.vldb.org/pvldb/vol10/p171...
► How To Use Streaming Joins with Apache Flink®: • How To Use Streaming J...
► How to Analyze Data from a REST API with Flink SQL: • How to Analyze Data fr...
CHAPTERS
00:00 - Intro
00:30 - What is Exactly Once?
01:05 - How Flink provides Exactly Once
01:23 - Flink Snapshots
02:55 - Visualize the Process
05:27 - Conclusion
-
ABOUT CONFLUENT
Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion - designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.
#apacheflink #flink #confluent - Наука та технологія
Dan here. Exactly once processing seems too good to be true when discussing real-time streaming applications. Yet because of Flink architecture, it’s achieved without causing long delays or other issues. What other topics would you like to see us break down? I also recommend checking out our Flink 101 course: cnfl.io/4b206zA