Exactly-Once Processing in Apache Flink

Поділитися
Вставка
  • Опубліковано 28 чер 2024
  • Learn how Apache Flink® can handle hundreds or even thousands of compute nodes running 24/7 and still produce correct results.
    Try Flink without worrying about the setup or configuration in Confluent Cloud: cnfl.io/4bhZZiQ
    RELATED RESOURCES
    ► Apache Flink 101: cnfl.io/4b206zA
    ► Streaming Joins in Apache Flink: • How To Use Streaming J...
    ► Original paper on state management in Apache Flink from comments below: www.vldb.org/pvldb/vol10/p171...
    ► How To Use Streaming Joins with Apache Flink®: • How To Use Streaming J...
    ► How to Analyze Data from a REST API with Flink SQL: • How to Analyze Data fr...
    CHAPTERS
    00:00 - Intro
    00:30 - What is Exactly Once?
    01:05 - How Flink provides Exactly Once
    01:23 - Flink Snapshots
    02:55 - Visualize the Process
    05:27 - Conclusion
    -
    ABOUT CONFLUENT
    Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion - designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io.
    #apacheflink #flink #confluent
  • Наука та технологія

КОМЕНТАРІ • 3

  • @ConfluentDevXTeam
    @ConfluentDevXTeam Місяць тому +3

    Dan here. Exactly once processing seems too good to be true when discussing real-time streaming applications. Yet because of Flink architecture, it’s achieved without causing long delays or other issues. What other topics would you like to see us break down? I also recommend checking out our Flink 101 course: cnfl.io/4b206zA