ksqlDB HOWTO: Split and Merge Kafka Topics

Поділитися
Вставка
  • Опубліковано 30 січ 2025

КОМЕНТАРІ • 14

  • @BrunoMendonça-w3m
    @BrunoMendonça-w3m 10 місяців тому

    I'm attempting to create a stream from a multi schema topic, similar to the train example at the end of this video. I would then split into multiple streams/topics for each message type. However, I can't seem to create the stream in a way that it's populated with the messages from the multi schema topic. Is there an actual example you can reference for this scenario?

  • @brunobule9762
    @brunobule9762 3 роки тому +2

    KSQL is so incredible. (from Angola)

    • @rmoff
      @rmoff  3 роки тому +1

      It certainly is :)

  • @mathiasyeremiaaryadi9097
    @mathiasyeremiaaryadi9097 Рік тому +1

    Can we make the insert query persistent ? So then it will be running automatically, not at that time when we write the query

  • @ashvanthkumarselvakumaran5874
    @ashvanthkumarselvakumaran5874 2 роки тому +1

    Can I consume from two topics in one Kafka instance, then combine and push it to another Kafka instance?

    • @rmoff
      @rmoff  2 роки тому

      ksqlDB can only connect to one Kafka cluster at a time. Please head over to www.confluent.io/en-gb/community/ask-the-community/ for more help with this requirement.

  • @mickeyp1291
    @mickeyp1291 3 роки тому

    is the schema created reused or called ORDERS_COMBINED-value ? or can you use another name ?

    • @rmoff
      @rmoff  3 роки тому

      The schema is tied to the topic, and inherits (but does not reuse) the parent schema. IIRC it'll take the name of -value by default.

  • @foolaris
    @foolaris 3 роки тому +1

    That is what we need, awesome!

    • @rmoff
      @rmoff  3 роки тому

      Thanks :)

  • @Evkayne
    @Evkayne Рік тому

    thank you

  • @aldovc
    @aldovc 3 роки тому

    I noticed that topics and streams are mentioned interchangeably, it it safe to assume the concepts are essentially the same but their usage is where we find the differences? Thank you

    • @rmoff
      @rmoff  3 роки тому +1

      Hi Aldo, a stream is a topic but with a schema declared. Both are immutable unbounded streams of events :) Let me know if that answers your question.

    • @aldovc
      @aldovc 3 роки тому

      @@rmoff Thank you for your reply! It makes a lot of sense now. Great content, keep it up!