Introduction to Schema Registry in Kafka | Part 1

Поділитися
Вставка
  • Опубліковано 18 січ 2025

КОМЕНТАРІ • 35

  • @jeetkp6186
    @jeetkp6186 9 місяців тому +1

    Best video out there !! I have been searching about the topic a lot , fortunately got this video , so good and easy to grasp the way you explained w diagram and explanation.

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  9 місяців тому

      Glad to hear the video is helpful to you @jeetkp6186! Happy Learning

  • @manojt7012
    @manojt7012 2 роки тому +3

    To be honest. I have been searching for a clear explanation on this Schema registry topic in many video. But your explanation was the best of best!

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 роки тому +1

      Glad to know the video is helpful to you Manoj T! You can check these 3 videos for Schema Registry hands-on --
      Introduction to Schema Registry in Kafka | Part 2
      ua-cam.com/video/46aZ6dqvswk/v-deo.html
      Using Glue schema registry for Apache Kafka Producer with Python
      ua-cam.com/video/2qKWs5_g8hU/v-deo.html
      Integration of AWS Glue Schema Registry & Kafka Consumer using Python
      ua-cam.com/video/q7XFcfE_TJ0/v-deo.html
      Happy Learning

  • @ADayinMyBrain
    @ADayinMyBrain 6 місяців тому +1

    This is exactly what i have been looking to know about Avro SR, Excellent, Thanks.

  • @bahamas1600
    @bahamas1600 3 місяці тому +1

    This is really very helpful. You have explained it in such a simplified manner. Thank you! 👏

  • @SHINEUPTILLAST
    @SHINEUPTILLAST Рік тому +1

    Man, the way you elucidate the topic is pretty amazing. You cleared all my concerns related to this topic. Thanks

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  Рік тому

      Glad to hear that Naman Jain! Happy Learning

    • @SHINEUPTILLAST
      @SHINEUPTILLAST Рік тому

      @@KnowledgeAmplifier1 I have one doubt in JSONSerializer the serialisation context we use whats the purpose of using that.

  • @dineshkarunanithi2286
    @dineshkarunanithi2286 Рік тому +2

    Really great explanation and keep up the good work. This really helps.

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  Рік тому

      Thank you so much for your kind words! I'm glad that my explanation was helpful for you, Dinesh Karunanithi. Stay Tuned

  • @praveensb4880
    @praveensb4880 Рік тому +2

    Thank you for this video.

  • @sagar7958
    @sagar7958 Рік тому +2

    Thank you. You teach well. Best of luck :)

  • @rabindrajaiswal5329
    @rabindrajaiswal5329 Рік тому +1

    Great, finally understood schema registry in very simple way
    Thank hou so much ❤

  • @anilsangula
    @anilsangula Рік тому +1

    Hi, May I know schema registry can we implement using windows as well. where can we get files, schema-registry-run-class and schema-registry-start files for windows.

  • @venuvr
    @venuvr 7 місяців тому +1

    Thanks a lot for the video

  • @babakdorani5914
    @babakdorani5914 Рік тому +1

    Thanks for this video

  • @rahulkakade1579
    @rahulkakade1579 2 роки тому +3

    Sir I'm going to create one poc using lamda,redshift ,glue ,s3 so I want to generate huge ammount of data for batch as well as streaming can you please make video how we can generate huge ammount of data

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 роки тому +3

      Hello Rahul kakade15, noted in backlog , in the meantime , you can try with Amazon Customer Reviews Dataset (s3.amazonaws.com/amazon-reviews-pds/readme.html) or you can generate fake date from this website -- www.mockaroo.com/

    • @rahulkakade1579
      @rahulkakade1579 2 роки тому +1

      @@KnowledgeAmplifier1 thanka you so much

  • @snehikpodder1018
    @snehikpodder1018 2 роки тому +2

    Really great explanation. Could you please make some video around subject name schema strategy when we have to support multiple schemas under one topic using python code examples?

  • @ohuuthai1678
    @ohuuthai1678 7 місяців тому

    Where will that topic be saved on the computer?

  • @SpiritOfIndiaaa
    @SpiritOfIndiaaa Рік тому +1

    #KnowledgeAmplifier thanks a lot bro. any vid on CONDUCTOR ?

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  Рік тому

      Hello SpiritOfIndia, I don't have any dedicated video on CONDUCTOR as of now , you can refer this channel -- www.youtube.com/@getconduktor/videos

  • @sanjaybedwal2385
    @sanjaybedwal2385 2 роки тому +1

    Nice video . One question though ..
    If schema validation is already happening at producer level . What are the chances or in which scenario does the schema validation can fail at consumer side ?

    • @KnowledgeAmplifier1
      @KnowledgeAmplifier1  2 роки тому +1

      Ideally it's not possible until and unless someone change the schema & the compatibility type in schema registry manually post the message published in kafka topic 🙂In consumer side schema registry is used for deserialization ...

    • @sanjaybedwal2385
      @sanjaybedwal2385 2 роки тому +1

      Sure thanks 🙏

  • @andreybraslavskiy522
    @andreybraslavskiy522 11 місяців тому +2

    It is not well explained. Always should be an example of failure. This video makes it hard to imagine when consumers can fail to parse the message. Following the video, it says that the consumer get an ID of the schema from the message itself. So how is it possible that the message will not match the schema if the message will not be published with this ID in case of mismatch in the first place?