Incremental Data Loading from an ERP System into Azure Data Lake Using Azure Data Factory

Поділитися
Вставка
  • Опубліковано 25 сер 2024

КОМЕНТАРІ • 12

  • @thenarathnegadamithchandan5226
    @thenarathnegadamithchandan5226 4 роки тому +1

    Good one..! Thanks for sharing..👌

  • @vemarajulasya9585
    @vemarajulasya9585 3 роки тому +1

    really good content. thanks for the video. and please upload more videos on data loading from a particular source to data ware house step by step.
    please!!

  • @damithchandanathenarathnag6408
    @damithchandanathenarathnag6408 4 роки тому +1

    Good one..!

  • @anujgupta8686
    @anujgupta8686 4 роки тому +1

    please upload more videos on azure data factory incremental loading using merge. and how to use dynamic expression s

  • @dileepkanumuri
    @dileepkanumuri 3 роки тому +2

    Nice video! I have a doubt. Will ADF handle incremental changes on the source DB like Deletes and Updates to the records?

  • @khana04
    @khana04 3 роки тому +2

    what if I have multiple table under my Copy activity using for each loop , and each table have different column to identify delta , is that possible or this has to be one table copy at a time

  • @anthonberg3274
    @anthonberg3274 3 роки тому +1

    Great video! The code for the demo M3 database is not something you would like to share? Thanks!

  • @anujgupta8686
    @anujgupta8686 4 роки тому +1

    if daily data is coming in my blob storgae I need to insert in my sql tables how to do it automativally. I have 10csv and each csv contains each table details i.e 10 csv and 10 tables in my azuresqldb need to be inserted.

    • @learnnrelearn7553
      @learnnrelearn7553 4 роки тому +1

      You can create a azure function to be triggered once your storage gets some data. The azure function will invoke the azure data factory which can perform the delta load and archive the csv file.
      Hope you this answer will help you, please let me know.

  • @gauravmodi1061
    @gauravmodi1061 4 роки тому +2

    If I want all the incremental data in a single file like lets I have done a full load of a table "users" now I want that the Incremental data but in the same file not indifferent date wise file so is that possible.

    • @learnnrelearn7553
      @learnnrelearn7553 4 роки тому +3

      Yes, it is possible by choosing a static file as sink and merge the data into it by using 'Union'.
      Please let me know if this helps

    • @Vigneshvaraa
      @Vigneshvaraa 4 роки тому +1

      Hi Gaurav modi,
      Exactly am looking for this requirement is this possible to load the updated incremental changes in same file???