20. Schema Mapping in Copy activity of ADF pipeline

Поділитися
Вставка
  • Опубліковано 14 жов 2024
  • In this video we learnt about Schema Mapping in Copy activity of ADF pipeline #adf #azuredatafactory #datafactory #azuresynapseanalytics #synapseanalytics #microsoft #cloud #cloudcomputing #dataengineer #dataengineering #dataengineeringessentials #azure #azurelearning #azurecontentannu

КОМЕНТАРІ • 19

  • @sagardevara4174
    @sagardevara4174 Місяць тому +1

    Really good stuff. Thanks for sharing!!

  • @azurelearner4055
    @azurelearner4055 9 місяців тому +2

    Simple and clear Explantion of schema mapping !!
    Thank you !!

  • @fpchd
    @fpchd 6 місяців тому +2

    thanks, this was very helpful!

  • @venkatpr9692
    @venkatpr9692 Рік тому +1

    Excellent lecture Annu
    Plz make more videos🦋🦋🦋

  • @ramrajendran8065
    @ramrajendran8065 Рік тому +1

    Good one ✌️

  • @joseangelmartinez308
    @joseangelmartinez308 6 місяців тому +1

    Hi Annu, this video was excellent!
    I was wondering, for the case of explicit mapping, when copying from hierarchical source to hierarchical sink, is it possible to add a column in the sink which is not present in the source? So for example, in your video, if you want to add a hardcoded column in your output JSON named ''status" and then fill it with value "active". Is it possible?
    And another questtion, can you build more complex sink structures based on the input data? For example, let's imagine that you need to have the 'fisrt_name' and 'last_name' from the source to be included in the output JSON within a JSON object named 'person_name', like: 'person_name' : {'firstname' : 'xxx', 'last_name': 'yyy'}, could you do that with the mapping? Or would we need a dataflow for more complex activities?

  • @sudhanshuranjan8526
    @sudhanshuranjan8526 4 місяці тому

    Hi ma’am
    Can we do this copy activity for delta table as sink.

  • @ATHARVA89
    @ATHARVA89 Місяць тому

    i have upwards of 500 columns in source xml files, which im trying to copy. But its giving me character exceeds limit of 8512 error. Any workaround in this case

  • @CGlassmates
    @CGlassmates Рік тому +1

    Thank you so much😊

  • @akrzha
    @akrzha 4 місяці тому

    24:30 What if we have multiple arrays in the source?

  • @sourabhsingh1315
    @sourabhsingh1315 Рік тому +1

    Hi Mam,
    How to join a column from another table in ADF.

  • @sanketchakane7745
    @sanketchakane7745 Рік тому +1

    my use case is if corrupt input data occurs then I want to log that data in sql table without using upsert, fault tolerance, enable logging or data flow , is there another way eg if string data comes instead of int then i want to skip that and record in table and dont interrupt rest run

    • @azurecontentannu6399
      @azurecontentannu6399  Рік тому

      Why not fault tolerance? It's the best and easiest way for this scenario

  • @t-rexrex9535
    @t-rexrex9535 Рік тому

    So who do you copy multiple csv file without headers and map them to existing tables in Azure without the pop_0 error?

  • @BittuBhowmick89
    @BittuBhowmick89 Рік тому +1

    I am trying to copy data from one sql table to another. but when i try to do import schema, i am not getting option to change the data type. pls guide me to undertstand the reason behind this

  • @ComedyXRoad
    @ComedyXRoad 9 місяців тому

    at 8:47 how table name is created we have used auto create but not given any table name