68. Schema Drift in Mapping Data Flow in Azure Data Factory

In this video, I discussed about Schema Drift in Mapping Data Flow in Azure Data Factory
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
#Azure #ADF #AzureDataFactory

[@sudipmazumdar5358]

Excellent video. Very Informative. Thanks a lot !!

[@WafaStudies]

Glad it was helpful!

[@santoshgshet]

Hi Maheer, the video is amazing.
I am looking for a solution to load multiple files into one SQL table in Azure. Issue is all these files are view extracts and the column names might shuffle. Is there a way to locate the common column names from all the files and load into the table through ADF?

[@arunkumarn6371]

Hi Maheer,
Thanks for the awesome video.
Is it possible to enable both schema drift and validate schema option? If so, will my pipeline fail on schema changes or will it run?
Thanks!

[@HarshitaVishwakarma-sd8kw]

I tried this practical demo but in my case I am getting country column as NULL while doing data preview after removing country column from source file. Also the schema drift box is unchecked.
Video-6:13

[@rathikavenkatesh2510]

Hi My db tables schemas getting changed, I m doing incremental copy data using upsert in pipeline. How to handle if any changes in schema by adding column., tables. Can you share the steps if possible.

[@kushalks9955]

Sir ,How can I delete that Country Column During Data flow so that ,the 'Country' column can't be used in future Dataflows.

[@kushalks9955]

Should I add Select Transformation in the next step to remove Country Column?

[@manojreddy8360]

@@kushalks9955 yes

[@harshitvishwakarma9076]

@@kushalks9955 but again it won't be generic.