17. ForEach Activity in Azure Data Factory | Azure data engineer
Вставка
- Опубліковано 12 вер 2024
- #azure #azuredataengineer #azuredataengineering #dataengineer
in this video of our azure data engineer playlist and we will learn about In this video, I discussed about ForEach Activity in Azure Data Factory
we will learn about
In this video, I discussed about ForEach Activity in Azure Data Factory
Azure data engineer playlist : • Azure Data Engineer
Join telegram to discuss t.me/+Cb98j1_f...
In this Azure Data Engineer playlists video, you will learn about Azure basics, Azure Data Engineer , and how to become an Azure Data Engineer. This is a must-watch video for everyone who wishes to learn Azure and make a career in it.
#dataengineer #bigdata #DataEngineer
can you please explain when we need to select file path and wild card file path
Hello bro I have a question here after in copy activity you didn’t select the file path and you also remove first row As a header and also change the option of import schema to none why? Please explain it don’t skip it so we can’t get what we need to.
CAN U DO THE SAME WITH A LOT OF EXCEL FILES??? I HACE TRIED, BUT IT S NO POSSIBLE
Will do that
i exceuted the same process as you mentioned in the video.my pipeline status is running sucessfully and data is not transferred to the output container
What is the issue
Why did we give .name in wildcard path?
What if the input container have multiple file formates(like 2 csv, 2 json and 2 avro) in this case how to use the for each activity to transfer data from input container to output container. can you please clarify it
Use get metadata + if condition
@@learnbydoingit Thank you in thhis we can not go with wildcard paths right?
I used the above process to get meta data activity and I check the 17th video as well but in this video when you selected the dataset automatically data set properties are coming so can you please tell me how to do that in video 17th we didn' see dataset properties
Are you not getting dataset properties?
@@learnbydoingit no i have tried so many times as per the video but no luck
This is unnecessary process we can simply select input folder then in Wildcard select * it will fetch all the files from there to destination folder
Yes this I showed how to use loop in adf .. We can do * also
suppose we have to loop only 50 files based on certain files name out of 100 files then?
Operation on target ForEach1 failed: Activity failed because an inner activity failed; Inner activity name: Copy data1, Error: ErrorCode=UserErrorSourceBlobNotExist,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=The required Blob is missing. Folder path: youtubecontainer002/SalesLT.Address.txt/.,Source=Microsoft.DataTransfer.ClientLibrary,'
Do ckeck ur source dataset