Azure Data Factory - Dynamic File Names with expressions

In this video we take a look at how to leverage Azure Data Factory expressions to dynamically name the files created. This of course makes it easier to also make pipelines and datasets reusable.
Like what you see and want more training? Check out www.PragmaticWorks.com!
#MitchellPearson #MitchellSQL

[@mendalin123999]

This is a very underrated channel!! Super helpful! 🙏🏽

[@dwaynecarroll6098]

Thank you for this excellent example in beautiful, clear English!

[@gautam26trivedi]

Hey Man, You rocked, Awesome.
Your Explanation was so clear & step by step that I understood the dynamic concat concept.
Hoping more videos on Function parameters

[@jaredaugust4893]

Thanks for making this -- it was super easy to follow and helpful!

[@mkiserbb]

Very helpful !! Thanks for demo’ing this, Mitchell!!

[@MitchellPearson]

Thanks Mike!

[@vivaanalbert6643]

a trick : watch movies on KaldroStream. Been using them for watching loads of movies recently.

[@finnbrody8379]

@Vivaan Albert yea, have been watching on KaldroStream for since november myself =)

[@terrelllayne2050]

@Vivaan Albert Yea, I have been using kaldroStream for since december myself :D

[@deckerraul2946]

@Vivaan Albert yup, I've been watching on KaldroStream for months myself =)

[@louisar4227]

I’m really trying to learn this with using an Excel Source and an SQL table as my sink destination. I need that SQL table to use that excel file name. Do you have a video for that???

[@AbgarMusayelyan]

How do you set the value of FileName from the copy activity?

[@luisafernandarodriguez1593]

Thanks for your video, good explanation!

[@gayanitweety]

Straightforward

[@EB-sh6yg]

Thank you One thousand TIMES

[@Rodri-xfit]

Hi, thanks for this video. It has helped me a lot. However, I still have a problem with the source SQL table and the JSON sink. I want one JSON file per record, but I can only generate one JSON file for the entire table. Any hints on how to reference the ID of each record in the file name?

[@fudhater8592]

7:06 Can't you use formatDateTime?

[@ijeomaossai1373]

Hi Mitchell, your videos always rock. Thanks. I was able to load files to blob storage but when I attempted to load the same file into SFTP, I keep getting an error that the file path does not exit. Apparently, it believes the expression together with the root directory is the file path. When I put an empty text file and remove the expression I was able to load it. Do you please have any tip that would be helpful to load data to SFTP?

[@jsyrhanns925]

having similar challenges with Azure Synapse Analytics ASA pipeline COPY activity; child dataset(s) appear not to be differentiating FILEPATH from FILENAME. and we will figure this out sooner or later, but hopefully sooner with help from Mitchell. impressions are these are new tech capability challenges and working out related kinks is active work in progress😊

[@kannibala1]

Hi
How to use multiple wildcards to filter a files from a share path?
For example, I have the files like .json, .csv, .txt, .xml, .xls
I could like to copy only .json and .xml.. How to do it? Thanks in Advance

[@alfianprayanta]

Many thanks Bro

[@harishkonakandla]

can you please make a video on SCD in ADF

[@MsEdward1990]

Thank you for very useful video

[@MitchellPearson]

Glad it was helpful!

[@dayasandhu5630]

What do you write in the sink and source for the copy activity?

[@ssbeats677]

What if we have multiple formate files in our folder eg. Few are .csv and few are .txt file ?

[@penchalaiahnarakatla3378]

Hi Michael, how rename file name. In blob. I verified so many you tube channels. But I didn't got. It useful if you make this video please.

[@MitchellPearson]

Hey, you can rename blobs directly from Azure Storage Explorer.

[@penchalaiahnarakatla3378]

Good

[@MitchellPearson]

Thanks!