You made me so happy at 13:24 minutes, I was scared that something like this wasn't possible, I'm so glad that it is! This will simplify our life a lot. You are awesome, thank you so much!
Your videos are great.. I have an issue in XML Flatten/Parsing.. complex data Elements with different names but all names ends with same keyword and all of them has similar properties (Key/Description) and these elements present in multiple segments in hierarchy in 1000’s.. Need to extract all of them into key/Value pairs. Would you make one video on how to parse /flatten such elements..
Hi, Does this work also for SQL sources? For example I would have Region as lookup and I would like to pass this to export some data to csv files, so if I have 5 regions 5 files should be created with different region names In SSIS we could parametarize sql command for the souce, does ADF support that or we should use filter from ADF? Thanks
Hi sir....your explanation good....I know one thing ...data engineer is easy or not compare to ETL testing.....Azure data engineer mostly coding part ?..please clarify .
this is nice. But i ve got a situation where I have an excel file and my source is in azure sql server. I'm trying to get the azure sql server tabel filtered for the dynamic rules in the Excel file and then write it to a delta table. I've been looking at your example and tried to do this 1 on 1. however this requires something else. anyone recognizes this situation?
Hi, i am trying this same scenario using derived column instead filter... Column is not evaluating as expression... Is this possible? If not what is the alternate?
Only one problem your videos have is --- None of the files are shared. It is very difficult to find those files or creating those files. You could've uploaded those files because uploading is much faster than creating/searching those files. People who are checking these videos to learn ADF, have nothing to practice with. Watching only videos have no use. I hope you understand and will think about this concern.
Would you make video on parsing xml with this kind of elements.. and pull Key and Descriptions from all the segments .. Category_KEYS ID= 'AAAAAAA'> AAAA DESCRIPTION BBB DESCRIPTION> CCCC DESCRIPTION ID | VALUE AAAAAAA | AAAA DESCRIPTION BBBBBBB | BBB DESCRIPTION CCCCCC | CCCC DESCRIPTION
You made me so happy at 13:24 minutes, I was scared that something like this wasn't possible, I'm so glad that it is! This will simplify our life a lot. You are awesome, thank you so much!
Very beautifully explained your videos are very helpful Many thanks 🙂
Thank you 😊
Wow! Covered so smoothly 😊 Thanks for sharing
Welcome 🤗
Very useful and nice explanation
Thank you 😊
Nice explanation.... If there more rules in Rule file then the target files also get created dynamically ??
Your videos are great.. I have an issue in XML Flatten/Parsing.. complex data Elements with different names but all names ends with same keyword and all of them has similar properties (Key/Description) and these elements present in multiple segments in hierarchy in 1000’s.. Need to extract all of them into key/Value pairs. Would you make one video on how to parse /flatten such elements..
Hi, Does this work also for SQL sources?
For example I would have Region as lookup and I would like to pass this to export some data to csv files, so if I have 5 regions 5 files should be created with different region names
In SSIS we could parametarize sql command for the souce, does ADF support that or we should use filter from ADF?
Thanks
Superb !
Thank you 😊
Hi sir....your explanation good....I know one thing ...data engineer is easy or not compare to ETL testing.....Azure data engineer mostly coding part ?..please clarify .
this is nice. But i ve got a situation where I have an excel file and my source is in azure sql server. I'm trying to get the azure sql server tabel filtered for the dynamic rules in the Excel file and then write it to a delta table. I've been looking at your example and tried to do this 1 on 1. however this requires something else. anyone recognizes this situation?
nice example!
Thank you Mark ☺️
Hi, i am trying this same scenario using derived column instead filter... Column is not evaluating as expression... Is this possible? If not what is the alternate?
How to write tarnslate funtion in this expression
I need to filter records based on date dynamically, please help
Lovely
Thank you 😊
Only one problem your videos have is --- None of the files are shared. It is very difficult to find those files or creating those files. You could've uploaded those files because uploading is much faster than creating/searching those files. People who are checking these videos to learn ADF, have nothing to practice with. Watching only videos have no use. I hope you understand and will think about this concern.
Would you make video on parsing xml with this kind of elements.. and pull Key and Descriptions from all the segments ..
Category_KEYS ID= 'AAAAAAA'> AAAA DESCRIPTION
BBB DESCRIPTION>
CCCC DESCRIPTION
ID | VALUE
AAAAAAA | AAAA DESCRIPTION
BBBBBBB | BBB DESCRIPTION
CCCCCC | CCCC DESCRIPTION
13:30