Thanks for the videos. Here are some other questions : 1. Drawbacks of tparallelize component. 2. How do you configure talend studio to capture logs in files. 3. diff between tmap and tjoin? when you prefer which component? 4. Implementation of SCD2?(with 4 possible outcomes)
Which Option will you choose to perform join of 10 tables. 1) One Tmap 9 lookups or 2) 9 Tmaps Provide justification for each. Thanks for your videos gives a lot of confidence to crack interviews for fun.
Hi Rohan, thank you for sharing the knowledge with such a great content. I am a beginner and would like to learn Talend. Do you mind sharing the sequence in which I can learn from your channel? It seem to me that videos are scattered, I might be wrong.
Hi Bhavesh, the videos in playlist is in sequence. Please start with the oldest video I mean upload date.. you will start from install, architecture, setting connections and basic things are in earlier videos..
Thanks a lot. Could you please help me in scenarios like what to do in input records so that they will fail in between and earlier records also get loaded in the target to perform recovery scenario.
U can handle this couple of ways.. 1 have the clean up script to avoid dups.. 2. Apply incremental logic to get max date from target .. 3. Apply insert/update login on target 4. Target look up to check they exist, if they exist check if values are different then you can load target Many ways.. choose the best.. I covered in in my videos.. u may want to check
@@LearningwithRohan I have created one scenario where I am getting file from input and wanted to fail that job at some records (assume it's at 33 line) so I wanted 32 records should get loaded in that case. So I am trying to give string value in int column and vice versa. Job is failing but no record is getting loaded into the target. What can I improve in this job?
@@vru5696 its due the commit interval.. you can reduce that to 1 or 10 just meet your requirement. But if you decrease it, it will cause slight perf issue
Hi Rohan, Thanks for your videos, they are really helpful, I have been asked a question in one interview. Question: If there are 10 input files with same schema and contains some data, now I wanted to load those 10 files data into target which contains only 1 table or file, while loading the data I need to add another column in the target and that column should let me know which data from which file it came through..?
hi rohan, what is your opinion about talend(particularly DI) future scope and job opportunities, now many cloud companies are providing complete package. will it replace talend.
Agreed, companies are slowly migrating to cloud and leveraging more such features. At the same time I don’t see direct impact on Talend DI next few years.. Talend is already geared up to add more features to stay on the top. So don’t worry as long as you have traditional ETL with cloud knowledge.. DI will stay on at least 10 years!! Hope it helps!
Hi Rohan, we have multiple extension files in a folder , but i want to read all files except .txt files ..similarly tomorrow another extension file will be included in that folder..so ..to read all files except.txt ..how can we design a job?? Please kindly answer this question. Thanks in advance.
Very useful information 👍
Keep uploading this type of videos
Very useful information
Nice explanation 👍
Thanks for the videos. Here are some other questions :
1. Drawbacks of tparallelize component.
2. How do you configure talend studio to capture logs in files.
3. diff between tmap and tjoin? when you prefer which component?
4. Implementation of SCD2?(with 4 possible outcomes)
Will cover in my upcoming videos
👌nice explanation
You’re welcome, keep learning and sharing knowledge
@@LearningwithRohan using talend we convert oracle to mango db?(any etl tool)
Which Option will you choose to perform join of 10 tables.
1) One Tmap 9 lookups or
2) 9 Tmaps
Provide justification for each.
Thanks for your videos gives a lot of confidence to crack interviews for fun.
I prefer to do it on database side if all are in a single db.. otherwise use 1 tmap with parallel lookup option
@@LearningwithRohan thanks
Hi Rohan, thank you for sharing the knowledge with such a great content. I am a beginner and would like to learn Talend. Do you mind sharing the sequence in which I can learn from your channel? It seem to me that videos are scattered, I might be wrong.
Hi Bhavesh, the videos in playlist is in sequence. Please start with the oldest video I mean upload date.. you will start from install, architecture, setting connections and basic things are in earlier videos..
Thanks a lot. Could you please help me in scenarios like what to do in input records so that they will fail in between and earlier records also get loaded in the target to perform recovery scenario.
U can handle this couple of ways..
1 have the clean up script to avoid dups..
2. Apply incremental logic to get max date from target ..
3. Apply insert/update login on target
4. Target look up to check they exist, if they exist check if values are different then you can load target
Many ways.. choose the best.. I covered in in my videos.. u may want to check
@@LearningwithRohan I have created one scenario where I am getting file from input and wanted to fail that job at some records (assume it's at 33 line) so I wanted 32 records should get loaded in that case. So I am trying to give string value in int column and vice versa. Job is failing but no record is getting loaded into the target. What can I improve in this job?
@@vru5696 its due the commit interval.. you can reduce that to 1 or 10 just meet your requirement. But if you decrease it, it will cause slight perf issue
Hi Rohan, Thanks for your videos, they are really helpful, I have been asked a question in one interview.
Question: If there are 10 input files with same schema and contains some data, now I wanted to load those 10 files data into target which contains only 1 table or file, while loading the data I need to add another column in the target and that column should let me know which data from which file it came through..?
You can do that using file list component and I think it’s covered in one of my video.. check it out
@@LearningwithRohan ua-cam.com/video/7MPmmSTONng/v-deo.html
@@LearningwithRohan Thanks once again :)
hi rohan, what is your opinion about talend(particularly DI) future scope and job opportunities, now many cloud companies are providing complete package. will it replace talend.
Agreed, companies are slowly migrating to cloud and leveraging more such features. At the same time I don’t see direct impact on Talend DI next few years.. Talend is already geared up to add more features to stay on the top. So don’t worry as long as you have traditional ETL with cloud knowledge.. DI will stay on at least 10 years!! Hope it helps!
@@LearningwithRohan thanks Rohan
Hi Rohan, we have multiple extension files in a folder , but i want to read all files except .txt files ..similarly tomorrow another extension file will be included in that folder..so ..to read all files except.txt ..how can we design a job?? Please kindly answer this question. Thanks in advance.
Iterate - filter for txt - then use input after filtering txt file names
You can also use the iterate global variables and put that not equal to txt condition in the link then connect to input component
Thanks a lot Rohan🙏
Thanks a lot Rohan🙏
Hi Rohan,
How can we perform transformations on directory containing different extension files through a single flow?
Use the file list component with wildcard for extension. Then use variable like current file in your file input .. this will bring all types of file..
I have json, xml, excel, csv files into directory then how can I read all these files through a single component and perform further transformations?