- 21
- 45 525
ETLGuru
Приєднався 22 кві 2022
ETLGuru is your ultimate destination for all things related to Extract-Transform-Load (ETL) systems and data integration. With our UA-cam channel, we strive to provide comprehensive and insightful content to help you master the art of ETL and excel in the world of data management.
Join us on this exciting journey of mastering ETL, as we equip you with the knowledge, skills, and insights needed to tackle data integration challenges, optimize your data pipelines, and unlock the true potential of your data. Subscribe to ETLGuru today and embark on a transformative learning experience that will elevate your data management prowess.
Join us on this exciting journey of mastering ETL, as we equip you with the knowledge, skills, and insights needed to tackle data integration challenges, optimize your data pipelines, and unlock the true potential of your data. Subscribe to ETLGuru today and embark on a transformative learning experience that will elevate your data management prowess.
IICS: File Processor Connector - Transferring Files between a Local File System & FTP/SFTP Server
#iics #etlguru #etl
IICS: File Processor Connector - Synchronization Task Transferring Files between a Local File System and an FTP or SFTP Server
The file processor connector is used to securely transfer files from one location to another, regardless of size and location.
We can use File processor connectors for file processing operations, such as transferring, archiving, unarchiving, encryption, decrypting, compressing, decompressing, moving or copying files.
The File Processor Connector is not a native connector, to add a file connector go to Administrator Add-on-Connection and search for "File Processor Connector" and click start a free trial for 30 days trial
www.etutorials.in/2023/01/iics-file-processor-connector.html
IICS: File Processor Connector - Synchronization Task Transferring Files between a Local File System and an FTP or SFTP Server
The file processor connector is used to securely transfer files from one location to another, regardless of size and location.
We can use File processor connectors for file processing operations, such as transferring, archiving, unarchiving, encryption, decrypting, compressing, decompressing, moving or copying files.
The File Processor Connector is not a native connector, to add a file connector go to Administrator Add-on-Connection and search for "File Processor Connector" and click start a free trial for 30 days trial
www.etutorials.in/2023/01/iics-file-processor-connector.html
Переглядів: 3 794
Відео
IICS: Simple Mapping Example with FTP/SFTP Connection
Переглядів 3,3 тис.Рік тому
#iics #etlguru #etl IICS: Simple Mapping Example with FTP/SFTP Connection for more videos join Telegram Channel : t.me/etlguru FTP(File Transfer Protocol)/SFTP (Secure File Transfer Protocol) connections enable to use of FTP/SFTP to access source and target files. FTP/SFTP connection needs the following directories: Local directory : A directory local to the Secure Agent that contains a copy of...
IICS:Expression Horizontal Macros with Constants
Переглядів 689Рік тому
#iics #etlguru #etl IICS: Expression Horizontal Macros with Constants Horizontal macro with constant example To create categories for employees based on salary ranges, you might create a horizontal macro that defines the minimum and maximum values for each range and corresponding job categories. In an Expression transformation, macro input fields define the constants to use in the expression. %...
IICS: Vertical Expression Macros | Removing White spaces in the data filed using Expression Macros
Переглядів 1,5 тис.Рік тому
#iics #etlguru #etl IICS: Vertical Expression Macros | Removing White spaces in the data filed using Expression Macros Output Macro Field LTRIM(RTRIM(ReplaceChr(0, %in_macro%,' ',''))) Video link on Horizontal Mapping ua-cam.com/video/1Tkwe-tUDY0/v-deo.html
IICS: Horizonal Expression Macros | Redirecting NULL & NOT NULL to separate target using EXP Macros
Переглядів 1,3 тис.Рік тому
#iics #etlguru #etl IICS: Horizonal Expression Macros | Redirecting NULL and NOT NULL to separate target using Expression Macros. Expression macros An expression macro is a macro that you use to create repetitive or complex expressions to perform calculations across a set of fields or constants in mappings. For example, to filter/replace null values in a set of fields or to remove unwanted spac...
IICS: Re-registering existing Informatica Cloud Secure Agent to New IICS Org
Переглядів 3,1 тис.Рік тому
#etlguru #iics #SecureAgent IICS: Re-registering existing Informatica Cloud Secure Agent to New IICS Org without reinstalling Follow the below steps to re-register Informatica Cloud Secure Agent without reinstalling it. 1)Generate Install Token from IICS Runtime Environment and copy to the notepad 2) Shut down the secure agent service if it is running. 3) Go to the path [Secure Agent installati...
IICS:Mapping example with a Normalizer and Aggregator Transformation
Переглядів 8492 роки тому
#iics #etlguru #antosh IICS:Mapping example with a Normalizer and Aggregator Transformation A relational table includes the quarterly unit sales for each store. To calculate the annual unit sales for each store, use a Normalizer transformation to create a row for each quarter. Then, use an Aggregator transformation to aggregate the quarterly sales for each store. The source data includes the fo...
IICS: Connection and Object Parameterization in Normalizer Transformation
Переглядів 1,4 тис.2 роки тому
#iics #etlguru #antosh IICS: Connection and Object Parameterization in Normalizer Transformation Before watching this video watch the Normalization Transformation implementation video the link is:ua-cam.com/video/9E26-h_HJZo/v-deo.html #iics #etlguru #antosh IICS Normalizer Transformation SRC Name,Maths,Physics,Chemistry Antosh,80,60,70 Mahadev,90,70,80 Krishna,95,75,85 TGT CREATE TABLE tgt_nor...
IICS Normalizer Transformation
Переглядів 4,3 тис.2 роки тому
#iics #etlguru #antosh IICS Normalizer Transformation SRC Name,Maths,Physics,Chemistry Antosh,80,60,70 Mahadev,90,70,80 Krishna,95,75,85 TGT CREATE TABLE tgt_normalizer( name varchar2(30), subject varchar2(20), marks number(3), gk_marks number(3), gcid_marks number(3) ); Expression DECODE(TRUE, GCID_Marks=1,'Maths', GCID_Marks=2,'Physics', GCID_Marks=3,'Chemistry')
IICS:SCD Type2 using MD5 Hashing
Переглядів 3,1 тис.2 роки тому
#iics #scdt2 #etlguru IICS:SCD Type2 using MD5 Hashing Slowly Changing Dimensions enable the historic aspect of data in an analytical system. It is used in Datawarehouse There are 6 types of Slowly Changing Dimension that are commonly used. In reality, only types 0, 1 and 2 are widely used, and others are reserved for very specific requirements. A Type 2 SCD retains the full history of values. ...
SCD Type1 Implementation in IICS using MD5 checksum
Переглядів 1,5 тис.2 роки тому
#iics #scdt1 #etlguru SCD Type1 Implementation in IICS using MD5 checksum SRC EMP_ID,EMP_NAME,EMP_SALARY,DEPT_ID 100,Naganth,70000,10 101,Vinod,60000,10 102,Antosh,50000,11 103,Krishna,90000,12 104,Mahadev,80000,13 TGT CREATE TABLE EMPLOYEES_SCDT1( emp_key number(6), emp_id number(6), emp_name varchar2(20), emp_salary number(8,2), emp_dept_id number(4), checksum varchar2(50)); Checksum Expressi...
Simple IICS Mapping Flat file to Snowflake Using Snowflake ODBC Driver
Переглядів 6912 роки тому
#snowflake #iics #odbc Simple IICS Mapping Flat file to Snowflake Using Snowflake ODBC Driver
Simple IICS Mapping Snowflake to Flat file Using Snowflake ODBC Driver
Переглядів 4392 роки тому
#snowflake #iics #odbc Simple IICS Mapping Snowflake to Flat file Using Snowflake ODBC Driver
Snowflake IICS ODBC Connection
Переглядів 1,9 тис.2 роки тому
#snowflake #iics #informatica 1. Download Platform dependent Snowflake ODBC driver from developers.snowflake.com/odbc/ 2. Install the downloaded driver in your operating system, Here I am demonstrating on Windows platform with 64bit driver 3. Create System DSN in ODBC data Source 4. Create ODBC connection in IICS with requested Snowflake values.
Brief Explanation of SCD Type 2 Implementation in IICS without using Lookup Transformation
Переглядів 7 тис.2 роки тому
#iics #ipass #informatica A Short Video with Brief Explanation of SCD Type 2 Implementation in IICS ( Informatica Intelligent Cloud Services) without using Lookup Transformation Note: There is no basic concept covered in this video and this Video is for Advance learner. The one who is already expertise in IICS and SCD Type 2. Data for Practice CREATE TABLE SRC_EMPLOYEES (e_id number(10),e_name ...
Count Number of Male and Female from the city table using SQL
Переглядів 2,5 тис.2 роки тому
Count Number of Male and Female from the city table using SQL
Informatica Scenario : Replacing Duplicate IDs
Переглядів 1012 роки тому
Informatica Scenario : Replacing Duplicate IDs
Informatica Scenario: Number of Vowels and Consonants in Name Field
Переглядів 7272 роки тому
Informatica Scenario: Number of Vowels and Consonants in Name Field
First 3 Records in Target1, Next 5 Records in Target2 and Rest Target3
Переглядів 2032 роки тому
First 3 Records in Target1, Next 5 Records in Target2 and Rest Target3
Oracle SQL Query for fetching SUM of Quarterly Sales through order date
Переглядів 2,6 тис.2 роки тому
Oracle SQL Query for fetching SUM of Quarterly Sales through order date
Oracle SQL Query for Full Load and Incremental Load
Переглядів 4,1 тис.2 роки тому
Oracle SQL Query for Full Load and Incremental Load
Please increase the audio volume. Its difficult to hear and zoom the screen bit.
how the connection identifies the target without mentioning the hostname or port or something?
Tq
Great overview!
Dear Sir: My trial is going to expire on June 10,2024 based on the notifications forwarded to my email account on today. Please tell me when I can start my luck because there are 50 assets are there getting scare to be lost. Your further guidance is always appreciated. Sincerely Yours, Muhammad Khan from North America
Hi, how to implement file encryption using file processor in iics?
Can we compress file and transferred to external server ?
what is the difference between completely parameterize and partially parameterize
super it works for me.......
Hi, how can I get all mappings from old iics account into new account if old account expired... Please respond me, what should I do..
sir, input parameter - fixed value during task/task flow run?
Thanks i have same issue which is resolve from your guidence
you got a subscriber sir.
what a clear explanation sir 🤗 please upload more.
Hi, have you used the synchronization task to upload a specific file that contains YYYYMMDD pattern for example? I have search for an example, but I still don't know how to use that option.
Great contribution. Pl keep it up.
After free trail account it will work
Hi sir, how to contact you ? Need small help in understanding my project requirements
Thanks ETLGuru for the videos. When we use parameterized connection from parameter file in IICS, will I be able to perform any calculation/expression if I don't know the incoming port names How can we work on this during migration to iics if we have used parameterized connection in powercenter
Annoying music, no explanation :l
Here we are using sequence genartor 1 run igot 1 to 5 number after second run i got again 1 to 5 in type 2 we unique to key value but ididnt got how i got unique numbers
In Target connections it's not showing any option to choose from. How to fix that?
How to explain iics migration Project in interviews
By using whuch
By using which tool you are Migration your prj? Wht are challenge you are facing while migrating power center to iics? These questions are must is you say Migration prj.
I need this
Any informatica PC proxy person available in hyd pls DM me
Nice explanation. Your voice was too low
This can easily be done with max function and using partitioning it
Excellent video. Thanks !!
Excellent video. Thanks !!
Super
Super.... Please make video on partitions
Thank you sir
Can you please create a videos how to access cloud repository database using rest api and pull the run statistics and load to a table
I will send that vedios to you, r u working on informatica
@@dhaswaktheterrificboy1057 Yes
Nice one.. please do post new videos' on IICS.... Thanks.
Do u have datastage videos? Pls upload.
I am getting the end_date as today's date in up_insert operation. I have done same as yours and even cross-checked
Check with Field mappings in target, if possible export your mapping and send on our telegram group t.me/etlguru , So I will check where is your mistake.
@@etlguru ok I will send it to u
From where v_CNT took reference in expression transformation ? I mean Without input ports how v_CNT calculating
The Integration Service uses a default value based on the datatype for the Numeric datatype it is 0, for the String datatype it is empty string and for the date datatype it is 1/1/1753 AD for more details refer docs.informatica.com/data-integration/powercenter/10-5/advanced-workflow-guide/workflow-variables/user-defined-workflow-variables/datatype-default-values.html
Thanks For Videos.. Could you please post some videos like connecting to S3 to read and load data from IICS
Thanks, Janakiram, I will look into it.
Good, will u tell the SCD type 1
Please refer ua-cam.com/video/gAoUJuQ1b4M/v-deo.html
Nice explanation, it will help many...
Thanks Ranjan.
Error in expression for TO_DATE('31-12-9999','DD-MM-YYYY') in end date is showing! not equivalent to mysql date type
Please check with YYYY-MM-DD format for MySQL
Thanks for the Video / Good Job Keep it up
Thanks, will do!
sql query??
Thanks for sharing
My pleasure and Thanks for watching
Hey man, glad to meet again. I have only a simple enquiry as a new sql learner. How order by clause differs from rank function in sql? Thanks for taking care of this.
The first 3 Records are in T1, the Next 5 Records in T2 and the Rest in T3 SRC->SQ->EXP->RTR-TGT1,2,3 EXP ----- v_CNT=v_CNT+1 CNT_1_3 = IIF(v_CNT<=3,1,0) CNT_4_8=IIF(v_CNT>=4 AND v_CNT<=8,1,0) RTR ____ Groups Group_Target1=CNT_1_3----->T1 Group_Target2=CNT_4_8----->T2 Default1------->T3
Meta Data for practice ------------------------------------ CREATE TABLE SALES(ORDERNO NUMBER(10),P_AMOUNT NUMBER(10,2), ORDERDATE DATE, CUST_ID NUMBER(10)); INSERT INTO SALES VALUES(70001,150.5,TO_DATE('2012-01-05','YYYY/MM/DD'),3005); INSERT INTO SALES VALUES(70009,270.65,TO_DATE('2012-03-05','YYYY/MM/DD'),3001); INSERT INTO SALES VALUES(70002,65.26,TO_DATE('2012-12-05','YYYY/MM/DD'),3002); INSERT INTO SALES VALUES(70004,110.5,TO_DATE('2012-10-06','YYYY/MM/DD'),3009); INSERT INTO SALES VALUES(70007,948.5,TO_DATE('2012-05-06','YYYY/MM/DD'),3005); INSERT INTO SALES VALUES(70005,2400.6,TO_DATE('2012-10-07','YYYY/MM/DD'),3001); INSERT INTO SALES VALUES(70008,5760,TO_DATE('2012-08-07','YYYY/MM/DD'),3002); INSERT INTO SALES VALUES(70010,1983.43,TO_DATE('2012-07-07','YYYY/MM/DD'),3004); INSERT INTO SALES VALUES(70003,2480.4,TO_DATE('2012-10-07','YYYY/MM/DD'),3008); SELECT * FROM sales; ------------------------------------------------------------------------ ORDERNO P_AMOUNT ORDERDATE CUST_ID 70001 150.5 05-01-12 3005 70009 270.65 05-03-12 3001 70002 65.26 05-12-12 3002 70004 110.5 06-10-12 3009 70007 948.5 06-05-12 3005 70005 2400.6 07-10-12 3001 70008 5760 07-08-12 3002 70010 1983.43 07-07-12 3004 70003 2480.4 07-10-12 3008 SELECT TO_CHAR(orderdate,'Q') AS QUARTER,SUM(p_amount) AS "Total Sales" FROM sales GROUP BY TO_CHAR(orderdate,'Q') ORDER BY QUARTER; ----------------------------------- QUARTER Total Sales 1 421.15 2 948.5 3 7743.43 4 5056.76
--SQL Query for Incremental Load --Source Table CREATE TABLE S1(sd1 number,sd2 varchar2(10),sdate date); --Target Table CREATE TABLE T1(td1 number,td2 varchar2(10),tdate date); INSERT INTO S1 VALUES(1,'antosh1','18-07-22'); INSERT INTO S1 VALUES(2,'antosh2','18-07-22'); INSERT INTO S1 VALUES(3,'antosh3','19-07-22'); INSERT INTO S1 VALUES(4,'antosh4','19-07-22'); INSERT INTO S1 VALUES(5,'antosh5','19-07-22'); COMMIT; SELECT * FROM S1; SELECT * FROM T1; --Full Load INSERT INTO T1(td1,td2,tdate) SELECT sd1,sd2,sdate FROM S1; COMMIT; SELECT * FROM T1; --INCREMENTAL LOAD INSERT INTO S1 VALUES(1,'antosh6','20-07-22'); INSERT INTO S1 VALUES(2,'antosh7','20-07-22'); INSERT INTO S1 VALUES(3,'antosh8','20-07-22'); INSERT INTO S1 VALUES(4,'antosh9','20-07-22'); INSERT INTO S1 VALUES(5,'antosh10','20-07-22'); SELECT * FROM S1; SELECT * FROM T1; --Incremental Load INSERT INTO T1(td1,td2,tdate) SELECT sd1,sd2,sdate FROM S1 WHERE sdate>(SELECT max(tdate) from T1); COMMIT; SELECT * FROM T1;