What is ETL with a clear example - Data Engineering Concepts

Поділитися
Вставка
  • Опубліковано 3 гру 2024

КОМЕНТАРІ • 107

  • @aahsankhan4502
    @aahsankhan4502 Рік тому +47

    Sir, this is a Superb Explanation.

  • @freedomofspeech122
    @freedomofspeech122 Рік тому +16

    I liked the clever pun "Enjoyed? Then Like" (ETL) 😁

  • @yqhanliving
    @yqhanliving Рік тому +1

    I'm a beginner to data analysis and was hearing about ETL for the first time in one of my SQL projects. This video has explained ETL very clearly to me. Thanks Chandoo!

  • @ArenitaHernandez
    @ArenitaHernandez 10 місяців тому +3

    What an eloquent manner to describe these concepts. I greatly appreciate it. 🙏🏽

  • @raghukoduri2018
    @raghukoduri2018 Рік тому +9

    Neither Ramarao nor RamCharan, you are my Superhero!! God bless you with long life Anna. Thank you so much for the great content

    • @carcrazynishant
      @carcrazynishant Рік тому

      Wow respect man… most people pay obeisances to actors from who we get entertained and not educated

    • @chaitanyakumar3023
      @chaitanyakumar3023 Рік тому

      Wonder to see actor comparison in comments for ETL !

    • @chandoo_
      @chandoo_  Рік тому

      That is so sweet. Thanks Raghu 😍

  • @juliamavis2830
    @juliamavis2830 7 місяців тому +1

    I’m looking into pivoting my career into data engineering and this video really was informative. Thank you

  • @hazmannaim705
    @hazmannaim705 7 місяців тому +1

    I like how you show us the real-world example. Make the learning more understandable!

  • @AllisonSadin-cq2wt
    @AllisonSadin-cq2wt 6 місяців тому

    This is the video I have been searching for! I was so confused about how ETL could be defined... if ETL only happened using ETL tools, or if you could build your own ETL pipeline without the common tools! Thank you!

  • @AdalgrimTook
    @AdalgrimTook 6 місяців тому +11

    Came here thinking I know nothing about this but turns out it's my daily job lol

  • @FawazPashaShroff
    @FawazPashaShroff 2 місяці тому +1

    Bro you are dam good at explanation, I love learning from the ETL course

  • @joshuabretana
    @joshuabretana Рік тому +3

    I like how you explain topics, they never get anymore complicated

  • @aryanpatil49
    @aryanpatil49 3 місяці тому

    Along with the explanation, your presentation and delivery style is beautiful

  • @chijiokeijezie969
    @chijiokeijezie969 Рік тому +2

    Your videos and teachings are top notch!!! Simply good at what you do

  • @NaisDeis
    @NaisDeis Рік тому +1

    Man, this clarifies everything, thank you so much!

  • @tamirbahalker16
    @tamirbahalker16 10 місяців тому

    Thank you for a great explanation, we need more of you in this world😄

  • @djenobthemixbane1146
    @djenobthemixbane1146 7 місяців тому

    Thank you so much for this. It helped clarify a lot about ETL and its tools

  • @stevenvanveldhoven4368
    @stevenvanveldhoven4368 5 місяців тому

    Thanks Chandoo. I always enjoy learning from you.

  • @eltonruco3598
    @eltonruco3598 29 днів тому

    thank you man, very clear and helpful

  • @nukestrom5719
    @nukestrom5719 7 місяців тому

    What a great mentor.

  • @kehindefayomi7417
    @kehindefayomi7417 Рік тому

    Am always happy seeing you solving problems...kudos my mentor

  • @surajmane5481
    @surajmane5481 6 місяців тому

    It's Wow! The way you explain...….

  • @itz_sameer795
    @itz_sameer795 15 днів тому

    Awesome explanation brother... keep it up :)

  • @arjundev4908
    @arjundev4908 Рік тому +1

    I watched in 13 minutes. But the pain behind to shoot this video with all those props. Amazing efforts chandoo sir😮😊

    • @chandoo_
      @chandoo_  Рік тому +1

      Thanks Arjun :) It was a fun video to make.

  • @PillsLifestyleReviews
    @PillsLifestyleReviews 8 місяців тому

    Thank You So Much. You put a lot of effort into this vid!

  • @tariqhussain1497
    @tariqhussain1497 9 місяців тому

    Good morning, and thats the nice to explain with a small data set

  • @victorbegnini5754
    @victorbegnini5754 10 місяців тому

    Amazing explanation!!
    Thanks for that 🎉

  • @andrewjason3756
    @andrewjason3756 Рік тому +2

    You are doing such good work. Keep it up.😊

    • @chandoo_
      @chandoo_  Рік тому

      You are welcome Andrew. 😀

  • @thenorthremembers5978
    @thenorthremembers5978 3 місяці тому

    thank you! this was super helpful

  • @rashmimishra2177
    @rashmimishra2177 14 годин тому

    always helpful sir

  • @VivekKBangaru
    @VivekKBangaru 9 місяців тому

    Really enjoyed it. Thanks bro

  • @learn_ai_with_us
    @learn_ai_with_us Рік тому

    last ETL concept was great ...

  • @talesoftravelsbysj
    @talesoftravelsbysj 4 місяці тому

    Clever explanation

  • @markpatterson766
    @markpatterson766 Рік тому

    I enojyed that. Countless examples without actual specific examples like this.

  • @pcandy468
    @pcandy468 5 місяців тому +1

    The whole video was very helpful! I did chuckle at the ETL/like the video joke 🤭

    • @chandoo_
      @chandoo_  5 місяців тому

      Glad it helped!

  • @omgitsbees
    @omgitsbees 2 місяці тому

    Thank you for this video! This helps me a lot, even though I already have experience with ETL. :) I like using Python to do this and actually is how I got started because I was learning on my own and went down the wrong path. :P

  • @ihemanthsagar
    @ihemanthsagar 2 місяці тому

    You won a subscriber 👍

  • @shivaratribikshapathilinus5985
    @shivaratribikshapathilinus5985 5 місяців тому

    Am learning the ETL

  • @PavanMS87
    @PavanMS87 Рік тому

    Thanks a ton . Invaluable

  • @alfredtomiamubiaya3330
    @alfredtomiamubiaya3330 Рік тому

    Many thanks Chandoo.You are awesome.

  • @chrism9037
    @chrism9037 Рік тому

    Nice work Chandoo, thank you!

  • @kirandeepmarala5541
    @kirandeepmarala5541 Рік тому +1

    Awesome Video Chandoo Annaya 💌👏

  • @aiasaiascon3894
    @aiasaiascon3894 Рік тому

    Super cool explanations - I like the paper concept

  • @balutaalex6694
    @balutaalex6694 Рік тому

    ASMR, amazing explanation!

  • @loybiz
    @loybiz 9 місяців тому

    Great job. Thanks a ton

  • @nviknesh8112
    @nviknesh8112 11 місяців тому

    Hi Chandoo, Happy new Year 2024. I have experience in Oracle PLSQL and MSSQL database's and i wish to switch my career to datawarehouse projects. Kindly guide me the path to proceed like what course should i start..

  • @Sandeepindiamyself
    @Sandeepindiamyself Рік тому

    Nicely explained sir😊...!!! Please make a complete video of Microsoft 365.

  • @chicaocasanova
    @chicaocasanova 5 місяців тому

    Thank you very much ❤

  • @edwindsouza7157
    @edwindsouza7157 9 місяців тому

    Very good explanation power

  • @idreeskhan5129
    @idreeskhan5129 Рік тому

    wow this is so amazing .

  • @hukkuhukku6208
    @hukkuhukku6208 10 місяців тому

    👏🏻awesome

  • @jagatkrishna1543
    @jagatkrishna1543 Рік тому

    Thanks 🙏 SIR, God Bless You

  • @NavneetKaur-kd6bd
    @NavneetKaur-kd6bd Рік тому +1

    Sir , i wanted to ask you that if i wanted to be a Business Analyst and Data analyst should i pursue MBA after having the skill set of Data analyst.
    And if i pursue MBA , should i do specialisation in Business Analyst or Normal MBA would do?
    Thank you ❤️

    • @chandoo_
      @chandoo_  Рік тому +1

      MBA is not requirement to be either Business or Data Analyst. If you have a strong background in the industry, you can get in to these positions. MBA often helps in speeding up the process (for example it might take 4-5 years of experience to get the role, but with MBA you might get the same in 1-2 years).

  • @janauppara
    @janauppara Рік тому

    Any ETL tool recommendation to start with?

  • @aparnapandravada5073
    @aparnapandravada5073 Рік тому

    Awesome, very useful

  • @Nash0303
    @Nash0303 11 місяців тому

    Fantastic!!

  • @Prabhakaran-hp1to
    @Prabhakaran-hp1to Рік тому

    Thank you so much!

  • @ajayyaleti6197
    @ajayyaleti6197 Рік тому

    Thank you ❤

  • @nikki_siddi
    @nikki_siddi Рік тому

    Great video!!

  • @KiranYadavOG
    @KiranYadavOG Рік тому

    thank you!

  • @CaribouDataScience
    @CaribouDataScience Рік тому

    Thanks.

  • @rockky-zz8ii
    @rockky-zz8ii Рік тому

    Hi Chandoo, can you help me in one issue I'm facing like. I have one Item number xyx00001 but for that 3departments are working but when I have created a Measure formula of variance e.g. (calculate Sum(total hour) - Sum(actual hours))in measure result I'm getting 3 different value instead on same on in each row any logic can you provide. and yes there is no relationship issue for that can you help

  • @Sardar_Uk
    @Sardar_Uk 4 місяці тому

    Which tool you used? Please reply

  • @easterntoronto
    @easterntoronto 6 місяців тому

    Great

  • @skrejaulhaque
    @skrejaulhaque Рік тому +1

    Thank you, first comment

  • @nandiniagarwal9201
    @nandiniagarwal9201 Рік тому

    Pls make a video on how to upload a dashoboard on linkedin

  • @talebbagazi1435
    @talebbagazi1435 3 місяці тому

    For ETL include as if we have one shared drive for the company and we take couple of data and combine and clean the data to get the data you need to create a report? Or I should have other sources like sql, azure or scrap the data?

    • @chandoo_
      @chandoo_  3 місяці тому

      Not sure I understand your question. Try again please?

    • @talebbagazi1435
      @talebbagazi1435 3 місяці тому

      @@chandoo_ my question is, can i say I do etl if I combine multiple excels using a primary’s keys? Or it something advance like scrape a data then joining data using sql?

    • @chandoo_
      @chandoo_  3 місяці тому

      Just cleaning data and combining tables is not ETL. You will need to be actually doing the "L" to a database / warehouse system. Don't be fast and loose with the terminology (especially in interviews).

    • @talebbagazi1435
      @talebbagazi1435 3 місяці тому

      @@chandoo_ please can further explain how to do the “L” to the database?

    • @chandoo_
      @chandoo_  3 місяці тому

      L = Load. This is where the transformed data is loaded to target system using either SQL or some other ingestion methods.

  • @trueman5948
    @trueman5948 Рік тому

    Sir do we need sqlserves ,ssis,azure, To learn powerbi and to get job on it.

  • @ppy0019
    @ppy0019 Рік тому

    Hello sir , please make a full course in SQL ...please sir

    • @chandoo_
      @chandoo_  Рік тому

      I have a detailed SQL video here - ua-cam.com/video/l8DCPaHc5TQ/v-deo.html

  • @rajatthakur6444
    @rajatthakur6444 Рік тому

    bring end to end ETL project Sir

  • @JagdishDive123
    @JagdishDive123 Рік тому

    Is ETL dev job will replace by AI.? How can freshers tackle this ? 😢

  • @mukeshvarma8662
    @mukeshvarma8662 Рік тому

    Chandoo, i have a problem. I need ur help. I have a excel files in share point . Which has query connection with other excel files. I need to refresh all in a excel file. Without opening the file manually. Because that file is connected to power bi

    • @mikatu
      @mikatu Рік тому +1

      forget it!
      you need to delete the main file and run a progress report. the report will delete the setup and then you insert the fileload which will allow for a refresh on demand.

  • @daminitripathi913
    @daminitripathi913 Рік тому

    sir can you share data so that we can practice the same query

    • @chandoo_
      @chandoo_  Рік тому

      You can use the dataset and SQL shared in this video - ua-cam.com/video/l8DCPaHc5TQ/v-deo.html

  • @BhuvaaneshRavi
    @BhuvaaneshRavi 6 місяців тому

    SHouldnt it be if(sum(s.amount)>1000,1,0)

  • @yonisupersaiyanyoni3693
    @yonisupersaiyanyoni3693 Місяць тому

    Where the stages explenation

  • @transworld8005
    @transworld8005 Рік тому

    😃

  • @MaxSmith-d6i
    @MaxSmith-d6i Місяць тому +1

    This is awesome: loved the jokes

  • @whothefcares2687
    @whothefcares2687 5 місяців тому

    ETL is just data entry then? WTF😂

  • @prrrrince
    @prrrrince Рік тому

    First

  • @akashgautam1909
    @akashgautam1909 Рік тому

    Hello Sir,
    Could you please help me know what skills are required to become a data analyst?
    I've watched tons of videos including yours on this topic and got confused.
    To give a brief idea,
    I have an intermediate level of knowledge of Excel, SQL, Python (Including Numpy, Pandas, Matplotlib, and Seaborn), Power BI ( PQ, Data Modeling, DAX, Dashboarding), and Statistics.
    When I go to any job portals, it says you need to know machine learning, and deep learning too. 🥲
    Can I get a job with these skills?

    • @bharaths5906
      @bharaths5906 5 місяців тому

      Did you got the job? I am in ur stage now and looking for a job