What is ETL with a clear example - Data Engineering Concepts

Поділитися
Вставка
  • Опубліковано 15 чер 2024
  • Do you want to know what ETL (Extract, Transform & Load) process is? How it looks and what really happens in it? In this video, understand the 5 key things when it comes to ETL:
    1️⃣ What is ETL?
    2️⃣ ETL vs. ELT
    3️⃣ Real-world example of ETL
    4️⃣ ETL tools & platforms
    5️⃣ A demo of ETL on my computer
    ⏱ IN THIS VIDEO 👇
    ================
    0:00 - Introduction to ETL
    0:18 - What is ETL?
    2:14 - ETL vs. ELT - the main difference
    2:50 - A real-world example of ETL
    6:17 - Examples of ETL operations
    7:27 - What tools are used for ETL?
    9:22 - ETL Demo (with SQL)
    13:14 - Closing remarks (and one more ETL for you)
    😍 MORE EXPLANATIONS OF DATA CONCEPTS:
    ========================================
    Loving the style of this video? You are going to enjoy below videos too. They are in the same style and demystify critical data concepts.
    💡 Know the difference between Database, Data Warehouse and Data Lake - • KNOW the difference be... (350k+ views)
    😎 Top 20 Data & Business Intelligence Terms - • Top 20 Data & BI terms...
    🤩 What is SQL and how to use it? • SQL Basics for people ...
    ⭐ What is Star Schema? • How to setup a Star Sc...
    Important Data Concepts & Skills (playlist) - • Important Skills for D...
    ~
    Why did the restaurant owner fire ETL developer?
    Because she kept joining the wrong tables 🤣
    ~
    #etl #data
  • Наука та технологія

КОМЕНТАРІ • 82

  • @aahsankhan4502
    @aahsankhan4502 Рік тому +38

    Sir, this is a Superb Explanation.

  • @freedomofspeech122
    @freedomofspeech122 7 місяців тому +11

    I liked the clever pun "Enjoyed? Then Like" (ETL) 😁

  • @ArenitaHernandez
    @ArenitaHernandez 4 місяці тому +1

    What an eloquent manner to describe these concepts. I greatly appreciate it. 🙏🏽

  • @yqhanliving
    @yqhanliving 6 місяців тому

    I'm a beginner to data analysis and was hearing about ETL for the first time in one of my SQL projects. This video has explained ETL very clearly to me. Thanks Chandoo!

  • @hazmannaim705
    @hazmannaim705 Місяць тому +1

    I like how you show us the real-world example. Make the learning more understandable!

  • @kehindefayomi7417
    @kehindefayomi7417 Рік тому

    Am always happy seeing you solving problems...kudos my mentor

  • @tamirbahalker16
    @tamirbahalker16 4 місяці тому

    Thank you for a great explanation, we need more of you in this world😄

  • @AllisonSadin-cq2wt
    @AllisonSadin-cq2wt Місяць тому

    This is the video I have been searching for! I was so confused about how ETL could be defined... if ETL only happened using ETL tools, or if you could build your own ETL pipeline without the common tools! Thank you!

  • @djenobthemixbane1146
    @djenobthemixbane1146 2 місяці тому

    Thank you so much for this. It helped clarify a lot about ETL and its tools

  • @chijiokeijezie969
    @chijiokeijezie969 Рік тому +2

    Your videos and teachings are top notch!!! Simply good at what you do

  • @suck-myballs1152
    @suck-myballs1152 4 місяці тому +3

    This was a GREAT video! Simple, informative, and with a real-world example!

  • @joshuabretana
    @joshuabretana Рік тому +3

    I like how you explain topics, they never get anymore complicated

  • @stevenvanveldhoven4368
    @stevenvanveldhoven4368 2 дні тому

    Thanks Chandoo. I always enjoy learning from you.

  • @juliamavis2830
    @juliamavis2830 Місяць тому

    I’m looking into pivoting my career into data engineering and this video really was informative. Thank you

  • @NaisDeis
    @NaisDeis Рік тому +1

    Man, this clarifies everything, thank you so much!

  • @victorbegnini5754
    @victorbegnini5754 4 місяці тому

    Amazing explanation!!
    Thanks for that 🎉

  • @raghukoduri2018
    @raghukoduri2018 Рік тому +8

    Neither Ramarao nor RamCharan, you are my Superhero!! God bless you with long life Anna. Thank you so much for the great content

    • @carcrazynishant
      @carcrazynishant Рік тому

      Wow respect man… most people pay obeisances to actors from who we get entertained and not educated

    • @chaitanyakumar3023
      @chaitanyakumar3023 Рік тому

      Wonder to see actor comparison in comments for ETL !

    • @chandoo_
      @chandoo_  Рік тому

      That is so sweet. Thanks Raghu 😍

  • @pillslifestylereviews6714
    @pillslifestylereviews6714 2 місяці тому

    Thank You So Much. You put a lot of effort into this vid!

  • @chrism9037
    @chrism9037 Рік тому

    Nice work Chandoo, thank you!

  • @nukestrom5719
    @nukestrom5719 Місяць тому

    What a great mentor.

  • @aiasaiascon3894
    @aiasaiascon3894 Рік тому

    Super cool explanations - I like the paper concept

  • @andrewjason3756
    @andrewjason3756 Рік тому +2

    You are doing such good work. Keep it up.😊

    • @chandoo_
      @chandoo_  Рік тому

      You are welcome Andrew. 😀

  • @VivekKBangaru
    @VivekKBangaru 3 місяці тому

    Really enjoyed it. Thanks bro

  • @surajmane5481
    @surajmane5481 Місяць тому

    It's Wow! The way you explain...….

  • @alfredtomiamubiaya3330
    @alfredtomiamubiaya3330 Рік тому

    Many thanks Chandoo.You are awesome.

  • @arjundev4908
    @arjundev4908 Рік тому +1

    I watched in 13 minutes. But the pain behind to shoot this video with all those props. Amazing efforts chandoo sir😮😊

    • @chandoo_
      @chandoo_  Рік тому +1

      Thanks Arjun :) It was a fun video to make.

  • @tariqhussain1497
    @tariqhussain1497 3 місяці тому

    Good morning, and thats the nice to explain with a small data set

  • @Sandeepindiamyself
    @Sandeepindiamyself Рік тому

    Nicely explained sir😊...!!! Please make a complete video of Microsoft 365.

  • @kirandeepmarala5541
    @kirandeepmarala5541 Рік тому +1

    Awesome Video Chandoo Annaya 💌👏

  • @PavanMS87
    @PavanMS87 8 місяців тому

    Thanks a ton . Invaluable

  • @balutaalex6694
    @balutaalex6694 9 місяців тому

    ASMR, amazing explanation!

  • @loybiz
    @loybiz 4 місяці тому

    Great job. Thanks a ton

  • @aparnapandravada5073
    @aparnapandravada5073 Рік тому

    Awesome, very useful

  • @Prabhakaran-hp1to
    @Prabhakaran-hp1to Рік тому

    Thank you so much!

  • @idreeskhan5129
    @idreeskhan5129 9 місяців тому

    wow this is so amazing .

  • @learn_ai_with_us
    @learn_ai_with_us 10 місяців тому

    last ETL concept was great ...

  • @nikki_siddi
    @nikki_siddi Рік тому

    Great video!!

  • @edwindsouza7157
    @edwindsouza7157 3 місяці тому

    Very good explanation power

  • @jagatkrishna1543
    @jagatkrishna1543 Рік тому

    Thanks 🙏 SIR, God Bless You

  • @ajayyaleti6197
    @ajayyaleti6197 Рік тому

    Thank you ❤

  • @Nash0303
    @Nash0303 5 місяців тому

    Fantastic!!

  • @KiranYadavOG
    @KiranYadavOG 9 місяців тому

    thank you!

  • @hukkuhukku6208
    @hukkuhukku6208 4 місяці тому

    👏🏻awesome

  • @markpatterson766
    @markpatterson766 8 місяців тому

    I enojyed that. Countless examples without actual specific examples like this.

  • @CaribouDataScience
    @CaribouDataScience Рік тому

    Thanks.

  • @nviknesh8112
    @nviknesh8112 5 місяців тому

    Hi Chandoo, Happy new Year 2024. I have experience in Oracle PLSQL and MSSQL database's and i wish to switch my career to datawarehouse projects. Kindly guide me the path to proceed like what course should i start..

  • @easterntoronto
    @easterntoronto Місяць тому

    Great

  • @NavneetKaur-kd6bd
    @NavneetKaur-kd6bd Рік тому +1

    Sir , i wanted to ask you that if i wanted to be a Business Analyst and Data analyst should i pursue MBA after having the skill set of Data analyst.
    And if i pursue MBA , should i do specialisation in Business Analyst or Normal MBA would do?
    Thank you ❤️

    • @chandoo_
      @chandoo_  Рік тому +1

      MBA is not requirement to be either Business or Data Analyst. If you have a strong background in the industry, you can get in to these positions. MBA often helps in speeding up the process (for example it might take 4-5 years of experience to get the role, but with MBA you might get the same in 1-2 years).

  • @rockky-zz8ii
    @rockky-zz8ii Рік тому

    Hi Chandoo, can you help me in one issue I'm facing like. I have one Item number xyx00001 but for that 3departments are working but when I have created a Measure formula of variance e.g. (calculate Sum(total hour) - Sum(actual hours))in measure result I'm getting 3 different value instead on same on in each row any logic can you provide. and yes there is no relationship issue for that can you help

  • @skrejaulhaque
    @skrejaulhaque Рік тому +1

    Thank you, first comment

  • @janauppara
    @janauppara 6 місяців тому

    Any ETL tool recommendation to start with?

  • @nandiniagarwal9201
    @nandiniagarwal9201 Рік тому

    Pls make a video on how to upload a dashoboard on linkedin

  • @trueman5948
    @trueman5948 Рік тому

    Sir do we need sqlserves ,ssis,azure, To learn powerbi and to get job on it.

  • @AdalgrimTook
    @AdalgrimTook 17 днів тому +2

    Came here thinking I know nothing about this but turns out it's my daily job lol

  • @ppy0019
    @ppy0019 Рік тому

    Hello sir , please make a full course in SQL ...please sir

    • @chandoo_
      @chandoo_  Рік тому

      I have a detailed SQL video here - ua-cam.com/video/l8DCPaHc5TQ/v-deo.html

  • @rajatthakur6444
    @rajatthakur6444 Рік тому

    bring end to end ETL project Sir

  • @daminitripathi913
    @daminitripathi913 Рік тому

    sir can you share data so that we can practice the same query

    • @chandoo_
      @chandoo_  Рік тому

      You can use the dataset and SQL shared in this video - ua-cam.com/video/l8DCPaHc5TQ/v-deo.html

  • @transworld8005
    @transworld8005 Рік тому

    😃

  • @JagdishDive123
    @JagdishDive123 11 місяців тому

    Is ETL dev job will replace by AI.? How can freshers tackle this ? 😢

  • @BhuvaaneshRavi
    @BhuvaaneshRavi Місяць тому

    SHouldnt it be if(sum(s.amount)>1000,1,0)

  • @mukeshvarma8662
    @mukeshvarma8662 Рік тому

    Chandoo, i have a problem. I need ur help. I have a excel files in share point . Which has query connection with other excel files. I need to refresh all in a excel file. Without opening the file manually. Because that file is connected to power bi

    • @mikatu
      @mikatu Рік тому +1

      forget it!
      you need to delete the main file and run a progress report. the report will delete the setup and then you insert the fileload which will allow for a refresh on demand.

  • @prrrrince
    @prrrrince Рік тому

    First

  • @whothefcares2687
    @whothefcares2687 6 днів тому

    ETL is just data entry then? WTF😂

  • @akashgautam1909
    @akashgautam1909 Рік тому

    Hello Sir,
    Could you please help me know what skills are required to become a data analyst?
    I've watched tons of videos including yours on this topic and got confused.
    To give a brief idea,
    I have an intermediate level of knowledge of Excel, SQL, Python (Including Numpy, Pandas, Matplotlib, and Seaborn), Power BI ( PQ, Data Modeling, DAX, Dashboarding), and Statistics.
    When I go to any job portals, it says you need to know machine learning, and deep learning too. 🥲
    Can I get a job with these skills?