Azure End-To-End Data Engineering Project (From Zero to Pro)

Поділитися
Вставка
  • Опубліковано 30 лис 2024

КОМЕНТАРІ • 86

  • @ranjithpower1891
    @ranjithpower1891 3 дні тому

    Great job explaining the Azure Data Engineer project! The step-by-step breakdown of data pipelines, storage, and integration with various Azure services was clear and insightful. This video truly showcases the power of Azure in handling real-time data.
    I'm really looking forward to more content like this. the real-time project continues.......and covers scenario-based interview questions as well bro

    • @ranjithpower1891
      @ranjithpower1891 2 дні тому

      next video you can use an SAS token to access the storage account

  • @AnshLambaJSR
    @AnshLambaJSR  9 днів тому +5

    Hey my DATA FAM ❤ Pls SUBSCRIBE the channel to support my hardwork. Do LIKE and SHARE the video! HAPPY LEARNING!

    • @VikashKumar0409
      @VikashKumar0409 6 днів тому

      Thanks for such a good and informative content man. Can you give some ideas like what things you have planned for the next few months like the timeline of content

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому +1

      @@VikashKumar0409 Thank you so much for the positive feedback. Will notify soon. Stay tuned and pls subscribe :)

  • @yogitakarande1233
    @yogitakarande1233 5 днів тому +2

    Amazing project and explained in very simple.. looking forward for more real time azure project related to pyspark and databricks

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      Thank you so much. Sure, will add more. Pls subscribe and share it with others :)

  • @shivadev9558
    @shivadev9558 6 днів тому +3

    Hey my brother. U r back again. Whenever I see your video i smile and forget every pain I faced in my life . As am trying for azure data engineer u r videos means a lot to me. I will never skip even I second of your videos. U r really making my days from past 2weeks. Again I am the first commenter and viewer . 😊

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      I am so happy that my videos are so helpful to you. Stay tuned and share it with others. Happy Learning :)

    • @shivadev9558
      @shivadev9558 6 днів тому

      @AnshLambaJSR I am financially weak now due to betrayal of friends. But knowledge u r giving us really helping to crack my interviews and earn myself.
      I request you to upload more and more videos. I want to deep dive in an azure cloud. Please make separate videos on each topic like adf, adb and synapse.

    • @vidyaeedara3336
      @vidyaeedara3336 6 днів тому +1

      Hi bro iam also trying to get in to azure data engineer role I loved your videos.thanks for sharing your knowledge.❤🎉

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      @@vidyaeedara3336 Thank you so much for loving my content. Pls subscribe and share it with others :)

  • @ReddyD-n8j
    @ReddyD-n8j 6 днів тому +1

    I have done up to dynamic pipeline run succeeded . Thanks bro its very useful content you are doing good job

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      Wow! that's great. Keep learning and share it with others as well :)

  • @vu8354
    @vu8354 5 днів тому +1

    Sir thanks one more time from data Engineer fan's ❤

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      Thank you so much for your feedback. Pls subscribe and share it with others :)

  • @jaganmohanthota8318
    @jaganmohanthota8318 3 дні тому

    5* Rataing way of explanation and teaching 🎉🎉🎉🎉🎉 Thanks bro

    • @AnshLambaJSR
      @AnshLambaJSR  2 дні тому

      I am happy that you gave 5 star ratings for my content. Happy Learning !

  • @arokiarajan1230
    @arokiarajan1230 5 днів тому +1

    Thanks Bro. Good lecturing for non-technical background. ❤ TY.!

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      Thank you so much for your kind words. Pls subscribe and share it with others :)

  • @Heatflakes
    @Heatflakes 5 днів тому +1

    Really enjoying learning data engineering the way you teach. Following you from your first adventureworks project. I have also shared with my friends. Thanks for everything 😀

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому +1

      So sweet of you. I am happy that you love my content. Happy Learning :)

  • @siddheshdhamale8019
    @siddheshdhamale8019 2 дні тому +1

    Great Project ! Very Helpful ! Ansh it will very useful if you create something on Data Validation in azure ani actual data monitoring

    • @AnshLambaJSR
      @AnshLambaJSR  День тому

      I am happy that you liked the video. Sure, stay tuned :)

  • @rahul2506
    @rahul2506 День тому +1

    Your content is awesome.Can you come up with Kafka and Airflow one shot videos just like your PySpark Videos....

    • @AnshLambaJSR
      @AnshLambaJSR  День тому

      I am happy that you found my content useful. Sure, stay tuned :)

  • @WaseemPashaZ
    @WaseemPashaZ 5 днів тому +1

    Thanks and looking forward for moreeee real time projects 😮

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      I am happy that you love the content. Pls subscribe and share it with others. Happy Learning :)

  • @Suryaprakash-v9j8z
    @Suryaprakash-v9j8z 3 дні тому

    Really its a wonderful one..looking more videos from you bro.❤

    • @AnshLambaJSR
      @AnshLambaJSR  2 дні тому

      Thank you for your lovely feedback. Pls subscribe and share it with others :)

  • @ganeshawarde8037
    @ganeshawarde8037 6 днів тому +1

    Thank you bro!
    for your efforts, it helps a lot
    and keep posting data engineering related content.✨

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому +1

      I am happy that you found my video insightful. Pls subscribe and share it with others :)

  • @aayushiagrawal1001
    @aayushiagrawal1001 2 дні тому

    Hi Ansh, great effort in providing comprehensive end-to-end videos all at once. Truly appreciate it! Since Databricks is an emerging technology, could you create a detailed video covering Delta Lake, Delta Tables, and live streaming data in Databricks

    • @AnshLambaJSR
      @AnshLambaJSR  2 дні тому

      I am happy that you found the video insightful. Sure, stay tuned :)

  • @sayalabhaskar167
    @sayalabhaskar167 5 днів тому +2

    Please Create Video on required SQL and also create video on how to move code from DEV -> QA -> Prd

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      I am happy that you are excited for more videos. Sure, will cover soon. Stay tuned :)

  • @kaushalsharma685
    @kaushalsharma685 6 днів тому +2

    I love your vedios it is amazing respect bro

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      Thank you so much for your positive feedback. Stay tuned and Happy Learning :)

  • @RadhaKrishna-i7s
    @RadhaKrishna-i7s 5 днів тому +1

    Thanks you bro for your efforts,it hleps a alot ❤

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      I am glad that you loved the video. Pls subscribe and share it with others :)

  • @rafekhan8667
    @rafekhan8667 5 днів тому +1

    Thanks brother ❤

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      I am happy that you like the video. Pls subscribe and share it with others :)

  • @rabink.5115
    @rabink.5115 6 днів тому +2

    Hi ansh. really loving your contet. The simplicity you bring up while explaining the project is awesome. Could you please make something on kafka project? Anythought on AWS project too?

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому +1

      I am glad to receive such a great feedback. Sure, stay tuned for these topics as well. Happy Learning :)

  • @eswarbonam8510
    @eswarbonam8510 2 дні тому +1

    VVV Good efforts bro

    • @AnshLambaJSR
      @AnshLambaJSR  2 дні тому

      Thank you so much. I am happy you appreciated my content. Pls subscribe and stay tuned :)

  • @MsMohanj
    @MsMohanj 6 днів тому +1

    Thanks for your effort the way of. Your teaching is giving more confident and interest in the topic keep on rock bro
    You are ture your video is full filled the missing topics my request can you explain real-time non-prod to prod migration pipeline in azure

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      I am so happy that you love my content. Thank your for your kind words. Sure, will cover these topics as well. Pls subscribe and share it with others :)

  • @dhanrajdesai3668
    @dhanrajdesai3668 5 днів тому +1

    Really thanks

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      Thank you for the positive feedback :)

  • @zulfiqar7967
    @zulfiqar7967 6 днів тому +1

    I appreciate your work, but keep doing this based on roadmap.. or add it in playlist.. so everyone know which to watch first

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      Thank you so much for the positive feedback. Sure!

  • @sayalabhaskar167
    @sayalabhaskar167 7 годин тому

    is it possible to extend this project - like when 2024 year have full data, automatically process and append to existing tables. Add incremental load, full load, unity catelog, autoloader & cicd concepts to NYC taxi. Please create video as part2

  • @siddeshbb-o5q
    @siddeshbb-o5q 6 днів тому +1

    Thanks Ansh for this end to end to project. Is psypark ( 6 gours courcse) required before starting this project ?

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      I am happy to see this excitement. You can start this video without any other video. This video has covered everything from scratch :)

    • @siddeshbb-o5q
      @siddeshbb-o5q 20 годин тому

      @@AnshLambaJSR Thanks :)💗

  • @mohitjoshi8984
    @mohitjoshi8984 6 днів тому +1

    Great project.
    Bro can you make a full azure tutorial for ML and Data engineering

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      I am happy that you loved this project. Sure, pls subscribe and stay tuned. Happy Learning :)

  • @zulfiqar7967
    @zulfiqar7967 6 днів тому +1

    Bro.. Youre doing so good ❣️
    Aws or Azure, which cloud is good to go for Big Data engineer ?
    And which has good job opportunities and growth?

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      Thank you so much for your kind words. I am really happy that you liked the video. You can go with any cloud platform. I would pick Azure !

  • @karpuramvamsi9176
    @karpuramvamsi9176 6 днів тому +1

    Hi ansh. please explain fabric architecture like do end to end project from basics to advaned level please please

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      I am happy that you want more from me. Sure, will add soon. Stay tuned :)

  • @mohammadfurquan241
    @mohammadfurquan241 3 дні тому

    Sir please make a video on Data Engineering project based on AWS

  • @AlHasan-sh3il
    @AlHasan-sh3il 4 дні тому +1

    Brother, no one makes videos in Hindi like this , please brother , make some videos in Hindi 😭🙏🙏

  • @naveenkumar-sw1qg
    @naveenkumar-sw1qg 5 днів тому +1

    I'm learning azure cloud is this useful for me to learn this project

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      This project will give you end-to-end understanding. Happy Learning :)

  • @moinzajam5117
    @moinzajam5117 5 днів тому +1

    Data engineer roadmap with free resources. MAKE a vedio on this topic....

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      Thank you so much for the suggestion. Pls subscribe and share it with others :)

  • @satyaprakashpattanaik9080
    @satyaprakashpattanaik9080 6 днів тому +2

    Can we have a Full Airflow tutorial???

  • @sayalabhaskar167
    @sayalabhaskar167 5 днів тому +1

    Tell me One Thing Ansh , Is Databricks is easy? Why I am asking this question, because i worked with different team in my organization. If it is migration project from hive code to data bricks code, people say hard, not migration people say easy. From past one year i am trying to learn, but i learned zero. May be this time i will be complete

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому

      Everything is easy if you learn using right resources. You will find content on this channel from scratch. So, start learning now. happy learning :)

  • @chaitanyanagare757
    @chaitanyanagare757 5 днів тому +1

    Hi Ansh, You are delivering really very Good content as of now and we are following you with your every week videos.. Thanks a lot. Please upload next video on SCD Types in Data Warehouse with Fact and Dimenssion Table project!

    • @AnshLambaJSR
      @AnshLambaJSR  5 днів тому +1

      Thank you so much for your kind words. I'm really happy that you are following the videos since day 1. Keep supporting :)

  • @moyeenshaikh4378
    @moyeenshaikh4378 6 днів тому +1

    How is it different from previous one?

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому +3

      This project contains different scenarios and have a different architecture. Also, DELTA LAKE is explained in detail. Happy Learning !

  • @jovanhimal669
    @jovanhimal669 6 днів тому +1

    Amazing and do detail, pls if you can, can you speak in lit less speed ?

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      Thank you for your positive feedback. Haha, sure!

  • @pratikpatil7133
    @pratikpatil7133 6 днів тому +1

    Bro i was following your first video of like 5 hrs end to end pipeline . What's different in this?

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому +1

      Thank you for following my content. Every project is unique to cover different scenarios. This will explain Delta Lake in detail. Happy Learning:)

  • @SharadSonwane-xk1ht
    @SharadSonwane-xk1ht 6 днів тому +1

    👍

  • @lakshmiprasadpresident4462
    @lakshmiprasadpresident4462 6 днів тому +1

    Aws data engineering
    Aws airflow

    • @AnshLambaJSR
      @AnshLambaJSR  6 днів тому

      I happy that you want more. Soon, stay tuned :)