Understand Where Azure Data Services Really Fit in Your Data Flow!

Поділитися
Вставка
  • Опубліковано 9 лип 2024
  • In this video I walk through some of the major data services in Azure and where they fit in the larger data solution for an organization.
    00:00 Introduction
    00:47 Types of source data
    02:35 Answers from data and data warehouse
    03:45 Data transformation solutions
    04:51 HDInsight
    06:30 Databricks
    07:45 ETL
    08:25 Data lake and ELT
    10:45 Data factory and control flow
    14:43 Azure Analysis Services
    16:25 Azure Synapse Analytics
    18:35 Azure Purview and insight into data
    20:16 Summary and close
  • Наука та технологія

КОМЕНТАРІ • 52

  • @carlosalonsocapilla4796
    @carlosalonsocapilla4796 3 роки тому +19

    You should do more "data tutorials" in Azure because you explain very well all the available tools and what is their use.

  • @hanhgio
    @hanhgio 2 роки тому +1

    You seem to read my mind. Every time I look for something there is a video of you explaining. Thanks

    • @lbros6941
      @lbros6941 4 місяці тому

      Same here. John always has a video for all that info ill be looking for. Appreciate the time he spends in preparing these for us. Right now im preparing for Data Architect interview next week , and this video is very helpful. Thank you John.

  • @satori8626
    @satori8626 Рік тому

    I have watched entire videos dedicated to discussions on ETL VS ELT, but haven't been able to grasp the difference. This is the first time it really clicks for me, even though it was not even the main purpose of the video. Thank you!

  • @mohammedmohammedsaeed9547
    @mohammedmohammedsaeed9547 Рік тому +1

    Another great video to make our life as a learners better. Thank you John.

  • @Cloud-rb9oo
    @Cloud-rb9oo 5 місяців тому

    I am preparing about different data services for 305, and the moment I keep the book down, I forget the overlaps between say like Stream Analytics and Synapse Analytics. DataLake vs others. When I search on UA-cam, I am always overjoyed and more of a relief when I find you have made a video on that topic. Now I plan to grab a cuppa and come back and hit the play button. Thank You. PS: I dont have to see it to know this will clarify the fuzziness my head. Thank you so much, John!

    • @Cloud-rb9oo
      @Cloud-rb9oo 5 місяців тому

      Added later for those new to this channel - got the dots connected and learnt something new - Purview. Once you get the dots connected, you will never forget.

  • @ashokvenkat8420
    @ashokvenkat8420 Рік тому

    Microsoft owe you for this explaination!!! Thank you so much!! for this John..

  • @ritchierobinson5248
    @ritchierobinson5248 2 роки тому

    What a brilliant video to simplify information that is actually quite complex! Thank you for this.

  • @helennamannila4464
    @helennamannila4464 2 роки тому

    This was a really useful video - even though I'd watched it before, my CTO highlighted it for a few recent use cases, and it really does make everything come together into a cohesive whole. Thank you - really appreciated!

  • @mauriciozaragoza3709
    @mauriciozaragoza3709 Рік тому

    Thanks for the video John. I will renew my Azure Architect cert soon and needed a quick way to remember all of these. Great work making hard things easy. God bless you.

  • @brianmedlin3647
    @brianmedlin3647 3 роки тому

    I am deeply grateful for the distilled knowledge and articulate presentation in this and all your videos. Thank you John!

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому

      You are welcome. Thanks for watching

  • @23inflicted
    @23inflicted 3 роки тому +1

    As an azure data engineer, you nailed the overview. Thanks!

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому

      Great to hear, thank you!

  • @userhelen1
    @userhelen1 2 роки тому

    Thank you so much for such great explanation. I can remember this now for my exam az-305. I listen to so many other videos and very hard to remember all this info if you didn't work on those specific technologies. I listen to your video once, and now I will not forget it :)

  • @henriquealexandreh
    @henriquealexandreh Рік тому

    Nice video! Thanks John.

  • @nikibray7109
    @nikibray7109 2 роки тому

    Thank you - this is so helpful, I've been trying to get my head around data bricks, data factory and synapse for weeks - its all now so clear!

  • @ubaidimran7102
    @ubaidimran7102 Рік тому

    beautiful presentation!

  • @Moh3enJamali
    @Moh3enJamali 2 місяці тому

    Nice and clear. Thanks.

  • @patrickboucher892
    @patrickboucher892 3 роки тому

    merci John. Brilliant !

  • @coder8515
    @coder8515 3 роки тому

    John, thanks for awesome overview. Very helpful!

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому

      Glad it was helpful!

  • @emekaegbuonu1871
    @emekaegbuonu1871 2 роки тому

    This is simply fantastic…it brought it down to me.

    • @emekaegbuonu1871
      @emekaegbuonu1871 2 роки тому

      Hi John
      So am currently looking at governance framework for Azure. What are the components to consider when applying governance to Azure..?

  • @MrRyanegal
    @MrRyanegal 19 днів тому

    This is really awesome. Great work!!

  • @melmixpita543
    @melmixpita543 2 роки тому

    Amazing video. Just what I needed :)

  • @bingomutant1
    @bingomutant1 3 роки тому

    great to have an overiew like this thankyou John

  • @yegunkim9364
    @yegunkim9364 8 місяців тому

    Thanks for great overview, Nice video!

    • @NTFAQGuy
      @NTFAQGuy  8 місяців тому

      Glad you liked it!

  • @yanhancozypet
    @yanhancozypet 10 місяців тому

    Another great content !

    • @NTFAQGuy
      @NTFAQGuy  10 місяців тому

      Much appreciated!

  • @invictuslegend4405
    @invictuslegend4405 3 роки тому

    Great summary John! Would love to hear your take on cosmos DB. You make complex things easy to understand! Thank you.

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому

      I talk about cosmosdb in the database master class. Thanks.

  • @rashidakhtar4789
    @rashidakhtar4789 3 роки тому

    Hi John, as per all your videos, fantastic job in simplifying and breaking it down. Would love a deep dive for Azure Data Services

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому

      i have a master class module on database already.

  • @tipsandhacksbygaurav
    @tipsandhacksbygaurav Рік тому

    Really helpful

  • @aswathanarayana
    @aswathanarayana 3 роки тому +1

    Hi John,
    First of all Thank you for the video. I still remember Pluralsight path for DP-201 exam where 90% of the courses were authored by you and they really helped me to clear the exam.
    I can see that there are less number of tutorials particularly on the streaming pipelines. Please do youtube playlist on the streaming pipelines touching services like Azure Eventhubs, Stream Analytics etc. It would be of great help. Again Thanks for bringing in some content during holidays.

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому +1

      Glad the content was useful.

  • @dylanhughes5630
    @dylanhughes5630 3 роки тому +1

    One of my customers has now started looking at Azure Data Catalog as well so would be nice if that got a mention 😀

  • @prasnig
    @prasnig 3 роки тому

    Great Explanation !! would have loved to understand where AZ AI/ML services and AZ SnowFlake services fit in

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому

      Glad it was helpful

  • @kristurk1
    @kristurk1 3 роки тому

    Great Video John as always... I didn't realise how realistic MS Whiteboard app was :P 17:05 your whiteboard marker kind of runs out of ink, made my chuckle

  • @danielrobertson3302
    @danielrobertson3302 3 роки тому +1

    The thing that I still struggle with is when to choose one service over the other since there is a lot of overlap within the data services with offering ETL capabilities within their service (still leveraging ADF under the hood), using Spark, ad-hoc SQL analytics and so on. I suppose that's the the point, to find the shoe that fits, but it makes it confusing for a non-data guy like me!

    • @NTFAQGuy
      @NTFAQGuy  3 роки тому +1

      data factory is very much a data integration platform now providing UI based data plane features (using sparc underneath) so likely start with data factory and use others if you need.