Apache Spark Architecture - EXPLAINED!

Поділитися
Вставка
  • Опубліковано 27 лис 2024

КОМЕНТАРІ • 36

  • @metinkonuk
    @metinkonuk 12 днів тому

    An hour felt like a few minutes thanks to your teaching skills, thank you for this tutorial.

  • @Lance-tr1qw
    @Lance-tr1qw 5 днів тому

    Thank you sou much for this informative tutorial. The best there is out there yet.

  • @maheshpatil3435
    @maheshpatil3435 15 днів тому

    The best way to explain the Spark in action. great tutorial..

  • @MassimoManfredino
    @MassimoManfredino 2 місяці тому +4

    Emil, finally I have fount one comprehensive tutorial about Spark architecture. I have subscribed your channel. Thanks a lot for your unvaluable support!

    • @DatabricksPro
      @DatabricksPro  2 місяці тому +1

      Pleasure on my side. I am very happy you like it and find it useful!

  • @aazimparwaz5386
    @aazimparwaz5386 2 місяці тому +1

    Amazing content! You've done absolute justice to explaining Spark! The breakdown of concepts is spot on and super easy to follow. Keep up the great work! Thank you!

    • @DatabricksPro
      @DatabricksPro  2 місяці тому +1

      Thanks for feedback. I am really happy to see this being useful!

  • @PankajSharma-z1h
    @PankajSharma-z1h Місяць тому +2

    The best spark tutorial on youtube!!

  • @honeyjohn2997
    @honeyjohn2997 Місяць тому +1

    I came across your video while searching for spark architecture, and it's incredibly well explained. The content is delivered at a great pace, not overly complicated but perfect for a beginner. I'm expecting more videos like this in the future. great job

    • @DatabricksPro
      @DatabricksPro  Місяць тому

      Thank you for feedback! Video about Delta Lake coming in 1-2 days. Hope you will like it as well.

    • @honeyjohn2997
      @honeyjohn2997 Місяць тому

      @@DatabricksPro can u plz provide the link to ur git repo for the code

  • @RavindraCh-tj6oz
    @RavindraCh-tj6oz 21 день тому

    Best video on spark Architecture

  • @yashshah8593
    @yashshah8593 3 місяці тому +1

    Very well explained and best part was to include examples for all the concept and explaination. Thanks for such great efforts.

    • @DatabricksPro
      @DatabricksPro  3 місяці тому +1

      Thanks! I am very happy that you liked it:)

  • @AdityaSingh-ps3vn
    @AdityaSingh-ps3vn 2 місяці тому

    This channel will explode in due time, great job! Looking forward to more such videos! (hopefully on spark optimisations soon). Thanks a lot!!

    • @DatabricksPro
      @DatabricksPro  2 місяці тому +1

      Thanks! Next week there will be a Delta Lake movie with a bit of optimizations approach.

  • @sekhar7419
    @sekhar7419 2 місяці тому +1

    That was really a great explanation, and covering each topic indeeply, I dont see anyone talk about sparkUI and the pwoer of it. Thanks really again

  • @Gaurav-pk2qc
    @Gaurav-pk2qc 2 місяці тому

    You nailed it perfectly Dimitri 😇

  • @wojciechjaniszewski9086
    @wojciechjaniszewski9086 7 днів тому

    really good content, right on the money! thank you for your effort!

  • @techmetothecloud
    @techmetothecloud 2 місяці тому +1

    You nailed it. Super useful video!!!

  • @ViralTube369
    @ViralTube369 Місяць тому +1

    🤙🤙💥Worthhhhhh spending time on this video. feels like zero to Hero

  • @lukaszwybieralski9520
    @lukaszwybieralski9520 Місяць тому

    Brilliant content, thank you!

  • @ramasahayamvarshini3816
    @ramasahayamvarshini3816 Місяць тому +1

    Too good explanation!!

  • @mertsevenz
    @mertsevenz Місяць тому

    Thanks for the great explanation! It would be perfect to also hear about your production deployment experiences in Databricks Delta Lake projects, including CI/CD, deploying bundles, monitoring, etc.

    • @DatabricksPro
      @DatabricksPro  Місяць тому

      Yes. I also think its a good idea. it will come

  • @sanjeevreddy3691
    @sanjeevreddy3691 Місяць тому

    thanks for your efforts

  • @cybersubhendu
    @cybersubhendu 3 місяці тому

    Hi!
    Thanks … indeed super thanks for such learning session on Spark. I wonder how many months of learning and understanding been put into 1 hour! I recomend this to all #databricks users to have this understanding of #spark to make life easy with the #development of #datapipeline or #dataanalytics or #dataanalysis or #optimizing your #codes.
    Thanks !!

  • @thamimmo
    @thamimmo 3 місяці тому

    Great work and thanks
    Could you please make a similar video like this on delta lake

    • @DatabricksPro
      @DatabricksPro  3 місяці тому +2

      I am glad you like it :) Delta lake is actually really good idea for the next movie.

  • @AliRjile
    @AliRjile 2 місяці тому

    Thank you :)

  • @sanjeevreddy3691
    @sanjeevreddy3691 Місяць тому

    query regarding cluster configuration ->
    while cluster configuration for example we specify node capacity as
    - 64 gb memory (it is RAM)
    - 8 cores
    how spark allocates -> storage (disk) ?
    from this 64 gb how it allocates for -> ram + disk?

  • @avskr-04
    @avskr-04 21 день тому

    Jiga bytes , airdd

  • @SonuKumar-fn1gn
    @SonuKumar-fn1gn 2 місяці тому

    Great video, Please im requesting you please where i get all this 5GB data please provide me link 🙏🙏🙏
    I want to use your data which hii have used so i understand eusly 🙏 please provide all 5Gb data

  • @rangareddy3722
    @rangareddy3722 2 місяці тому

    i’ve watched many videos and tutorials, none of them are in detailed. Awesome work🫡