Map Reduce Paper - Distributed data processing

Поділитися
Вставка
  • Опубліковано 14 січ 2025

КОМЕНТАРІ • 29

  • @umessi10
    @umessi10 4 роки тому +32

    It's incredible how you compress a complex paper that can take days or even weeks to fully grasp into a ten minute video. You are an amazing teacher. Props to your animation that is on point.

  • @TheModernPolymath
    @TheModernPolymath 2 роки тому +4

    i cant even begin to explain the level of clarity i achieved after watching this video!! Thanks a lot sir! Please keep posting more videos, it is very helpful for students like us :)

  • @jigyasarathod6194
    @jigyasarathod6194 4 роки тому +3

    Really very well explained in a very short amount of time! Much appreciated

  • @chinmaykajalwa
    @chinmaykajalwa 2 роки тому

    The best explanation and pictorial representation of Map Reduce I came across. I saved this Playlist. It is too good and useful.

  • @monishchhadwa777
    @monishchhadwa777 Рік тому

    You are an excellent teacher!
    Please keep making more such videos.

  • @trysubbu100
    @trysubbu100 2 роки тому

    awesome and crystal clear explanation. Such a big topic condensed to 10 minutes video. kudos to your work

  • @MrGreen-kq4ds
    @MrGreen-kq4ds 5 років тому +5

    thank u! can't wait for bigtable design review.
    please do a zookeeper / etcd one.

  • @ashokrajur09
    @ashokrajur09 3 роки тому

    short and crisp explanation, thank you

  • @aristonchen8782
    @aristonchen8782 4 роки тому

    the best explaining video of this concept i have ever seen. Thanks :)

  • @talirabetti8066
    @talirabetti8066 5 років тому +1

    Thank you for the video! Very clear explanation. I especially liked the examples part.

  • @manukhandelwal8878
    @manukhandelwal8878 5 років тому +1

    I highly appreciate the work you do. Keep up the great work

  • @tarunbhatia8652
    @tarunbhatia8652 4 роки тому

    One of the best explanation you can find on internet ! Please make a video on HDFS

  • @SatyaprasadMr
    @SatyaprasadMr 3 роки тому +1

    After a long time I found excellent videos. May I request you to create videos/playlist on Kafka, Cassandra and AWS Cloud. I see them very tricky and hard to understand. Thanks for making awesome videos.

  • @yashwantdhole1228
    @yashwantdhole1228 2 роки тому

    Excellent explanation....👍👍👍

  • @ruhinapatel6530
    @ruhinapatel6530 2 роки тому

    You are brilliant

  • @glsruthi6522
    @glsruthi6522 4 роки тому

    Thanks for such awesome explanation. Keep doing the great work 😁👏

  • @sanchitsingh7089
    @sanchitsingh7089 4 роки тому

    Dude, this was an amazing explanation!!

  • @siddheshswnt
    @siddheshswnt 5 років тому +2

    Need Google big data table video as you promised in GFS video.

  • @HarmonicQuest
    @HarmonicQuest 2 роки тому

    That was really good !!!

  • @jennybolena2341
    @jennybolena2341 4 роки тому

    Great explanation!!

  • @feniljagani6150
    @feniljagani6150 3 роки тому

    Excellent!!

  • @songzhu1085
    @songzhu1085 3 роки тому

    Good

  • @sugyansahu9120
    @sugyansahu9120 5 років тому +1

    very good that you also covering latest technologies like Hadoop ecosystem. Expecting more things like these. 🙂

  • @Anotender
    @Anotender 4 роки тому

    Really good explanation! However, I have one question. I may have missed something but how exactly it deals with chunks replicated over a couple of nodes? There may be a case when we use some data twice so it can impact the result.

    • @architsaxena3792
      @architsaxena3792 3 роки тому +1

      I think that's why client informs master right. I mean master has all info where the nodes are duplicated so it can avoid duplicate servers.

    • @user-em9mw9ch3y
      @user-em9mw9ch3y 3 роки тому +1

      operations are run on only one of the 3 replicas ( remember that out of 3 servers, 1 is primary and other are secondary). If the primary fails, the GFS master sends the operation (map ) function to another secondary replica keeping the data and final result in the same server.
      my humble answer. Corrections are welcome.

  • @PratapSingh-dz9tj
    @PratapSingh-dz9tj 2 роки тому

    Can't we get read/write frequency count from GFS master log files itself which is Stored remotely since it have read write log for files, I Just learning so might i understood wrongly

    • @DefogTech
      @DefogTech  2 роки тому

      GFS's responsibility is to act as massive hard-disk, it does not have understanding of what is written on files. If you check the GFS video, clients directly store data on individual machines, and GFS Master is not aware of what is being written.

  • @pulkitbajpai01
    @pulkitbajpai01 5 років тому

    i hv certain questions related to java memory manegement and out of meemory...where i can send