Map Reduce Paper - Distributed data processing

Поділитися
Вставка
  • Опубліковано 12 вер 2024

КОМЕНТАРІ • 29

  • @umessi10
    @umessi10 4 роки тому +32

    It's incredible how you compress a complex paper that can take days or even weeks to fully grasp into a ten minute video. You are an amazing teacher. Props to your animation that is on point.

  • @TheModernPolymath
    @TheModernPolymath Рік тому +4

    i cant even begin to explain the level of clarity i achieved after watching this video!! Thanks a lot sir! Please keep posting more videos, it is very helpful for students like us :)

  • @jigyasarathod6194
    @jigyasarathod6194 3 роки тому +3

    Really very well explained in a very short amount of time! Much appreciated

  • @MrGreen-kq4ds
    @MrGreen-kq4ds 4 роки тому +5

    thank u! can't wait for bigtable design review.
    please do a zookeeper / etcd one.

  • @chinmaykajalwa
    @chinmaykajalwa Рік тому

    The best explanation and pictorial representation of Map Reduce I came across. I saved this Playlist. It is too good and useful.

  • @trysubbu100
    @trysubbu100 2 роки тому

    awesome and crystal clear explanation. Such a big topic condensed to 10 minutes video. kudos to your work

  • @monishchhadwa777
    @monishchhadwa777 8 місяців тому

    You are an excellent teacher!
    Please keep making more such videos.

  • @talirabetti8066
    @talirabetti8066 5 років тому +1

    Thank you for the video! Very clear explanation. I especially liked the examples part.

  • @tarunbhatia8652
    @tarunbhatia8652 4 роки тому

    One of the best explanation you can find on internet ! Please make a video on HDFS

  • @SatyaprasadMr
    @SatyaprasadMr 3 роки тому +1

    After a long time I found excellent videos. May I request you to create videos/playlist on Kafka, Cassandra and AWS Cloud. I see them very tricky and hard to understand. Thanks for making awesome videos.

  • @manukhandelwal8878
    @manukhandelwal8878 5 років тому +1

    I highly appreciate the work you do. Keep up the great work

  • @aristonchen8782
    @aristonchen8782 3 роки тому

    the best explaining video of this concept i have ever seen. Thanks :)

  • @ashokrajur09
    @ashokrajur09 2 роки тому

    short and crisp explanation, thank you

  • @glsruthi6522
    @glsruthi6522 3 роки тому

    Thanks for such awesome explanation. Keep doing the great work 😁👏

  • @sugyansahu9120
    @sugyansahu9120 5 років тому +1

    very good that you also covering latest technologies like Hadoop ecosystem. Expecting more things like these. 🙂

  • @sanchitsingh7089
    @sanchitsingh7089 4 роки тому

    Dude, this was an amazing explanation!!

  • @siddheshswnt
    @siddheshswnt 4 роки тому +2

    Need Google big data table video as you promised in GFS video.

  • @HarmonicQuest
    @HarmonicQuest 2 роки тому

    That was really good !!!

  • @yashwantdhole1228
    @yashwantdhole1228 2 роки тому

    Excellent explanation....👍👍👍

  • @feniljagani6150
    @feniljagani6150 3 роки тому

    Excellent!!

  • @jennybolena2341
    @jennybolena2341 4 роки тому

    Great explanation!!

  • @ruhinapatel6530
    @ruhinapatel6530 2 роки тому

    You are brilliant

  • @songzhu1085
    @songzhu1085 3 роки тому

    Good

  • @Anotender
    @Anotender 4 роки тому

    Really good explanation! However, I have one question. I may have missed something but how exactly it deals with chunks replicated over a couple of nodes? There may be a case when we use some data twice so it can impact the result.

    • @architsaxena3792
      @architsaxena3792 3 роки тому +1

      I think that's why client informs master right. I mean master has all info where the nodes are duplicated so it can avoid duplicate servers.

    • @user-em9mw9ch3y
      @user-em9mw9ch3y 3 роки тому +1

      operations are run on only one of the 3 replicas ( remember that out of 3 servers, 1 is primary and other are secondary). If the primary fails, the GFS master sends the operation (map ) function to another secondary replica keeping the data and final result in the same server.
      my humble answer. Corrections are welcome.

  • @PratapSingh-dz9tj
    @PratapSingh-dz9tj Рік тому

    Can't we get read/write frequency count from GFS master log files itself which is Stored remotely since it have read write log for files, I Just learning so might i understood wrongly

    • @DefogTech
      @DefogTech  Рік тому

      GFS's responsibility is to act as massive hard-disk, it does not have understanding of what is written on files. If you check the GFS video, clients directly store data on individual machines, and GFS Master is not aware of what is being written.

  • @pulkitbajpai01
    @pulkitbajpai01 5 років тому

    i hv certain questions related to java memory manegement and out of meemory...where i can send