You have managed to take the written article published by google and explains Google File System and MapReduce in a very good, clear way so anyone can consume it. good job!
Excellent Explanation sir. Loved it. Wanted to learn more on it. I am now big fan of yours. Watched most of your videos and trying to read as much possible from you sir. Please consider to share more videos on this topic.
FWIW the google paper left out some of the details you needed for full resilience. We had to learn those through things going wrong -e.g the infamous facebook cascade failure where, once a critical mass of servers went offline, the recovery work took the rest down
Very nice explanation. Thank you so much for the same. I had a few questions - 1. Which type(s) pf write operation(s) can a client application perform on the files. In other words, what does GFS supports in terms of writing into files? 2. Where in the file the writing can be done? 3. How much data can be written there and by how many applications at the same time and at the same location? 4. In what type of memory is the metadata stored on the master
Bit late but hopefully others find it useful: Regarding (1) & (2), GFS was primarily aimed at applications which involved appending data to a long-running file, with random location writes happening rarely (if at all). For (3), the limits would depend on the actual implementation - this was just a theoretical paper on GFS. But yes, it is meant to support concurrent writes. And regarding (4), the Master keeps a track of all the files on the GFS, a list of chunk handlers that make up each file, and the list of chunk servers that hold a particular chunk (there are multiple servers for redundancy) Additionally the master keeps a log of all the changes that were made (along with checkpoints), so that it can recover from crashes
Thanks for the great content. But I haven't seen any recent videos from you, it'd be great if you start making these videos again, they're just wonderful.
🙏 You are the Best Teacher that I have ever seen.🥇, A classical method of approach = Superb indeed.👌.🎯Please Could you kindly teach us Flutter & Dart & Go lang & Scala too . Pleeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeese Sir..... 🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏
hey, thanks so much for reaching out.. just been busy with new job, and added laziness :( I am researching for NoSQL series, but will take time. Regarding funding, absolutely.. I love teaching and hope to someday do this fulltime. Might start UA-cam subscriptions for earning. Let me know your thoughts, is ~130 INR a month something everyone would go for, or should it be course based fees on a separate website?
@@DefogTech , this channel is my first point of reference for any cs related topic , things that make your videos unique are the awesome slides , quality content & very crisp explanation. I myself being a software professional at Adobe frequently watch your videos, so yes youtube subscription seem to be a viable option. Hoping you to resume soon so that we can make best amidst the lockdown. :)
You have managed to take the written article published by google and explains Google File System and MapReduce in a very good, clear way so anyone can consume it. good job!
This is how one should teach. Loved it!
Best explanation of GFS on UA-cam. This is how one should teach. Wish the channel had posted more such videos.
amazing video. the finest tutorial of GFS on youtube.
high quality video. your explanations are clear as crystal
Thank you for getting into distributed systems realm. Would love to see some videos about the workings of cassandra.
Now I realsed that my teacher must have watched this video before lecture .
Your explanation is GREAT.
This explanation and the voice clarity is too good, thanks a lot for the video
Excellent video clearing the basics of GFS.
So a simple explanation. Amazing.
Very well systematically explanation.! Great Work! Thank you. God bless you.
Amazing video, super clear.
Your videos are crisp and very clear. Thanks. Keep up the good work😊👍
Very well explained. Thanks for the content and effort
Excellent Explanation sir. Loved it. Wanted to learn more on it. I am now big fan of yours. Watched most of your videos and trying to read as much possible from you sir. Please consider to share more videos on this topic.
Thank you so much for your kind words! Planning to do more videos soon
Amazing video. Thank you so much
Explained clearly. Thanks.
Such a good explanation.
Very nicely explained. Thank you.
Very well explained and articulated.
FWIW the google paper left out some of the details you needed for full resilience. We had to learn those through things going wrong -e.g the infamous facebook cascade failure where, once a critical mass of servers went offline, the recovery work took the rest down
Very good explanation!
Perfect explanation .Thank you for this.
Great job!
Exceptional sir.
Very nice explanation. Thank you so much for the same. I had a few questions - 1. Which type(s) pf write operation(s) can a client application perform on the files. In other words, what does GFS supports in terms of writing into files? 2. Where in the file the writing can be done? 3. How much data can be written there and by how many applications at the same time and at the same location? 4. In what type of memory is the metadata stored on the master
Bit late but hopefully others find it useful:
Regarding (1) & (2), GFS was primarily aimed at applications which involved appending data to a long-running file, with random location writes happening rarely (if at all).
For (3), the limits would depend on the actual implementation - this was just a theoretical paper on GFS. But yes, it is meant to support concurrent writes.
And regarding (4), the Master keeps a track of all the files on the GFS, a list of chunk handlers that make up each file, and the list of chunk servers that hold a particular chunk (there are multiple servers for redundancy)
Additionally the master keeps a log of all the changes that were made (along with checkpoints), so that it can recover from crashes
Nice! Very easy to follow
Very nicely explained.Thanks a lot :)
Very well explained , thanks
great content , thank you
Well explained ,thank you.
Thanks for the great content. But I haven't seen any recent videos from you, it'd be great if you start making these videos again, they're just wonderful.
Great explanation
🙏 You are the Best Teacher that I have ever seen.🥇, A classical method of approach = Superb indeed.👌.🎯Please Could you kindly teach us Flutter & Dart & Go lang & Scala too . Pleeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeese Sir..... 🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏
Thank you so much for the kind words. Definitely plan to continue creating videos, and also covering more topics like Dart and Go
Great explanation! Thanks.
Thank you! a very clear explanation.
Can't wait for the BigTable and DynamoDB episodes!! Also can you do one on pagerank?
Epic!
Really good video.
its architecture somewhat similar to napster ( I think napster was ahead of its time)
Good work
I really like your videos and regular follower of your channel. Please publish a video on Cassandra architecture. If possible.
Yes sir! Cassandra is similar to Google Bigtable. Will cover it soon.
Awesome 👍
Awesome
Well done,thank you
Great video. Thanks for making. There is a typo in the last slide about chunk size being 64kb instead of 64mb :)
waw u explained so smilply
Thank you so much..
Very helpful.
Thanks, can you also explain MapReduce please?
Absolutely. That video is coming tomorrow!
If each chunk has 3 replicas, then will there be a total of 4 such chunks ?
Good one buddy👏
Thank you buddy! Btw, Congrats on 40K, that was fast!
Defog Tech thanks dude🙏🏻
I m happy to see 2 good Java content creators at one place. Continue the legacy. :)
Sanjay Kantheti 🤘
Thank you for your video
Hi , Can you make video related to transaction management ,propagations ,isolations,2-phase commit, deadlocks in transactions..
Hey , why have you stopped uploading videos....let me know if you need any funding
hey, thanks so much for reaching out.. just been busy with new job, and added laziness :(
I am researching for NoSQL series, but will take time.
Regarding funding, absolutely.. I love teaching and hope to someday do this fulltime. Might start UA-cam subscriptions for earning. Let me know your thoughts, is ~130 INR a month something everyone would go for, or should it be course based fees on a separate website?
@@DefogTech , this channel is my first point of reference for any cs related topic , things that make your videos unique are the awesome slides , quality content & very crisp explanation. I myself being a software professional at Adobe frequently watch your videos, so yes youtube subscription seem to be a viable option. Hoping you to resume soon so that we can make best amidst the lockdown. :)
Hey , request you to please make new video.
Eagerly waiting for your new videos.
Perfect.
Gr8
Can you please do Dynamo paper
is the master something like a zookeeper?
No, it's a single instance backed by a secondary one unlike concensus based one like zookeeper
👍🏿👍🏿👍🏿
💙
The chunk is **64KB** NOT MB
It is 64MB. GFS is used mainly for large files with append-only structure. In the paper there is good trade-off of why they chose 64MB.
MB
Very clear explanation. Thank you!
Great explanation.
Awesome explanation