To be honest, I immediately liked the video just by reading the title and without even watching the video. I was like "finally something new and not even new but also really interesting topic". Would like more of those kind of videos in the future, thank you
Graphics make all the complex concepts you cover super approachable. More 20-minute videos please! This was excellent. You covered all the important points concisely and only cut out details that can be found in the newsletter. I would suggest a TLDR of some kind at the start.
In fact, the implementation of leader election is needed even without the use of web workers. And many browsers do not have a shared worker. You can use a broadcast channel, "active tab" events, and local storage to elect a leader. And make sure that all requests to the server come only from the leading tab. Especially in the case of sockets, this reduces the load on the server hundreds of times -- people have a habit of not closing tabs -- in collaborative web application. And sometimes there can be several "read leaders" if you have 2+ active tabs/monitors at the same time.
Great great video! I have stumbled upon the "How Notion Cut Latency" posts on Linkedin multiple times previously, but the textual material always seemed too heavy or contained too much jargon to comprehend easily without losing patience. This video format & someone explaining as we go - is SOOO SOO much better! Please keep doing this. There's a lot of DSA content on UA-cam but almost no content such as this video. This could also be NeetCode's near future niche.
The cause of your website performance problems is database latency. Over the last 20 years, this has consistently been true for every system I've had to maintain. It's extra funny when they have gone to the effort to rice, using whatever meme language everyone is claiming to be fastest. Reducing the query count has taken operations from minutes to microseconds, and I keep having this experience every time I change teams.
Checks out to me. No matter how much flashy a software piece is, you will be limited by your hardware, and something that strictly enters disk manipulation for read & write (aka the DB) makes sense that will drastically slow your app
Feedbacks: 1- pictures are really good. I think you should keep it. It really helped visually internalizing some of concepts or design approaches. 2- The time was all right. For more complicated videos it makes sense to go longer. 3- Tying the content of the current video with entry level/beginner stuff (for eg ACID compliance at the end) is really good. That helped unveiling more of the complexity of what is happening. 4- I was originally not happy with the flow of the video (moving from subparts of the videos) but after reflecting I think it was fine Thank you for going that deep in the details of what exactly is happening and what is going wrong. That is what sets your system design video apart from the other content on UA-cam. Excited about where this is going.
I usually dont comment on the videos, but this made me comment because of your effort you put in the video creating it! Amazing video dude! I really liked the flow of the video and everything else.
I watched the whole video, I think the length is appropriate for the depth, thank you! I'd love to know how Notion does, or how you would, implement the sqlite part.
I love the way you explain. Definitely keep the visuals. Everytime i think wth he is talking about you immediately goes to basics of it and i really like this aspect of your explaining complex problems/designs. Thank you for providing such value on UA-cam.
You are f$$king fantastic. The depth vs breadth covered is amazingly on point. You point out the gotchas (e.g. SQLite is ACID compliant - so how come...?) which a lot of videos don't (creating a 'perfect system where everything just works' illusion). Your scribbling is even nice - does highlight and help my brain hold on to key concepts while it's dynamic enough that I don't lose focus. Overall, just keep killing it, man
I loved all the visuals and the explanations. I would prefer if these videos were 15 to 20 mins and not longer. The blog post can provide additional details. Also, this was one the best explanations I have seen to date.
This was super helpful and incredible video. I love learning about these kinds of stories since it mimics what engineers actually do on the job. It's also something I've wondered a lot myself!
Very cool video. Liked those hand-on explanation. The way you actually showed application tab, it's memory usage and the js file with log statements. Pls continue your good work. Looking forward to learn more from you!
One thing to note is this only improves the write queuing performance (which is fine as it's the bottleneck) as sqlite does not support concurrent writers as stated in the "when to use" docs: "SQLite only supports one writer at a time per database file. But in most cases, a write transaction only takes milliseconds and so multiple writers can simply take turns. SQLite will handle more write concurrency than many people suspect. Nevertheless, client/server database systems, because they have a long-running server process at hand to coordinate access, can usually handle far more write concurrency than SQLite ever will."
Loved the visuals loved the explanation and drawings. For the video, if anything I would love more depth. I feel that's what's mainly missing in all of UA-cam. Totally in for much longer videos or series where you fully cover a concept in high level and actual code/tech level. Hope to see that! For the newsletter I want to read it, but wonder can we only read it in the emails ? nowhere else? Just like to read in light mode or reading mode of some browsers if possible.
Awesome !!! The details, the code and yes the pictures - very very useful ... I have also signed up for your newsletter. Your leetcode videos are gold standard, and so was this.
great content i loved it but by the way at 11:35 i wanna say that basically threads share the same memory but processes don't , this is why processes they have to communicate through channels
ah good catch, in this case i believe while web workers run in a separate thread, from a programming perspective to me it still feels like they communicate with the main js thread the way different processes would communicate with each other. this is such a subtle point tho so someone please correct me if im wrong
Everything is good 📈😊, honestly It makes me stick to the video to the end. You should add the visuals like these to persuade the System design and very informative video BTW, I hope like me everyone expect this like understandable and knowledgeable video from you in the future . Thank you.
Awesome awesome video! Thank you for taking the time to draw and give a great explanation of their system, I found it really helped and connected all the pieces together! You are the GOAT. I love these types of videos. Keep up the great work!
the browser file API being the problem reminds of a talk by a database creator. He said that many people assume that if you write bytes to disk, and then immediately read them back, you get the same thing. Turns out that when you are creating a database, that's not "true enough" - from time to time the SSD or HDD gets corrupted, and you have take that into accound.
Liked the diagram pictures used & the length of the video was nice, I learned that this was possible from this video & knowing the pitfalls like the OPFS causing data corruption will save a lot of headaches I imagine.
This was extremely awesome and kept my attention intact and curiosity raised, drawing and images way of explanation is better (atleast for e) than rambling while showing up bunch of text. Thankyou so much. Btw might be a naive question, how do you get to know about news as such ? what are your sources?
Naive Question: does Notion solve for race between tabs? I.e. let’s say you have two tabs open on the same task but they are in two different states. one is newer - let’s say 2 paragraphs in the task description One with staler data. Focus is on the tab with the new data, and now you move to the old tab, add one char to your stale description and navigate to a different task. Will you lose your paragraphs ? (I don’t use notion… but intrigued)
Awsome video, awsome topic as well. I wanted to learn more about using sqlite for caching, particularly now with WASM tools like the sqlite-vec extension for vector search!! This was great! Visuals were great!
the visuals are good. obviously could always be better but i dont have further feedback on how. for the vid length could definitely cut it a bit. Thanks as always
Great video man! If you do get time make more videos on these concepts, atleast for things in you newsletter that you fell are video worthy! Again, great video man!
Dunno about cutting latency, but they did a lot if shite to make notion slow right after initial release. I remember how at first I was pretty happy how it was snappy as hell, but when our teams started to fill more documents it become slower. And then they've released a new update with new features and everything turned into a turtle - everything was slow as hell. Including simple selection and opening context menu.
Hi nav, I really enjoied a lot your video. I'm mind of tech lead in the places I work. We are doing aí stuff. And it's very good to me to see how others experts are solving their problems
Superb Content Bro! Expecting more and more such videos and more images ,graphics and code samples and less Text. I felt 20 minute is less , 30 minutes should be fine.
I actually prefer Informative videos and 'Hour-long-videos' actually doesn't matter to me yk, I'd like if you produce such contents as I really feel your ability to explain is pretty neat. Oh and also, really nice and informative visuals I really appreciate it.
Keep doing these videos, i learned a lot from this. Also this just made me realize than as a self taught sometimes you can invent your own solutions to overcome programming problems like workarounds same as what notion did with race requests etc
Loved the video, I like how you explained system design Often with bytebytego (which I do like) I do feel a little stumped at times Also if I understand correctly we are literally having a database on the client side?!? That seems wild, but why didn't they just use indexedDB
im so tired of programming man i just wanna sit and read a book man its so sad, I wanna get a ton of money in lottary or some unknown billioonaire uncle so I can just enjoy my life instead of focusing everything about practicing every day after work just to get freaking MONEY
Honestly, had a lot of fun making this one. How'd you like it and do you wanna see more?
Written version: neetcode.io/newsletter
Finally what we have all been waiting for. Neetdesign 🎉
Sure NeetCode. I really like the way you explain everything :)
yes , watched the video twice. its pure Gold. Need more and more videos.
For sure!
Yep really like this style of content, primeagen and t3gg theo are some of my favourite types specially as a beginner
To be honest, I immediately liked the video just by reading the title and without even watching the video. I was like "finally something new and not even new but also really interesting topic". Would like more of those kind of videos in the future, thank you
I love it.. the format, the video length, the topics coverage and of course the hands-on explanation. Looking forward to this series.
same here
Great video. I loved the visuals and 10-20 minutes is the sweet spot for optimal length imo
Agreed, sweet spot that makes you watch it now, instead of saving it for later (and forget about it)
Graphics make all the complex concepts you cover super approachable. More 20-minute videos please!
This was excellent. You covered all the important points concisely and only cut out details that can be found in the newsletter.
I would suggest a TLDR of some kind at the start.
In fact, the implementation of leader election is needed even without the use of web workers. And many browsers do not have a shared worker. You can use a broadcast channel, "active tab" events, and local storage to elect a leader. And make sure that all requests to the server come only from the leading tab. Especially in the case of sockets, this reduces the load on the server hundreds of times -- people have a habit of not closing tabs -- in collaborative web application. And sometimes there can be several "read leaders" if you have 2+ active tabs/monitors at the same time.
Great great video! I have stumbled upon the "How Notion Cut Latency" posts on Linkedin multiple times previously, but the textual material always seemed too heavy or contained too much jargon to comprehend easily without losing patience. This video format & someone explaining as we go - is SOOO SOO much better! Please keep doing this. There's a lot of DSA content on UA-cam but almost no content such as this video. This could also be NeetCode's near future niche.
The cause of your website performance problems is database latency. Over the last 20 years, this has consistently been true for every system I've had to maintain. It's extra funny when they have gone to the effort to rice, using whatever meme language everyone is claiming to be fastest. Reducing the query count has taken operations from minutes to microseconds, and I keep having this experience every time I change teams.
Checks out to me. No matter how much flashy a software piece is, you will be limited by your hardware, and something that strictly enters disk manipulation for read & write (aka the DB) makes sense that will drastically slow your app
Feedbacks:
1- pictures are really good. I think you should keep it. It really helped visually internalizing some of concepts or design approaches.
2- The time was all right. For more complicated videos it makes sense to go longer.
3- Tying the content of the current video with entry level/beginner stuff (for eg ACID compliance at the end) is really good. That helped unveiling more of the complexity of what is happening.
4- I was originally not happy with the flow of the video (moving from subparts of the videos) but after reflecting I think it was fine
Thank you for going that deep in the details of what exactly is happening and what is going wrong. That is what sets your system design video apart from the other content on UA-cam. Excited about where this is going.
I usually dont comment on the videos, but this made me comment because of your effort you put in the video creating it! Amazing video dude! I really liked the flow of the video and everything else.
appreciate it 🙏🙏
I watched the whole video, I think the length is appropriate for the depth, thank you!
I'd love to know how Notion does, or how you would, implement the sqlite part.
I love the way you explain. Definitely keep the visuals. Everytime i think wth he is talking about you immediately goes to basics of it and i really like this aspect of your explaining complex problems/designs. Thank you for providing such value on UA-cam.
You are f$$king fantastic. The depth vs breadth covered is amazingly on point. You point out the gotchas (e.g. SQLite is ACID compliant - so how come...?) which a lot of videos don't (creating a 'perfect system where everything just works' illusion). Your scribbling is even nice - does highlight and help my brain hold on to key concepts while it's dynamic enough that I don't lose focus. Overall, just keep killing it, man
Visuals are great. Lengthy videos are also nice, I'm not here for dopamine, I'm here for education. Keep up the good work man! 🙂
I loved all the visuals and the explanations. I would prefer if these videos were 15 to 20 mins and not longer. The blog post can provide additional details.
Also, this was one the best explanations I have seen to date.
The visuals were awesome, I made sure to subscribe to the newsletter!
Loved this. Please make more of this system design / optimisation type video!
Yes! Visuals are fantastic, especially for breaking down abstract concepts. Love this initiative.
This was super helpful and incredible video. I love learning about these kinds of stories since it mimics what engineers actually do on the job. It's also something I've wondered a lot myself!
Very cool video. Liked those hand-on explanation. The way you actually showed application tab, it's memory usage and the js file with log statements. Pls continue your good work. Looking forward to learn more from you!
One interesting thing about this is OPFS. I've never actually used it before.
One thing to note is this only improves the write queuing performance (which is fine as it's the bottleneck) as sqlite does not support concurrent writers as stated in the "when to use" docs: "SQLite only supports one writer at a time per database file. But in most cases, a write transaction only takes milliseconds and so multiple writers can simply take turns. SQLite will handle more write concurrency than many people suspect. Nevertheless, client/server database systems, because they have a long-running server process at hand to coordinate access, can usually handle far more write concurrency than SQLite ever will."
Loved the visuals loved the explanation and drawings.
For the video, if anything I would love more depth. I feel that's what's mainly missing in all of UA-cam. Totally in for much longer videos or series where you fully cover a concept in high level and actual code/tech level. Hope to see that!
For the newsletter I want to read it, but wonder can we only read it in the emails ? nowhere else? Just like to read in light mode or reading mode of some browsers if possible.
Awesome !!! The details, the code and yes the pictures - very very useful ... I have also signed up for your newsletter. Your leetcode videos are gold standard, and so was this.
Clean explanation. Need more high quality content like this. Good job my man🎉
I rarely put comments on videos. But have to say, this is good. Length is good. Content is non-generic. Learnt something that might come handy someday
Loved the pictures. Explaination was amazing as well. And yup 20 minutes is ideal. Thanks for making this newsletter.
great content i loved it but by the way at 11:35 i wanna say that basically threads share the same memory but processes don't , this is why processes they have to communicate through channels
ah good catch, in this case i believe while web workers run in a separate thread, from a programming perspective to me it still feels like they communicate with the main js thread the way different processes would communicate with each other.
this is such a subtle point tho so someone please correct me if im wrong
I love this format so much new things to learn. Would definetly love more of these.
Everything is good 📈😊, honestly It makes me stick to the video to the end.
You should add the visuals like these to persuade the System design and very informative video BTW,
I hope like me everyone expect this like understandable and knowledgeable video from you in the future .
Thank you.
Honestly, Everything about your content, the way you share is just awesome for understanding. Looking forward for even more of these content.
There is so much entry level stuff posted for tech in general its hard to find good sources for Mid + level development.
This is huge.
Awesome awesome video! Thank you for taking the time to draw and give a great explanation of their system, I found it really helped and connected all the pieces together! You are the GOAT. I love these types of videos. Keep up the great work!
Nice thumbnail. The dark and faded blue looks really good against the black background, very easy to read.
the browser file API being the problem reminds of a talk by a database creator. He said that many people assume that if you write bytes to disk, and then immediately read them back, you get the same thing.
Turns out that when you are creating a database, that's not "true enough" - from time to time the SSD or HDD gets corrupted, and you have take that into accound.
Man, you are so good in explaining things. Thank you for your hard work!
Liked the diagram pictures used & the length of the video was nice, I learned that this was possible from this video & knowing the pitfalls like the OPFS causing data corruption will save a lot of headaches I imagine.
Great video! I admire how you simplify complex concepts, making them easy to understand.
sqlite is possibly the best piece of software written in the 21th century
Loved your way of explaining up the things, 19 minutes totaly worth to watch
This video hit me at the perfect time. That shared web worker strategy is a surprise to me. Might save some bugs in my own code!
This was extremely awesome and kept my attention intact and curiosity raised, drawing and images way of explanation is better (atleast for e) than rambling while showing up bunch of text. Thankyou so much.
Btw might be a naive question, how do you get to know about news as such ? what are your sources?
This is awesome! I like the length of your video, your explanation and thought are clear as always! Please keep making these!
I love the video and the explanation and the detail and everything. You genuinely want your viewers to learn these things and it shows. Thanks
Love the content! Keep the visuals coming. they make things much easier to understand.
love the content.
really interesting to see a breakdown of optimization of a platform I use and a bunch of other people
great video! love the visuals, length, and overall format 👍
This is so good keep doing it please ur the only person i can listen to talk
Keep the style! This works really well and I understood everything. Thank you
That was 20 minutes??? Time flys when you are having fun. The exact issue I’m writing thru too rn. Love it give me 14 more
Naive Question: does Notion solve for race between tabs?
I.e. let’s say you have two tabs open on the same task but they are in two different states.
one is newer - let’s say 2 paragraphs in the task description
One with staler data.
Focus is on the tab with the new data, and now you move to the old tab, add one char to your stale description and navigate to a different task.
Will you lose your paragraphs ? (I don’t use notion… but intrigued)
Awsome video, awsome topic as well. I wanted to learn more about using sqlite for caching, particularly now with WASM tools like the sqlite-vec extension for vector search!! This was great!
Visuals were great!
Great job, man! I will check out your newsletter. Thanks!
Love the vid! Visuals help a lot, thanks for taking the time to draw them!
The visuals were awesome, Keep up the good work, THANKS
loved videos that shows drawing to explain the process and thought on how its done, please do more like this! thanks
I really like this video! I like the visuals, the length is perfect.
the visuals are good. obviously could always be better but i dont have further feedback on how. for the vid length could definitely cut it a bit.
Thanks as always
Great video as usual, i love your explanation and diagrams! Keep up the good work, THANKS
Cool video! I think the shared worker is called "service worker"?
BTW, you forgot to link the newsletter in the description
Visuals are key to understanding any topic much faster and better. So, add more if necessary.
never had someone taught me this clean, you are the best thanks
loved the video, it's perfect. Concise and letting me know the things possible as opposed to exactly how to do it.
Great video man! If you do get time make more videos on these concepts, atleast for things in you newsletter that you fell are video worthy!
Again, great video man!
Love this. Love your channel and most importantly way you explain things. Even for folks with 10+ yoe, it’s so useful.
Love the thorough run through and easy explanation!
Dunno about cutting latency, but they did a lot if shite to make notion slow right after initial release. I remember how at first I was pretty happy how it was snappy as hell, but when our teams started to fill more documents it become slower. And then they've released a new update with new features and everything turned into a turtle - everything was slow as hell. Including simple selection and opening context menu.
Excellent video, looking forward to have more like this. Really need some practical system design knowledge. Thanks for your videos as always
Very refreshing video, between leetcode problem solving videos.
looking forward to see more system design lecture , Thank you.
I like the coding, it really adds to the typical system design videos.
Love stuff like this. Signed up for the newsletter.
"Latency is bad but you know what is worse..." I was totally expecting a sponsor plug there 😅
learnt something within 5 mins of the video. Quality content, thank you !
your effort is worth it coz i watched the whole video till the end, your narrations visuals everything is top notch. Liked and subscribed
Love seeing these system design videos, keep it up (but also keep up leetcode questions, I'm still unemployed)
sick video. with a hands on explanation it was easy for a novice like me to understand it. i need moreeee
Great video man!!! Keep up the good work!!!
I really enjoy the explanation...
Great video, good length and details enough to be awesome watch and educational keep it up
loved the video with the details , images and everyhting. it was soo clear and eays to understand, lots of knowledge as well!
Hi nav, I really enjoied a lot your video. I'm mind of tech lead in the places I work. We are doing aí stuff.
And it's very good to me to see how others experts are solving their problems
Great deep dive. I appreciate the visuals.
Love the Length. Love the pictures. Just subbed.
need some more videos like this my man!!!!!! keep up the good work!
The visual is amazing, keep doing it 🔥
I have a software interview tomorrow. Watching this to see if I can learn some system design lingo to trick them into thinking I know stuff.
Do more of these videos plz!! Joined your newsletter!
Superb Content Bro!
Expecting more and more such videos and more images ,graphics and code samples and less Text.
I felt 20 minute is less , 30 minutes should be fine.
Great video! I hope to see more of this type here!
awesome explanation and liked the way you draw too.
I actually prefer Informative videos and 'Hour-long-videos' actually doesn't matter to me yk, I'd like if you produce such contents as I really feel your ability to explain is pretty neat.
Oh and also, really nice and informative visuals I really appreciate it.
Keep doing these videos, i learned a lot from this. Also this just made me realize than as a self taught sometimes you can invent your own solutions to overcome programming problems like workarounds same as what notion did with race requests etc
Nice video with pretty good illustrations. Thanks mate
Great video you should keep the images and cover more details on each topic.
I love the video . I love the practical aspect. Kudos to you ....
absolutely love the sys design videos, pls do more
Loved the video, I like how you explained system design
Often with bytebytego (which I do like) I do feel a little stumped at times
Also if I understand correctly we are literally having a database on the client side?!? That seems wild, but why didn't they just use indexedDB
Can't wait to study this, but shouldn't you be posting this on the main channel?
My guess is: His main account probably maxed subscribers in cs job market, so opening another channel would bring more exposure and double income.
im so tired of programming man i just wanna sit and read a book man its so sad, I wanna get a ton of money in lottary or some unknown billioonaire uncle so I can just enjoy my life instead of focusing everything about practicing every day after work just to get freaking MONEY
True. I cant do this all the time. This wears out as I am in my early 30s.
Please do more videos like this! Please don't leave daily Leetcode problems too =] These 2x are "must have" to interview.
Great video and super clear explanations, thanks a lot!