Database Design Tips | Choosing the Best Database in a System Design Interview
Вставка
- Опубліковано 11 чер 2024
- One of the most important things in a System Design interview is to choose the right Database for the right use case. Here is a cheat sheet that can help you choose the right DB for most of the use cases that you can encounter.
Summary of the video: www.codekarle.com/system-desi...
Author: / sandeep1904
We do over some important topics like which database you should use, in what scenarios, in a System Design Interview. Some comparisons between SQL and NoSQL databases, how to use multiple databases together in a real-world system, etc.
Chapters
0:00 - Intro
1:05 - Things that matter
1:45 - Caching
3:20 - File storage
4:22 - CDN
5:11 - Text search engine
6:30 - Fuzzy text search
8:25 - Timeseries databases
10:11 - Data warehouse / Big Data
11:17 - SQL vs NoSQL
11:24 - Relational DB
14:28 - NoSQL - Document DB
16:28 - NoSQL - Columnar DB
18:23 - If none of these are required
19:03 - Combination of DBs - Amazon case study.
#codekarle #databases #systemdesign #system #design #interview #amazon #faang
You make me intelligent with every video I watch of yours.
Thanks!! That makes our day :)
Do share this with your colleagues and spread the knowledge :)
I agree with you 100%
Ture !!
Why no design videos these days?? What happend?
Just in case someone is still confused when to use column based DBs here's a little explaination:
Consider a database which has a large volume of data with 100 columns. And your application most of the time just queries only a few columns (let’s say 4-5 columns). Then in case of document DBs or row based DBs (relational Dbs) all data will be loaded row by row in main memory for processing , parsing and other operations. It will be a waste of a lot of effort in loading and processing of unnecessary columns. Column based DBs are used to tackle this problem where a large amount of data is stored in column based fashion so that the application can query only a few columns of large volume of data.
- reference: Designing Data-Intensive Applications. by Martin Kleppmann.
Well explained!!
But you can also do the same thing in RDBMS. you can easily right a query to get only few columns in the result
WOW. Watched so many videos and finally found the gold content. No flashy animations and funky music. Just old school 1-1 explaining with clarity, examples and strong fundamentals. Beauty of online education.
This has been the most useful 23 mins of System Designs Learning I've come across yet. And this is after I took an 11 hour course... you put it all together for me so much more succinctly. Thank you!!
He's amazing
Best video tutorial available on the internet for choosing between databases for designing systems. Period
Thanks for the kind words :)
As someone with only monolithic embedded systems experience, this is hands down the only resource on the internet that made sense to me in this domain. Heartfelt thanks!
this video is an absolute gem. Finally someone that breaks this down directly without dancing around the topic
Best video I have watched which summarizes it so simply. The best part of this is he explains it by taking examples of products such as Amazon, Netflix etc.
This man needs at least 100K subs. Love this content, extremely concise and informative, I have subbed!
THANKS A TON for making things amazingly simple to understand. Great stuff indeed! I have watched all your videos on system design, they are so nicely presented and organised. Awaiting the next videos.
This channel should really have lot of subscribers. This is the first channel where I found so much detailed explanation on system design. Thanks a lot.
Cool and crisp details relevant to the topic. Very few people are gifted with the skill to share the knowledge and also create an impact. I came across this channel and now I'll be watching the whole series in coming days.
Thanks for creating such an insightful video.
There are few things that I would suggest adding to all the important points that you have mentioned:
1> Write Heavy vs Read Heavy systems is also an important point to consider for database selection. We cannot write scale RDBMS (as generally in RDBMS the write is on the single primary instance). For DocumentDB, we need sharding to write scale it which can be done but are not so natural as it is in ColumnarDB like Cassandra where we need to mandatorily choose the partition key during the data modelling itself. So for write heavy systems I prefer to go with Cassandra if I don't need ACID. For write heavy systems that need ACID we should choose RDBMS with multi master configuration and for that application needs to take care of bifurcating the data to the appropriate master based on the decided key.
2> Graph database for mapping social network type of data.
Can you give examples of Write Heavy systems and Read Heavy Systems and why?
@@shponder9510 OLTP vs OLAP
@@shponder9510 URL shortener- you will have more reads than writes. may be 100:1 ratio of reads to writes
Your videos are very simple to understand. I would like to thank you for explaining the FR and non-FR for each system design consideration. That sets the expectation very well.
I had been struggling with starting Databases to build my conceptual knowledge and this is amazing for everyone. Thanks a lot for sharing this in the most simplistic way.
The clear explanation/flowchart at the end for choosing SQL vs document vs columnar was GOLD
No words to say..the way you've cleared everything.... You should be on UA-cam long time before.
One of the best System Design videos series on UA-cam. Keep up the good work!
This is one of the best explanation on choosing db....
I don't know why people are buying gold when by just watching this video you can be rich!
Sincere gratitude to you Sandeep!
This was just what I needed, gem of a video. Thanks!
Thank you Karle, you have solved my mysterious about databases that has been going thru my head for many years.
Your videos are a life saver for me. I have recently joined an organisation as senior developer and i have been given few system design tasks. And going through your videos is enabling me to understand the intricacies of the system design.
Sandeep: I must say that you have the gift of explaining complex concepts in a very simple way, this is rare to find in today's days. Your clarity in explaining the fundas is great and makes me learn so much more. Please continue sharing your knowledge thereby helping learners across the globe! Thank you for sharing this and best of luck to you on this journey!
Thanks Jyoti! Do spread the word about the channel. It motivates to keep making more :)
Each minute is worth watching... Very logical and concise.
Such an amazing video! I am glad I came across your channel. This is very informative and you have a knack for explaining things well! Keep up the good work :)
Really informative. Loved it, coming out burnt from GKCS, that guy always leaves me confused for some reason. This channel is must recommended.
Reading this a day before on-site interviews. I am much more confident on the database selection justification :). Thank you
Excellent video talking about key considerations in choosing the "right" DB/ data store. Sincere thanks for your efforts!
Awesome !!
That's exactly what we require in a DB design rounds , in more depth though , but this was a very good intro in that direction
Those who prefer AWS Managed Services. Here, is the list
Blob Storage : AWS S3
Caching : AWS ElasticCache
Full Text Searching : AWS ElasticSearch
Time Series Database : AWS TimeStream
Analytical Databases : AWS Redshift ( It depends, sometimes we can use AWS S3 for storing large csv files and then we can use AWS ElasticMapReduce(EMR) to process S3 Files)
RDMS (Relational Databse) : AWS Aurora
Document Database : AWS DynamoDB
Columnar Database : Not sure, I think AWS DynamoDB will satisfy this requirement too.
are you from AWS :)
Bo Wang No, learning AWS :)
literally no words
i was struggling to find a perfect video which explains in every possible perception (user, developer, maintainer)
this made all the doubts cleared ...
thank you
This is the best video on this topic on UA-cam. This is a confusing topic but you explained in so simple and elegant way. Thankyou! for making this video.
Your videos are pure gold!! Hands down the best system design tutor!!! Thanks a lot!
Brother, this is the best video I have ever seen on System Design (Databases). Thanks for sharing all this knowledge. Kudos to you!!
Amazing explanation of various databases at a breadth. Candid for quick brush up. Thanks
Super helpful. More I watch it more clarity I get. Thanks for making this video.
Every video i watch, I click like. Complex system design problems are explained in very simple way. Keep it up and make more such videos. Thanks a lot!
this guys is best! simple explaination.. easy to digest
I like the way you present.. you look like a humble human being with lots of knowledge and work experience... please continue your good work..
Wow !!! What clarity in explaining Database use cases, scenerios, categories of database with pictorial representation. The way you explained the concept is quite impressive. The way you corelate the concept with example is best fit. Keep the good work. May your light shine upon people like me the beneficiary. Thanks.
Wonderful video! I have been looking for something in depth like this for a very long time!
To the point and crisp.... Covered all popular types of DB. Thanks
Glad that you liked it!
I have been looking for this information since long time.
Thank you for providing the exact detail
Bro, this is just soooo good. You summarised so many important topics of software development concisely in some minutes with awesome explanation. Hats off to you. first time watching your video and i have become a fan. Thanks for the great content!
Thanks for the video. It's worth stressing on is the consistency aspect of databases. RDBMS's provide strong consistency, whereas a NoSQL like Casandra provides eventual consistency, but higher availability owing to its masterless model, and thus lack of a single point of failure. HBase, on the other hand, is a single-leader system with a single-point of failure.
Well explained and informative. works well as a cheat sheet with clear overview, leaving to us to get in depth wherever needed.
This is awesome, I am amazed that everything you share has so much detail and thought.
This video is exactly what I wanted for quick revision. Thank you so much
Perfect cheet sheet for most of the DB formats..!!!
So beautiful and simple explanation..!!! 👏👏
Please keep up the great work..!!!
Good explanation of document DB, you are the first who made me understand the use case!
I could binge watch your videos forever. such an informative videos
What an amazing explanation for choosing databases. Kudos to you man.
Great refresher, thank you!
Awesome content dude. I ensure I watch all the ads during the video and click on all of them because I don't know how else I can give back to you for the invaluable knowledge you share with us!
Thanks Abhijit!
Just spread the word about the channel amongst your friends / LinkedIn connections and that would be amazing :)
Keep doing the excellent work mate. This was a great video with respect to databases.
Wonderful! The best free video for choosing database in system design interview. Thanks so much
Thanks for your help with my interview prep!
You have great communication ability and explain things crisply. Thank you.
Amazing Video. This is an absolute precise explanation for this topic. Thanks !!
Wow!! Amazing video with great content in a concise manner. Kudos, thank you so much!
I had a lot of confusions on this, Thank You So Much!
thank you ! This video cleared up so many concepts for me. Keep making these amazing videos
I was happy after going through the video. Just one short and clear.
This is a very good video, something no one has done. So many terms I hear on a day to day basis but didn't know, are clear now.
Oh my God! I didn't know this kind of content is also available on the net and that too is free with so many details explained beautifully and concisely. Subscribed and gonna share it with others. Thanks again for putting so much effort for the learners like us.
Wow! This explanation is so lucid and logical, yet concise. Summarizing things this well should be considered an art form!
I have always wished for a video like this! Since, I am non-CS background, I am a bit oblivious to the world of DB products out there. I had always heard many of these names, but only as lingo - never really understood why they were being mentioned in the context. Thank you for putting this together, I will now probably understand more future such discussions in life :D
Just wow! You made such a concise video for such useful information. Thanks a lot.
Seedhi Baat.. No Bakwaas.. Excellent short cheat sheet video for choosing right DB.
Thank you so much for such a precise cheat sheet. You also cleared a lot of concepts for me which were fuzzy in spite of my 8.6 years of work experience!
Clear and to the point explanation. Great job! I learned a lot. Thanks.
Glad that it was helpful!
Thanks for making this review! I enjoyed it.
Love you brother. This video is so much informative. 1 video talks about so many solutions.
I'm only 4 minutes in and I've already learned a lot! Keep it up!
Excellent video with precise information. Kudos and keep them coming. 🙏🏼🙏🏼
Very insightful video. Thanks a lot!!
You have just fulfilled my all queries for interviews.
As usual, you are just brilliant!!! Fantastic
Thanks a lot. You just made it super clear.
Very helpful. Thanks to your efforts and time.
awesome, the video gets to the heart of the matter and doesn't go around.
Thanks a lot for these videos. Big fan of such videos. Make sure you post more videos. Keep up your good work guys
Amazing video, very professional and well described !
This is gem!! Thanks for such amazing content.
Great Man! Nice way of explaining. Kudos to your thoughts!
awesome video. gives a bigger picture on dbs to me. very useful. thank you
such an amazing and clear articulation ! kudos
What a very dense video! I took 3 pages of notes. The database world is much clearer for me. Thanks a lot!
Wow. That's good to hear!
Best content on this topic! Thank you so much for your efforts!
Nicely explained! 🙌 I subscribed!
Thank you!! It was well explained!!
This is a perfect learning video, thank you. I found it very useful how you associated real world examples with type of db. Info about use of combination of database is also lot of helpful understanding how real world system might be using them.
You explained everything in a very concise way. Keep up doing the good work😊🙏
Simple and informative. Thanks for making this great video.
This is a super valuable video. It's beautiful. Thank you Karle.
What a informative video! Thanks!!
great video. very helpful .Thank you !!
This is very good, please keep adding more interviews.
Very useful summary of various system options