Netflix YouTube Prime Video System Design on AWS | Video On Demand System Design Interview
Вставка
- Опубліковано 19 лип 2024
- The video on demand system such as Netflix, UA-cam, Prime Video is a common system design interview question. In this video, we will cover features like uploading video, search and viewing, detecting adult content. This design needs to be scalable, resilient, highly available, cost effective, and secure. In addition to the design, this whiteboard architecture is also implemented using AWS services.
💰👨🎓 Get my courses with max discount and 30 day moneyback guarantee: bit.ly/3Eku9RH
*Connect with me*
🤳 Instagram: / cloudwithraj
🏢 LinkedIN: / cloudwithraj
🐦Twitter: / cloudwithraj
🖼 Facebook: / cloudwithraj
Timestamps:
0:00 Requirements and features
2:53 Video ingestion
5:36 Database
7:41 Video encoding
10:26 Adult content detection
12:00 Parallel processing
13:21 Content Delivery Network (CDN)
15:44 Searching and viewing video
20:47 S3 cost savings techniques
23:17 Security
#SystemDesignInterview #WhiteboardInterview #AWSArchitecture - Наука та технологія
My Rocking Systems Design course is out now in Udemy! Limited time discounted link to get the course for $9.99 - www.udemy.com/course/rocking-system-design/?couponCode=LEARNSYSTEMDESIGN
How is this guy not waaay more popular is beyond me. His youtube videos and udemy courses are simply amazing.
Thanks piyush for the kind words, really appreciate it!
@@cloudwithraj I totally agree, you make a really good content!
I agree too!!
I can vouch for that. He is awsome. I am on my path for SAA and Raj videos are helping me to make sense by converting theory to practical knowledge. Thanks bro. Wish you more success...
I have worked on couple of Video Optimization projects, a decade ago I would have to spin-up(literally) multiple servers for transcoding and then couple others for different layers, the whole architecture was so damn complex. Its phenomenal how AWS/cloud has made it so simple, this was very interesting to watch. Thanks
True Sharad! It's amazing what cloud has done. The other day I was able to spin up a Kubernetes cluster while sitting on an airplane!!
Cloud with Raj: "if the interviewer presses you..."
💀😂
Didn't expect to be enjoying my time studying for system design interviews. Great content! Going to binge forsure
Really well done! Gets straight to the point and wastes little time in flushing out key topics. I find the size of the presentation just right. Too long and you tend to lose focus and like Raj already mentioned, you never end up watching the whole video.
Found this channel a week before my interview - great timing :) And a great video, thank you!
Thanks Carla. Best of luck on your interview, hope you ace it 🚀☁📈
Raj, the way you explain the topics means undoubtedly you are a world class Cloud Architect. Unless your concept is that much clear, it is not possible to deliver and make others understood in such a commanding perfection. Take a bow from me, please.
This is an exceptional video. I'm currently developing a IPTV streaming platform and despite being a developer for 20 years it is new territory for me and I've been struggling to find a single source of information that covers everything. Still more for me to research but your video has definitely helped a great deal thank you.
Excellent video Raj! I knew all the concepts but you strung them really well into this practical example! One new thing I learnt from this was HLS! Loved the video! ♥️
No gimmicks… very precise n perfect system design . Hats off RAJ
What an amazing teacher you are. Respect sir. Great effort with simplicity.
I love this guy, he is incredibly smart. For me, he made it easy to understand. Thanks!
This video is awesome! you are bridging the gap between my AWS knowledge and the practical design architecture. Thank you so much sir
Glad it was helpful!
Great video, great explanations. I was a little surprised you used Elastisearch for the DB instead of DynamoDB. I thought Elastisearch was for searching data, not a database. I will have to study more.
Thank you for clarifying@@sam18086 . Happens to the best of us and Raj is great!
You are an amazing tutor.. Made everything so simple. Hope none of your videos move to Glacier ☺
Hahha, I hope so too!
Great! Guru jee. Preparing for AWS DEvops Professional ... These videos are blessings.
All the best Ankush bhai
I really like this architecture videos, it helps a lot in learning in how everything fits together! I’m going through all your videos, probably will check your udemy videos as well. Im a devops Engineer but I still have some gaps to fill. Thanks a lot for your videos!
Ps. Can you please make more architecture videos like this?
Glad you like them Arnold! More to come!
Would be super interested in designing security for systems for data at rest and in transit.
Great vid!
Again His Vedios makes easy to solve the real time stuff ! clearly understandable and it is the Indian way of explanation,Thanks a Lot on ur Valuable sharing of Knowledge Sir
Amazing! Always your video helps to understand the usage of AWS service in real time. Please create video on authentication part.
Excellent channel man! I was literally answering alongside. Everything was On point.
Don’t know about virality but pls keep making this amazing content. Wish I found it sooner.
Thanks and cheers🎉
This is absolutely wonderful explanation about system design with step by step.
Very nice explanations and videos. I have become your fan and have started following your videos. Please continue to make more such videos with explanations from your busy and hectic schedule. Thanks a lot. God bless you Raj Sir.
Thanks. Explained the approach and design consideration.
Thanks a lot Raj.. your videos are of more value.. motivation for us to explore n learn
Great video! You covered everything i was looking for. Thank you!
Glad it was helpful!
Thanks for the video. The explanation is picture perfect. One question I have though is for search functionality in youtube, would you be able to leverage Azure CloudSearch?
Thanks Raj for such a nice presentation and explanation. really helpful.
Great explanation, thank you!
Hi, I appreciate you for making these videos. Can you add a e-commerce design tutorial also?
Really loved this video , so much informative on real time system designs
This is greate : D It helps me understand more about those services, Cloudfront, API gateway, search ...
No sarcasms!! You are world class😇
Great job Raj. Quick and to the point. Can we see these steps in action. Please share if shot these steps in real time for hands on
Very impressive. Very simple and effective design walkthrough of a complex design. Thank you
Glad it was helpful!
Beautiful video…. Loved it
Thank you very much. It helps put all the concepts in place for me. With a real life scenario. Great video!
You're very welcome!
Excellent video, lucidly explained
Awesome video. Easily understood. And, completely informative.
Glad it was helpful!
thank you Raj. learning a lot from your content
Well explained. We need more of this.
I enjoyed this video e2e .. thank you !
Raj … naam toh suna hoga. awesome video brother. god bless you and thank you
This is extremely helpful, it incorporate the jigsaw parts together. I will be the first to buy premium systems designs course.
Thanks Raj for the amazing contents.
Thanks brother for the kind words! Maybe I will create the course, will keep you posted.
Explained like a Legend !!! Great Job I totally enjoyed it...One questions whats the Elasticsearch DB in AWS I could not find it.
Love watching this while sitting at a grand total of 6 subscribers at the moment :)
This is amazing content, Raj! Thank yo so much for all the real world knowledge you are sharing so kindly!
Glad you liked it!
best Ott video I have seen on UA-cam. Thank you. keep sharing knowledge. Please share link if you have any video on video formats,transcoding and protocols. Thank you
Great content Raj! Thanks for sharing!
Thanks Raj! This is really helpful. Keep up the good content.
Thanks miguelv, I am glad you found the video useful.
Amazing video, this is so insightful and very well illustrated, hope you reach more people soon !! Good Luck
Thank you so much Anshika for the kind words!
this is some premium level content bro. Keep publishing these amazing videos bro
You’re a great teacher .. wow
You are amazing.. thank you so much master
Absolutely THE best course on System Design! Saha Saahib is VERY knowledgeable, an expert rather, and has great communication skills. Have purchased his course @udemy.
Thanks so much for the kind words, and the support by purchasing my course!
Great content Raj! Very helpful. Thank you very much!!
Glad it was helpful!
Nice one. Was implementing one right now.
Really useful video on system design
Thanks for the hard work
Wow, super interesting and helpful! Please continue making such videos.
I have one question. You told that the DB must be scalable and able to handle 10x traffic, and that RDMS are not good for that. But I think ElasticSearch, even being non-relational DB, has the same issues: you can not instantly scale it up and down. It is a great text search engine, but in my opinion, it does not really much the criteria. I thought you suggest DynamoDB. What do you think about that?
Hey Max, great question. ElasticSearch is chosen mostly because you can create indexes on texts which makes text searching very efficient. You can use Dynamo, however you need to implement text search in your code. In reality, for frequently searched terms, there is a caching layer inbetween so it doesn't hit the database every time.
@@cloudwithraj Yeah, agree, it does make sense. If you have time, could you please make a new video explaining the second part of the video with CDN. I would use CDN for static content delivery, like images, css, js. And caching layer would implement in the app itself: for instance check if a data is in Redis, then read it, if now - make a request. But now I see that this solution is not scalable :) Because the number of connections to Redis may increase drematically, and it will be problem. I did not know that in CDN layer we can communicate with API Gateway and work with caching.
It would great if you could make a separate video explaining the second part of the video with CDN and caching.
Have a great day, Rajdeep! :)
Really great insight here for a young engineer like me. Thank you 😊
Glad it was helpful!
Excellent description. Do you have any video on the AD federation along with the social networking integration?
Awesome Raj. Such videos really help. Thank you so much
Glad to hear that
great video on the system design. Can you please share the link to Security part of the design or create a video if possible if not already available (that has Active directory and how its integrated to the AWS and other items of the security)
Excellent Raj Sir! Thank you for making such vidoes! Keep it doing!
Yw Purvak, glad it was helpful
You are a real eye-opener :D
I watched your video till the end 😄 thanks for the wonderful explanation.
Thanks Tallin!!
Great video Raj! TY!
Glad you liked it Alex!
Great content!
Questions:
1. Are the HLS chunks cached by the CDN (pretty sure the anser is yes)
2. What is the AWS technology to use for a CDN (CloudFront?)
For completeness sake you should go into more details for the Lambda/Step Function topic since an interviewer might ask to dive deep.
Yes to both answers. And I will go over lambda/step fn in more details n a future video. Ty for your valuable suggestion.
great work, keep it up
Very nice video, man!!!
Excellent Excellent video.Thanks for sharing your knowledge.
Glad it was helpful!
Great explanation. Thank you.
Glad it was helpful!
This is gold, thank you very much
You're very welcome!
thank you Raj, great videos, keep it up in the system design series.
Thanks, will do!
Raj, Your videos are awesome, thanks for sharing :). Love from India(Rohtak, HRY) :)
I'm also planning to start something with Linux stuff first, ... but still learning from you :)
Go for it!
really amazing. simply and well explained.very helpful
Glad it was helpful!
You really explained so well for a begineer like me. Loved it really
Glad it was helpful!
It's poetic 🧡
You videos should defo be viral! Great content!
I appreciate that!
I think relational database can be scaled horizontally using consistent hashing
Hi Raj , Pleasure to watch this and it was great ! Can you pls make a video on Active Directory pls ? Thx
Wow, this was awesome! I’m currently working on a project and I need to stream 25+ separate .mp4 files back to back for a conference. Is that possible with the Elemental Suite of tools?
Super !! liked the way you have explained Dada ..!!
Thanks a ton Dhiraj bhai 🙏
Very nice video....
Dont know about others but I definitely watch your videos and eagerly waiting for your videos. Your content is top-notch. I purchased your courses on Udemy as well. I hope to work with you someday in AWS.
Very helpful video and very well presented thank you.
Glad it was helpful!
Hi, instead of step function can we trigger batch jobs for each programs(encoding, rekogniton)?
Great video. Thanks for sharing.
Thanks for watching!
Great content delivery !! Please do a video on the security implementation especially the IAM part.
Thank you! Will do!
Thank you
I need a video on how to build OTT channel content management system in aws to facilitate auto switch to scheduled programming when Live input is off.
You’ve awesome content, your videos are gold to me, greetings from Colombia
Thanks Juan for the kind words, much appreciated 🙏
This was an amazing video, Raj. Thanks a lot for your great efforts in simplifying the solution design of a lot of use cases.
I have a question regarding the CDN part. It can be implemented using Cloud Front, correct?
Ty mohamed! Yes, you can implement it using Cloud Front
so if hls the url is to .m3u8 playlist resolving to a set of #.ts files on s3 behind a signed url. so you need lambda to make signed url. on the cdn behaior, direct calls for m3u8 to a lambda which parses the .m3u8 file adding the querystring for the signed url to each segment or other playlist listed in the .m3u8 file. then return that signed "doped" playlist to the caller.
then each ts file will have the correct signed url querystring.
RDS which is relational database -Scaling options include both vertical scaling and horizontal scaling. Amazon RDS now supports Storage Auto Scaling and it automatically scales your storage capacity for database workloads, with no downtime. Is this mean we can use RDS for Netflix type of design?
same question. Aurora too.
Excellent :)
awesome video.u really provide great information..!!
Glad it was helpful!
Awesome!! Thanks a lot Raj!
Thanks Joao!
Hey Raj! I watched your videos to the end. 😊
Ty so much!