Love the "True-crime stories" vibe, where all the details are uncovered step by step. Great story telling! I really like how your channel is positively progressing over time.
Absolutely impressive how they made all of these pieces fall in line and interface correctly. I imagine it would be hell to diagnose a bug on such a complex system. Where do you even start? They would've had to choose from dozens of different terminals and log systems to even start looking at what is happening.
10/10 As a developer in a small company it's hard to scope out what needs to be done to make a solution *infinitely* scalable. It's great to understand how big companies handle big data to provide insight on how I can develop solutions Cheers
Just watched it all! It's enlightening that you mentioned each problem they faced and what different practical techniques and technologies they used to overcome them)
I really like this topic especially because I'm a backend dev that uses Python. It highlights what amazing stuff you can do with it outside machine learning and AI.
@@ninobach7456 Its build really well, and has a lot of community with experience behind it. Its also easy to setup and develop with. But flask and tornado are also populair (but i wouldn't recommand them unless you work in a team that knows what they are doing. )
This video made me feel like a speck of dust in the field of web programming. I use php and mysql to store and retrieve info from one server. With a million users per day the way I handle the load is by making the server more powerful rather than scaling up horizontally. This is such an eye opener :|
I don’t think that’s a bad thing. I think there’s actual a really good use-case for vertically scaling your existing server and is often overlooked! Simplicity is super helpful.
Posts and messages are generally not modified quickly, so that's cool. But what about the rapidly changing ones like comments, likes, etc? How can we be sure that the cached value in the CDN is the actual value or atleast close? (Yes I'm talking about one of the two hardest problems in CS)
Absolutely mind-blowing! This documentary showcasing how Instagram scaled to 14M users with just three engineers is a testament to their incredible ingenuity and resourcefulness. It's a prime example of how a small, dedicated team can create monumental impact through innovation and smart engineering. Truly inspiring for aspiring tech entrepreneurs!
it's crazy to think how Python powered Instagram in its early stage where it experienced massive growth, given Python's reputation for being a not so performant language.
Python still powers Instagram, however they have their own in house CPython version called "Cinder" which has much better performance and is tailored exactly to their requirements.
i think you are wrong buddy, the user application normally will have a set point of where to request the data, that set point is always a CDN . in other words all URLS on the user side goes to the CDN, then if the CDN contains the data and the data is not stale it returns the DATA, the Server Application never needs to translate the Object Storage URL to a CDN URL , its Just that the User Application is never aware of all that sort of thing or even that the Server Application will send the Object Storage URL to the CDN.
With all that complexity, resources to buy, developers to pay, have you ever wondered how the app manages to stay free of charge ? Remeber, you’re the product.
I really enjoyed the content of the video 🎉 but I was a bit irritated by the flow or the narrative rhythm of the video. There was a lot of silence/emphasis on unimportant animations. Don’t want to be unappreciative, thought! I enjoyed it anyways but it’s just something I noticed ❤
Hey, thanks for the video. It was fun watching it. As a software engineer, myself, I enjoyed it very much. First you explained the challenge and I thought about what I would use to solve this, and then I watch further, and it was always the same solution the guys from Instagram came up with.
I had to solo craft entire infrastructure for a company that is now operating in dozens of countries. When it keeps going for longer, you switch from engineering issues to mental issues..
Hi everyone :) I got married lately and was on a bit of a break! Glad to be back and posting videos! Let me know what you want to see.
Congratulations
Congratulations
Congratulations
Congrats!! :)
Congrats!!!
I really like how you turn software architecture into a compelling narrative! You earned my subscription.
Love the "True-crime stories" vibe, where all the details are uncovered step by step. Great story telling! I really like how your channel is positively progressing over time.
Absolutely impressive how they made all of these pieces fall in line and interface correctly. I imagine it would be hell to diagnose a bug on such a complex system. Where do you even start? They would've had to choose from dozens of different terminals and log systems to even start looking at what is happening.
the quality of this video is insane
10/10
As a developer in a small company it's hard to scope out what needs to be done to make a solution *infinitely* scalable. It's great to understand how big companies handle big data to provide insight on how I can develop solutions
Cheers
Just watched it all! It's enlightening that you mentioned each problem they faced and what different practical techniques and technologies they used to overcome them)
Agreed!
those 3 did that.. meanwhile me on my WFH day: watching youtube all day doing no work smh
I generally don't watch such video but the presentation of this video ket me hooked to the end. Its just amazing! Kudos to you and your team!
I really like this topic especially because I'm a backend dev that uses Python. It highlights what amazing stuff you can do with it outside machine learning and AI.
Brother your content is becoming something else, it's like watching million dollars documentary, keep it up
Mind blown! Great video!
Horizontal Scaling is Awesome, I love the concept.
These videos are so interesting! Always the things we take for granted are somehow the most fascinating.
Amazing that Django handled the entire application sided of things. Always loved python for web programming.
Is Django the go to for back end development in Python?
@@ninobach7456 Its build really well, and has a lot of community with experience behind it. Its also easy to setup and develop with. But flask and tornado are also populair (but i wouldn't recommand them unless you work in a team that knows what they are doing. )
@@ninobach7456 Not anymore, async frameworks like FastAPI are taking over.
@@ninobach7456yes, among Flask and FastAPI
@@ninobach7456 pretty much
One of the best system designs video 🎉
I love these kind of videos. Keep it up Lewis ❤
This video made me feel like a speck of dust in the field of web programming. I use php and mysql to store and retrieve info from one server. With a million users per day the way I handle the load is by making the server more powerful rather than scaling up horizontally. This is such an eye opener :|
I don’t think that’s a bad thing. I think there’s actual a really good use-case for vertically scaling your existing server and is often overlooked! Simplicity is super helpful.
Your contents are at another level, lewis
Nice way to teach system design, totally liked it.
Really love the format of going through each layer one at a time.
This is amazing.
Nice explanations, I loved every bit of it!
I love your story time videos. They are informative and entertaining. The unicorn part got me 😂
Great content man
You can see the effort put into these videos. I see a great future for this channel. My subscription is yours oh great one.
As always keep up with your videos! 😉🔥
i really like how the videos are made. keep up the good work
You should start making more videos like this, like how companies handle things 😇
I love how you make engineering principles suspenseful and interesting. Well done. New sub.
Great video! Mad editing skills, Lewis. Love the vibe of this video. Felt like an episode from Mr. Robot hahah
Basically the 3 engineers uses Amazon ready-to-use technologies :-)
Posts and messages are generally not modified quickly, so that's cool. But what about the rapidly changing ones like comments, likes, etc? How can we be sure that the cached value in the CDN is the actual value or atleast close? (Yes I'm talking about one of the two hardest problems in CS)
Absolutely mind-blowing! This documentary showcasing how Instagram scaled to 14M users with just three engineers is a testament to their incredible ingenuity and resourcefulness. It's a prime example of how a small, dedicated team can create monumental impact through innovation and smart engineering. Truly inspiring for aspiring tech entrepreneurs!
Hi chatgpt
ChatGPT response
Loved the content, really amazing, would love to see your videos on different firm's infrastructure to understand tech better.
contetn is gold, its like im wathing netflix crime documentaries
Video starts: "How did three software engineers alone..."
knowing whats going on in the background is important even more interesting the way its being delivered here thank you
You must be one of three legendary engineers. Thanks for amazing content.
Quality Content! Keep it up Lewis!
when i see this type of videos
i know surely that I'm still a beginner
this video is underrated
Super interesting video. Good Job :)
This format is great! Keep up the great work!
great video, it is very inspiring to see what those engineers were able to build with that three principles🎉🎉🎉
Have a lot to learn as backend engineer
Amazing video, I'm using some of the tools mentioned in the video.
Bro the scaling needed for everything is too immense to think of
This is really good. Thank you so much for the awesome content.
Wow, this is Netflix level documentary!
That was so helpful. Thank you.
This video is truly incredible in its quality and content! Special thanks
Congratulations bro🎉
Make video on AI in video games
Stay tuned :)
please more content like this
Please don't stop producing this kind of video, it's really good!😃
Absolutely amazing
Great stuff!
it's crazy to think how Python powered Instagram in its early stage where it experienced massive growth, given Python's reputation for being a not so performant language.
Python still powers Instagram, however they have their own in house CPython version called "Cinder" which has much better performance and is tailored exactly to their requirements.
I love this new way to study system design
Amazing Insights
More of this!!!
Very good editing
great video and great presentation of the whole things, nicz work and thank you
i'm amazed as well as inspired to lern these tech!
Great story telling, loved it!
Loved it , I have subscribed to your channel now 👍🏻
Great post. Subscribed to your channel.
i think you are wrong buddy, the user application normally will have a set point of where to request the data, that set point is always a CDN . in other words all URLS on the user side goes to the CDN, then if the CDN contains the data and the data is not stale it returns the DATA, the Server Application never needs to translate the Object Storage URL to a CDN URL , its Just that the User Application is never aware of all that sort of thing or even that the Server Application will send the Object Storage URL to the CDN.
I saw a talk from Instagram engineers talking about celery framework server for background task scaling
Nigga, this shit was crazy, and i loved it, keep it going gang 🚀
Awesome video! Thanks !
With all that complexity, resources to buy, developers to pay, have you ever wondered how the app manages to stay free of charge ? Remeber, you’re the product.
I really enjoyed the content of the video 🎉 but I was a bit irritated by the flow or the narrative rhythm of the video. There was a lot of silence/emphasis on unimportant animations. Don’t want to be unappreciative, thought! I enjoyed it anyways but it’s just something I noticed ❤
i love this episode! make more please!
Every ting seems good but Infoq London summit says something different like Casandra as well
are trends just data optimization for instances? because everything is just locally relevant
Great video!
my mind:
Guni-corn 💀
This was sooo good so informative and entertaining
Do Snapchat next
Hey, thanks for the video. It was fun watching it. As a software engineer, myself, I enjoyed it very much. First you explained the challenge and I thought about what I would use to solve this, and then I watch further, and it was always the same solution the guys from Instagram came up with.
I had to solo craft entire infrastructure for a company that is now operating in dozens of countries.
When it keeps going for longer, you switch from engineering issues to mental issues..
Thanks for your sharing
Where did you get the slick animated icons at the three rules portion? I loved those! Especially the reinvent the wheel one!
This is Modern dystopia 😅
This video is beautiful.
Brilliant engineering.
Thanks for the great video!
You spell it Gunicorn btw.. This is common knowledge. \s
How did you find these informations, I mean technologies Instagram used and may have even stopped using right now
Incredible production quality! Please keep it up.
Omg! 25 instances!? Impossible 😮 😂
As an iOS engineer ,this video is too backbend I’m kinda confused love it by the way .
if you made this video a while ago it would've been super helpful haha
Simple, Instagram is not a technology innovation. One software engineer could be also enough
Good old days when Kubernetes wasn't a thing
As always great content Lewis did you see discord went down yesterday ? can you make a video on that thank you
Gunicorn is G-Unicorn - stands for Green Unicorn lol so it pronounced Either GUNI-Corn or G-Unicorn depending on what you'd feel good about.
Make a video on how UA-cam is made
This is more useful than 4 years degree in CS.
how do you create these videos? Specially the graphics that you show to explain the architecture and flow of the request/response?
Not sure if I'm inspired to learn, or to quit.....
100 good developers > 500 average developers
10 elite developers > 500 average developers
Thanks, I got a few clicks in my head from this story 😊