Imagine you are doing R & D on a topic for the last few days and you are drowning. Then your fav youtuber came with a boat. That's happened right now. Thanks Man
I would love to see architectures of Saas startups' software. Evolution of the architecture, how to scale. Thanks for your videos, there is a lot to learn from them.
Soon I'll start live streaming, and start from scratch, trying to build a SaaS product that consists out of multiple microservices. Running in a Kubernetes cluster in docker instances on AWS using Terraform, Github Actions, different backend languages/frameworks, trying to combine everything and show what that hassle of that process is, which walls you'll run into and how to solve each problem as elegant as possible. Disclaimer: I'll try to avoid any type of JS in de backend ;)
@@barnabaslada-hartyani8998 Last week I've released my "first video" on my channel. It was my first livestream and first video edit, so thing where a bit messy, don't mind the quality of it at the moment. Next two weeks I have vacation, bought a new Macbook and a video editing course, so I hope that quality will increase a lot as well as my streaming schedule! YT: ua-cam.com/channels/SBbWhPHNiIs8VgLzW3s-Bg.html Twitch: www.twitch.tv/tpotjj
Very informative videos from your channel. Thank you to you and your team who make so much effort with different tools and spend hours just for a short video. Another appreciable point is you read the comments on your videos and reply every question by viewers.
🎯 Key Takeaways for quick navigation: 00:07 📹 Live streaming faces challenges due to real-time internet transmission and compute-intensive video processing. 01:07 🌐 Encoders package video streams using protocols like RTMP, while newer options like SRT promise lower latency and network resilience. 02:06 🌍 Point-of-presence servers are used to optimize upload conditions for streamers and ensure fast transmission to the platform. 02:35 🔄 Adaptive bitrate streaming allows video players to adjust quality based on viewer's internet connection, and transcoding converts video streams into different resolutions. 03:38 📦 Popular live-streaming formats include HLS and DASH, with HLS being the most widely used format, consisting of manifest files and video chunks. 04:38 ⌛ Achieving lower latency may require sacrificing video quality, and some platforms offer options for streamers to adjust interactivity and quality. Made with HARPA AI
Segmentation and transcoding are key. I had always wondered how you'd deal with various resolutions and bitrates, and how you'd chop up a video in smaller pieces.
Fantastic channel. I would be interested in how to design an IoT telemetry system. It would be an interesting opportunity to explore time series databases.
Appreciated your content, I couldn't stop your video once started to watch it. But please try making a more details Video, explaining more about the components. Thanks.
@@ByteByteGo With the amount of people asking what you you use to make these animations (myself included), there might be a market out there tailored to system diagrams animations for those without graphics design background. I know I would pay for such a service.
How does the CDN delivers the content so fast to clients all over the world? That's the question I had in mind, but was not answered unfortunately. The rest of the process is interesting also, but I would have imagined something like that. How the CDN achieves such latency all over the world is a mystery to me
Thanks for this video. How do we implement the feature of playing video watched on one device to start exactly where we left on another like UA-cam? Especially where and how do we store that data?
@@ByteByteGo I want to know 1. How is the closest CDN server chosen by the client 2. Caching strategy in a CDN 3. How to stop unauthorised users from accessing secure content
It takes a team. We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator, etc. Each video takes many hours to make.
@@ByteByteGo ohh that’s crazy :) Any tool suggestions for creating a nice presentation similar to what you do? I wanna do something for my job, but don’t wanna go to crazy with video editors :)
Could be, but it has some potential simplifications. For example: In some scenarios (1:1), the quality may be requested by the client and the server-side transcoding can be omitted (almost) entirely. In most cases the number of necessary quality formats is lower and can be adjusted on the fly. Video calling also does not benefit from any CDN caching and can skip this step entirely. Basically: Video calling is just video streaming, but with a few potential optimisations due to the lower number of viewers.
Great question. Live streaming and video conferencing/calling implementations are quite different. Video conferencing could be an interesting video. The main difference is scale. Living streaming is 1-to-many, where the many could be in the millions. Video conferencing maxes out in the low hundreds, and the experience at that scale is not very good. Also, video conferencing is bi-directional. That imposes a different set of design constraints. To learn more about video conferencing, start with terms like WebRTC, SFU, and MCU.
It is similar. The main difference is that there isn't the same latency constraint so more time can be spent during the video processing stage to improve compression/quality and it's likely that a a different protocol is used on the ingestion side.
Hey, do you have any clue why I can live stream on UA-cam smoothly unlike Twitch where I get tons of frames drops. Never happened to me before and this issue just popped out of the blue. Twitch is my main platform..
Isn't it simpler to write a custom gRPC protocol that uses HTTP2? I think its latency is much much lower than RTMP and SRT. (The project I'm working on has a max streaming audience of 50 viewers. So my load balancing strategy is more relaxed. But thanks for the great video!)
Not sure if it is simpler. It sounds like a lot of work. 😂 Here's another angle. Many streamers prefer to use their own favorite encoder, with OBS being a prime example. Having our own custom protocol would limit that.
For live streaming, we believe the answer is yes. Both HLS and DASH are based on HTTP. If and when they are updated to support HTTP/3, then we can probably say that they use UDP, since HTTP/3 uses QUIC and QUIC is built on UDP. We have a video on HTTP/3 and QUIC: ua-cam.com/video/a-sBfyiXysI/v-deo.html
I'm presently at a loss on a project that involves live streaming i inherited. It was designed with ffmpeg as the transcoding engine and I'm having a huge problem with latency as its output is in rtmp. Can you help me out with figuring out how to reduce latency for Live streams?
I respectfully disagree. Even as a North American native English speaker, Sahn’s narration is one of the main reasons why I love this content. If the channel used a fully-polished professional narrator, I would probably stop watching. Other professionally-narrated “talk over” explainer videos make me lose focus very quickly. Sahn’s accent is unique and casual, and yet also simple and clear. Even though he is reading from a script, it’s not annoying or bland. Instead, it comes across as “even” and “steady”, which is exactly what you want for this type of content. This is a very difficult balance to pull off. I also appreciate his “talking head” in the corner, as it gives the viewer another location to “rest” their eyes from the topic being animated. Again, simple without being distracting. As a leaner, I don’t want to be smothered by professionalism; I want to remain engaged in the topic, which I think the team achieves very well.
Video capture --(RTMP)--> PoP Server -> Transcoding / Segmentation -> Packaging -> CDN distribution / Caching
Right on the money. No BS! No Hype! No extraneous info. Just get's to the point with clear graphics. 5 minutes and done. Beautifull!
Imagine you are doing R & D on a topic for the last few days and you are drowning. Then your fav youtuber came with a boat. That's happened right now. Thanks Man
I can relate to this..
There is surprisingly little content on exactly how this works from a system design perspective
There are many youtubers who have explained it in much more depth and with easy to understand approach
This is literally what just happened to me lol
@@akshaykmalik can you suggest few names? I am looking to learn more on this
I would love to see architectures of Saas startups' software. Evolution of the architecture, how to scale. Thanks for your videos, there is a lot to learn from them.
Soon I'll start live streaming, and start from scratch, trying to build a SaaS product that consists out of multiple microservices. Running in a Kubernetes cluster in docker instances on AWS using Terraform, Github Actions, different backend languages/frameworks, trying to combine everything and show what that hassle of that process is, which walls you'll run into and how to solve each problem as elegant as possible.
Disclaimer: I'll try to avoid any type of JS in de backend ;)
@@tpotjj2979 cool, where can we find it?
@@barnabaslada-hartyani8998 Last week I've released my "first video" on my channel. It was my first livestream and first video edit, so thing where a bit messy, don't mind the quality of it at the moment.
Next two weeks I have vacation, bought a new Macbook and a video editing course, so I hope that quality will increase a lot as well as my streaming schedule!
YT: ua-cam.com/channels/SBbWhPHNiIs8VgLzW3s-Bg.html
Twitch: www.twitch.tv/tpotjj
@@tpotjj2979 awesome, keep up the good work bro
@@barnabaslada-hartyani8998 thanks for subscribing! Long way to go, just have to put in the work next couple of weeks.
Please subscribe if you learned something new.! Thank you.
Tools we use: Adobe after effects and illustrator
Very efficient description of live video streaming I have seen so far. It's amazing how you covered this topic in about 5 mins
I love this channel. Last night I was literally asking: "I wonder what the architecture of a live streaming platform is" and BAM!
that is crazy considering he only have 18 videos in total
@@luv2stack RIGHT!?
is a quantum perfection no?
I love that these are "bite sized" at around 5m - I can always make a point of fitting them in even on a busy day, and they're always worthwhile :)
Very informative videos from your channel. Thank you to you and your team who make so much effort with different tools and spend hours just for a short video. Another appreciable point is you read the comments on your videos and reply every question by viewers.
🎯 Key Takeaways for quick navigation:
00:07 📹 Live streaming faces challenges due to real-time internet transmission and compute-intensive video processing.
01:07 🌐 Encoders package video streams using protocols like RTMP, while newer options like SRT promise lower latency and network resilience.
02:06 🌍 Point-of-presence servers are used to optimize upload conditions for streamers and ensure fast transmission to the platform.
02:35 🔄 Adaptive bitrate streaming allows video players to adjust quality based on viewer's internet connection, and transcoding converts video streams into different resolutions.
03:38 📦 Popular live-streaming formats include HLS and DASH, with HLS being the most widely used format, consisting of manifest files and video chunks.
04:38 ⌛ Achieving lower latency may require sacrificing video quality, and some platforms offer options for streamers to adjust interactivity and quality.
Made with HARPA AI
Besides the polished script, I gotta compliment the art design and pacing for these videos. 10/10
What software do you use to make these presentations? They're very slick!
Somebody get this guy a raise!
I am also curious what software is used to create those animations ?
Powerpoint
Thank you. Adobe illustrator and after effects
Segmentation and transcoding are key. I had always wondered how you'd deal with various resolutions and bitrates, and how you'd chop up a video in smaller pieces.
I ve been waiting for a channel like that for such a while thank u so much
This is amazing content. Thanks for making such high quality content available for free.
Wow that was a really smooth presentation on the topic
You make it so simple man!! thanks for share this knowledge
We are all learning how to make quality videos as we go. It takes a team. Our editors on illustration and animation are awesome, we have to say...
Fantastic channel.
I would be interested in how to design an IoT telemetry system. It would be an interesting opportunity to explore time series databases.
That's a good idea. We will definitely do that at some point.
@@ByteByteGo Great ! Looking forward to it !
beautiful diagrams! 🕺 and great explanations
Appreciated your content, I couldn't stop your video once started to watch it. But please try making a more details Video, explaining more about the components. Thanks.
geez the explanation is superb! thanks! keep up the good work!
Saas for managing company workflows would be great!
Very nicely represented and done.
Such great quality videos! ❤
This is an Amazing Explaination Thank you for the video :D
Great Explanation. Thank you for the video!!!!
thanks for sharing, very informative. 🙂
much helpful videos content as a computer science student... keep going ❤❤👍👍👏
It's a gem! Thanks for sharing! :)
Thank you for such a high quality video
Precisely and simple speaking. I have spend a few minutes everyday to watch. Can I ask what is your tool yo create such pretty presentation?
Thank you. Adobe illustrator and after effect.
@@ByteByteGo With the amount of people asking what you you use to make these animations (myself included), there might be a market out there tailored to system diagrams animations for those without graphics design background. I know I would pay for such a service.
This was a really good overview. thanks
Very well done
How does the CDN delivers the content so fast to clients all over the world? That's the question I had in mind, but was not answered unfortunately. The rest of the process is interesting also, but I would have imagined something like that.
How the CDN achieves such latency all over the world is a mystery to me
very interesting. thanks for this good explanation
Very good! Thank you
I loved the content. What do you use to edit the video? what do you use for the animations?
Thanks
Thanks for this video. How do we implement the feature of playing video watched on one device to start exactly where we left on another like UA-cam? Especially where and how do we store that data?
thank you brother.
Would you please make a video about how Jenkins works?
Great video as always
thanks
Very useful. Thank you
Can you please make a detailed video on GraphQL too🙏🏻🙏🏻🙏🏻
Yes, it is on our list.
@@ByteByteGo Thankyou so much for the update and also for the quality videos you make🙏🏻🙏🏻🙏🏻
Thank you so much for such a great lesson/video. May I know what tool r u using for this graphic/video?
Awesome video 👌🏻
Great content, keep it up!
Great video
Could you do a presentation on how CDN works.
Thank you for the suggestion. We will put it on the list.
Is there a particular area of CDN you would want to know about?
@@ByteByteGo I want to know
1. How is the closest CDN server chosen by the client
2. Caching strategy in a CDN
3. How to stop unauthorised users from accessing secure content
awesome! thanks!
Nice one !
it don't get better then this.
Amazing!
Which platform did he use to design this flow?
What technology did you used to build the presentation?
4:20 he used the word "streaming format" for DASH/HLS which confused me. If I'm correct, it should be a "streaming protocol".
May I ask what tool you use to create the schematics and stuff in your videos?
We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator.
Interesting can you please tell me which tool you are making interesting diagram
Thanks for great content !
Does anyone know, which software/tool is being used to make these videos/animation ?
We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator.
What tool do you use to create such excellent animations?
How can I do my podcast live? While using 2-3 different cameras & audio through a rodecaster pro?
Hey Alex
What are you using for creating these slideshows??
Looks amazing!
It takes a team. We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator, etc. Each video takes many hours to make.
@@ByteByteGo ohh that’s crazy :)
Any tool suggestions for creating a nice presentation similar to what you do?
I wanna do something for my job, but don’t wanna go to crazy with video editors :)
Alex Xu老师 这个视频的齿音太明显了 需要升级下设备或者后期用专业软件消除下齿音 加油！
How do you animate your videos? 😱
Using Adobe After Effects for sure.
@@ibrahimkhurshid4339 Maybe! Some people script their videos, like 3b1b. But I assume that's inefficient for this kind of content
With video processing!
I would love to know this as well. Visualisation and animations in this video are amazing.
@@ibrahimkhurshid4339 is those effects available from the box there or you need to buy/animate by youeself all that fancy appearing icons?
hey, I am super sleepy, could you please write the document more easier to understand and remember, including all the details for interview. thank you
Is Live-streaming same as video calling? If not what's the difference?
Could be, but it has some potential simplifications. For example:
In some scenarios (1:1), the quality may be requested by the client and the server-side transcoding can be omitted (almost) entirely. In most cases the number of necessary quality formats is lower and can be adjusted on the fly.
Video calling also does not benefit from any CDN caching and can skip this step entirely.
Basically: Video calling is just video streaming, but with a few potential optimisations due to the lower number of viewers.
Great question.
Live streaming and video conferencing/calling implementations are quite different. Video conferencing could be an interesting video.
The main difference is scale. Living streaming is 1-to-many, where the many could be in the millions. Video conferencing maxes out in the low hundreds, and the experience at that scale is not very good.
Also, video conferencing is bi-directional. That imposes a different set of design constraints.
To learn more about video conferencing, start with terms like WebRTC, SFU, and MCU.
@@ByteByteGo Thank you! I am learning how WebRTC works. Yes, it would be great if you make video or blog about video conferencing.
This is very interesting… is this also similar to how a non live normal video share platform works..eg netflix prime youtube..?
It is similar. The main difference is that there isn't the same latency constraint so more time can be spent during the video processing stage to improve compression/quality and it's likely that a a different protocol is used on the ingestion side.
Is SRT based on HTTP/3 ?
No, but both are UDP-based.
@@ByteByteGo Yes, this is why I asked.
Curious to know if there is some natural convergence between those two protocols.
Hey, do you have any clue why I can live stream on UA-cam smoothly unlike Twitch where I get tons of frames drops. Never happened to me before and this issue just popped out of the blue. Twitch is my main platform..
Isn't it simpler to write a custom gRPC protocol that uses HTTP2?
I think its latency is much much lower than RTMP and SRT.
(The project I'm working on has a max streaming audience of 50 viewers. So my load balancing strategy is more relaxed. But thanks for the great video!)
Not sure if it is simpler. It sounds like a lot of work. 😂
Here's another angle. Many streamers prefer to use their own favorite encoder, with OBS being a prime example. Having our own custom protocol would limit that.
How can i create my own sdk
This is why you experience slightly slow internet when you're on VPN
So currently most of the stream services serves the content using tcp?
For live streaming, we believe the answer is yes. Both HLS and DASH are based on HTTP.
If and when they are updated to support HTTP/3, then we can probably say that they use UDP, since HTTP/3 uses QUIC and QUIC is built on UDP.
We have a video on HTTP/3 and QUIC: ua-cam.com/video/a-sBfyiXysI/v-deo.html
I'm presently at a loss on a project that involves live streaming i inherited. It was designed with ffmpeg as the transcoding engine and I'm having a huge problem with latency as its output is in rtmp.
Can you help me out with figuring out how to reduce latency for Live streams?
What is the latency now, and how low do you need to go?
@@ByteByteGo there's a massive delay of 11-18secs delay and i am looking at how to get it to 5-7 secs at the very least
👏👏👏
Teriffic video. UA-cam is just flooded with filler content, so refreshing to see this type of material.
damn I don't see that in the book, why so many new items
is this covered in book?
No, not in our two books.
Kuhlman Junction
This could have been a nice video but you were too fast. Slow down a little
bro the video animation is very good, hats off. but the voice and explaination is soo poor..please hire a voice artist
I respectfully disagree. Even as a North American native English speaker, Sahn’s narration is one of the main reasons why I love this content. If the channel used a fully-polished professional narrator, I would probably stop watching. Other professionally-narrated “talk over” explainer videos make me lose focus very quickly. Sahn’s accent is unique and casual, and yet also simple and clear. Even though he is reading from a script, it’s not annoying or bland. Instead, it comes across as “even” and “steady”, which is exactly what you want for this type of content. This is a very difficult balance to pull off. I also appreciate his “talking head” in the corner, as it gives the viewer another location to “rest” their eyes from the topic being animated. Again, simple without being distracting. As a leaner, I don’t want to be smothered by professionalism; I want to remain engaged in the topic, which I think the team achieves very well.
Great video as always
thanks