I am a final year mechanical student ✅ how I become a devops engineer ??? I don't want to make money I just want to grow my skill, as a DevOps engineer what you think which is the best step for me ??? 👏🏽
Get fundamentals right. Networking -> OS -> Linux. Then get hands on with the Tools such as Docker and Kubernetes use them in projects. Get Free Cloud Trial accounts set up highly reliable systems. Then apply to companies for internships/fresher roles meanwhile still working on yourself. Make sure to be in a company that is at that scale where they have clients with SLAs so that they have production servers running on k8s and so on. Then only you'll get to learn instead of where I interned which used EC2 and ECS for their services and faced considerably high downtime in prod environments
One of the issues I can identify is that the content can be easily redistributed. It’s quite straightforward to download HLS videos, even if you have a signed URL from S3. To address this, consider implementing HLS with encryption. Additionally, verify the S3 signed URL using an additional Lambda verification on our CDN’s incoming request for these contents. This measure enhances security and makes it more challenging for unauthorized individuals to download and distribute the content.
I am a fresher, just got my first job, even though i have AWS certifications it is hard to understand this for me now, completely watched this video, now will comeback after a month to see how much i am able to understand at that time XD
Use of fargate with asg might be cheaper if you use golang for the backend, golang requires very less resources and can handle almost double the amount of traffic per second when compared to node js.
That's actually much cheaper than I thought it'd be. I wonder how'd the costs look like if a lot more of the architecture was serverless, considering the recent cultural shift towards serverless-less.
Hi Mehul, To connect cloudfront to lambda function using lambda url, how are you managing the API paths. I can think of using behaviors, if so, isn't it cumbersome to manage ?
Looks like you forgot to tick the free tier checkbox, and multi-az is a best practice for failover. Also, I didn’t notice your egress. That’s just the tip of the iceberg. There’s cost for backups and lots of other knobs you didn’t mention.
Do you use any of the premium support options from AWS? I remember they had an option where they assign a dedicated TAM to you and have periodic reviews of your infrastructure going over stuff like cost optimize, future planning, arch review etc.
Not sure but maybe media convert with reserved capacity might a bit cheaper for transcoding in your case instead of having so many large instances running but overall awesome setup and amazing breakdown it will really help a lot us to understand the pricing change with different services
i have always wondered how does this sponsorship works, like even though the video is sponsored it's not just about their product but more of the actual content, so what happens like do u come up with an idea make a video and then approach the brand to sponsor it or do they approach you first? i just wanna know how the cycle works here
Can you give me insight on this : What if I just rollup a vps from something like digital ocean and just used "golang on the server" and "postgres" on the db now with that - I have full control over my system - meanwhile I am not vendor lock in and also it costs me almost nothing. but how scalable is that? and how hard is to maintain it as a group of 1-3 dev.
@oSpam There are advantages to cloud for sure. But on-prem has another set of advantages. It depends on which set of advantages you want to prioritise. I am into HPC and for me cloud is a no go.
Thanks to Miro for sponsoring today's video. Check out Miro here: miro.pxf.io/19GP4m
As a DevOps Engineer I absolutely loved this one! Just perfect
Hi, How can I be a devops engineer
I am a final year mechanical student ✅ how I become a devops engineer ???
I don't want to make money I just want to grow my skill, as a DevOps engineer what you think which is the best step for me ??? 👏🏽
Get fundamentals right. Networking -> OS -> Linux. Then get hands on with the Tools such as Docker and Kubernetes use them in projects. Get Free Cloud Trial accounts set up highly reliable systems. Then apply to companies for internships/fresher roles meanwhile still working on yourself. Make sure to be in a company that is at that scale where they have clients with SLAs so that they have production servers running on k8s and so on. Then only you'll get to learn instead of where I interned which used EC2 and ECS for their services and faced considerably high downtime in prod environments
People coming here get to see Mehul's balance sheet and AWS cost; Mehul starts the AWS 101 lecture.
One of the issues I can identify is that the content can be easily redistributed. It’s quite straightforward to download HLS videos, even if you have a signed URL from S3. To address this, consider implementing HLS with encryption. Additionally, verify the S3 signed URL using an additional Lambda verification on our CDN’s incoming request for these contents.
This measure enhances security and makes it more challenging for unauthorized individuals to download and distribute the content.
you don't need an sqs to trigger the lambda. S3 itself can do so. all the transcoding should just use eks
This can also avoid polling SQS, just one straight pipeline
I am a fresher, just got my first job, even though i have AWS certifications it is hard to understand this for me now, completely watched this video, now will comeback after a month to see how much i am able to understand at that time XD
As business owner and feder weight in tech ops this was very explanatory and a mind opener. Thank you for the clear explanation
Your architecture is way more simple and light weight in comparison to open edx which is not flexible in terms of customisation, it is a good thing
Use of fargate with asg might be cheaper if you use golang for the backend, golang requires very less resources and can handle almost double the amount of traffic per second when compared to node js.
Thank you so much for this informative video on infrastructure.
Thanks man, loved it, Please make such videos more
That's actually much cheaper than I thought it'd be. I wonder how'd the costs look like if a lot more of the architecture was serverless, considering the recent cultural shift towards serverless-less.
Hi Mehul,
To connect cloudfront to lambda function using lambda url, how are you managing the API paths. I can think of using behaviors, if so, isn't it cumbersome to manage ?
Looks like you forgot to tick the free tier checkbox, and multi-az is a best practice for failover. Also, I didn’t notice your egress. That’s just the tip of the iceberg. There’s cost for backups and lots of other knobs you didn’t mention.
great video mehul, thanks. very informative and transparent.
Why there are two separate S3 buckets? One while video is being uploaded and other one is for storing it permanently?
Do you use any of the premium support options from AWS? I remember they had an option where they assign a dedicated TAM to you and have periodic reviews of your infrastructure going over stuff like cost optimize, future planning, arch review etc.
Yes, we don’t use support
Hi mehul you said you guys use DRM protection then why does the video show in screen recording?
It’s not enabled by default (since it is chargeable component). Creators who want to enable it ask us to do it from our side
Miro is 👍, I have used miro in my previous startup company .
This was an insightful video
Not sure but maybe media convert with reserved capacity might a bit cheaper for transcoding in your case instead of having so many large instances running but overall awesome setup and amazing breakdown it will really help a lot us to understand the pricing change with different services
Hi Mehul, You did not seems to use EFS system in your diagram when doing video processing . Just lamda and Ec2 multiple instances ?
Next video on how you use cloudfare for fermion ?
Insightful explanation
The best part of AWS is its exceptional availability and reliability.
Miro is awesome, btw what’s the right way to pronounce it? Is it meero or māiro? “Jira” is officially settled at least.
A quick question: how many users do you've per month for this scale? Is this scale typical of startups? Thanks!
i have always wondered how does this sponsorship works, like even though the video is sponsored it's not just about their product but more of the actual content, so what happens like do u come up with an idea make a video and then approach the brand to sponsor it or do they approach you first? i just wanna know how the cycle works here
Does aws amplify fit in this prototype? It is also serverless technology and need of integrate apis and lambda functions with rds, s3, cognito.
Never used it
Can you give me insight on this :
What if I just rollup a vps from something like digital ocean
and just used "golang on the server" and "postgres" on the db
now with that - I have full control over my system - meanwhile I am not vendor lock in and also it costs me almost nothing.
but how scalable is that? and how hard is to maintain it as a group of 1-3 dev.
and use iptables with ssh-keys, different port and openvpn for additional security and cloudfare for obvious reasons.
Can you please send this infra diagram? Thank you
@mehul Why S3 instead of R2. Even when S3 has really costly data outflow cost.
Cloudflare (and r2) has extremely bad peering in India with networks. Speeds are very slow
What is opinion on openai o3 model?
Very cool! Video soon
Very Insightful, thanks
Welcome back Mehul 👋
Thank you for making this video. Educative much!
After a long time mehal ❤
Will using ecs fargate for your node services be more expensive than using lambda?
We are now on metal for our Backend, this is how it was on AWS
@@codedamncan you make a video to show how moving from AWS to bare metal has reduced the cost
Why Video transcoding is not done inside the Lambda itself?
For transcoding, you will need to do some file system write operation?? If so, then it can't be done since lambda does provide such functionality.
@@faiz697 I think lambda provide some local storage. Correct me I am wrong.
@@jaisaravanan1612 you might be talking about ephemeralStorage then. I wouldn't use it for any important work
I see that cloudflare is replaced with cloudfront after that Jio-CF bug
AWS Cognito?
Mehul, Lot's of start ups are struggling or getting crushed under "taxes".
Tldraw will never forgot this 😂😂
Valuable ❤
7:17 Why does it look like youtube player?
fuck I hate automatic translations on yt tittles did you really mean "fruit"? I get that on spanish but doesn't tell me anything
Quality video
HEy I am lazy can somone put the cost he mentioned
About 2500$/mo
it takes 6usd droplet. nothing more at the very beginning.
👍 great
Hey @Mehul what js framework you use in aws lambda?
We wrote it internally for our Backend
May be build your own onprem lab till you make money
Just go on-prem !
$2600 for all this circus and poor performance is too much.
You must hire some cheap staff to be keeping your servers up. Let alone the electricity, actual hardware costs and multi regions
@oSpam There are advantages to cloud for sure. But on-prem has another set of advantages. It depends on which set of advantages you want to prioritise. I am into HPC and for me cloud is a no go.
Yo!
RDS is bit costly to be honest, but their are reliable option too in market .🤔 But you are going with AWS for all other stuff seems good choice then .
Bhai yaa toh tu samjha leta how much it cost to run a tech startup ya toh sponsor ke sath hi bakchodi karle