00:07 Cloud cost optimization 05:46 Stale resources on AWS can lead to higher cloud costs 11:35 Create a Lambda function to delete unused EBS volume snapshots 17:38 A Lambda function is used to delete snapshots that are not associated with any volume. 23:21 Increase default invocation time for Lambda to 10 seconds 28:59 Learn how to manage cloud cost optimization in AWS accounts 34:47 Demonstration of creating and deleting snapshots 40:01 Lambda functions can be scheduled to run automatically using CloudWatch events.
Each and every word in the python script understood how it is going to fetch the running instances , after fetching it will check for snapshot. If that snapshot doesn't belong to any running instances or EBS, directly delete it. After deleting, again using try block once again checks the volume of snapshot if it is present or not. Really impressed with the code Abhi Bro
Implemented the cost optimization demo Abhishek it was good getting errors and rectifying those and setting up the policies with ec2 and snapshots and creating ec2 from volume creating snapshot with the help of your code I was able to implement removing stale snapshot which is not associated to the volume " This is the final response Deleted EBS snapshot snap-0c443b848464 as its associated volume was not found." Thanks a bunch Abhishek.
This is the concept which i was asked in the multiple interviews and i just said i haven't worked on it and we look for instance utilizes alone something like that Thanks for the explanations 😮😊
I just came across your shot video on zero to hero aws,wanted to watch all the previous videos and want to practice too Subscribed to your channel,Thanks
Ur explanation and execution is on point, very simple and engaging. Thanks for contributing your knowledge to the Devops community and the fellow Learners.
Thank you so much Abhishek for AWS Cost Optimaization demo......I was working on AWS Cost Optimaization from 1-1.5 years but this approach is very efficient / time saver / chances of making mistakes are very less and able to save AWS resources cost drastically. Thanks again🙏 and waiting for another such content🤩🤩🤩
Excellent information, Sir kindly make more videos explaining the concepts and applications of Terraform in AWS in details and how to configure AWS NETWORKING Networking with details steps explained
For some reason I didn’t find the describe volume permission before and when tried to run the lambda test it didn’t give any errors about it - but when I finally found it and added it it worked like magic thank you very much !
Just one word Awesome!!!! Felt very happy after understanding the concept and able to successfully execute it without looking into the code....Kudos Abhishek
Thanks Abhishek for the best explanation on cost optimisation and lambda functions...i have no words to thank you.....and thanks for this good work as you are providing this top notch content for free ....thanks a lot bro❤
Very helpful video . Thank you Abhishek for sharing the knowledge with clear explanations of the concepts along with a neat demo . Well done and keep up such good work !
I appreciate all your helpful information. I would like you to please make a video explaining how to set up a production grade eks cluster with the help of other services...it must have high security. We know how to set up eks clusters, but do not know the best practices.
Thanks for this tutorial 👍....One Request After this aws series If its possible for you then please start a Open-shift tutorial and mainly Python tutorial with practical implementations for devops ...
Hi Abhishek, hope you are doing well. You are closer to the completion of AWS course. I would like to request you to please announce the Azure 30 day course ASAP. Thank you 🙏
@@AbhishekVeeramalla Please sir I have been on the ultimate cicd implementation with argo cd but the pipeline always failed at the stage of building the docker image. it is giving me "docker command not found " although I have docker up and running and also I have created the credentials to let jenkins connect to my dockerhub registry. Please could you guide me?
Thank you for providing such an informative session and creating these helpful videos. Do you plan to cover topics related to determining the overall cost of resources before building anything on AWS?
please make a complete video on prometheus architecture including jobs, exporter ,all metric type and one project on that only .It will be very helpful as i can't see any complete video on that in youtube also
Brother best explanation. We stopped at event bridge scheduler, how we will explain this step in Interview. I want to know it looks critical since aws is event driven function. Please continue on aws lambda in some other project.
Hey, its very simple, just select the required API action (for example when EBS is created) and Cloud watch will trigger the lambda function you provided whenever the EBS is created. That's it.
Cost optimization People move to cloud because 1. Overhead of infrastructure 2. Cost of infrastructure management Cloud cost is down only if you use it efficiently. Taking snapshot of volume means taking backup of volume. Even after deleting ec2, and volume aws will keep charging for snapshot of volume. The resources you have forgotten and are being charged are called stale resources. Cloud cost will go high. So we as devops engineer have to look for stale resources. Eg, Snapshot that are not attached to ec2 or any volume, send notification or delete the snapshot
Project is filtering and deleting the stale resources. We will use lambda function to write python code. By using module boto3. Boto3 will talk to aws API and give information about stale ebs snapshots. Since lambda function is event written you can trigger it using cloud watch.
Abhishek in industry we take snapshots either manually or by some script for backup, how can we incorporate the same in this project where it will delete or note only the snapshots which has been taken manually only..
abhishek I get the concept but what I am worried about is the code, like how will i be able to write the code of other kinds of scenarios. What can be the solution here?
Hi Abhishek quick question why have you created role which has ec2 as principal and given snapshot read write access to it , I thought you keeping lambda as principle and given it snapshot read delete policy to it will work
Hi Abhishek, Suppose there are so many resources which we want to remove which is going to take more than 15 min (max execution time for lambda) then will lambda will scale out for more container to finish that job in max time or it will just fail as timeout , pls clarify
You can split your code and invoke other lambda function from this one But better to keep your execution time short by writing effective code .. if its not an option your split the code and invoke another lambda
Sir followed as you did, but The Snapshot was not deleted, when i run the test there is no error, it just shows staty id, request id. No message of snap shot deleted. What might be the issue.
@dhanushgowda7593 You probably have missed adding DescribeVolumes or DeleteSnapshots permission to the role and you cannot see the error due to the usage of try/except in the script. You can see the exact error by removing those two lines (29 and 34) and then executing the function.
Thanks!
Thanks alot for supporting the channel
00:07 Cloud cost optimization
05:46 Stale resources on AWS can lead to higher cloud costs
11:35 Create a Lambda function to delete unused EBS volume snapshots
17:38 A Lambda function is used to delete snapshots that are not associated with any volume.
23:21 Increase default invocation time for Lambda to 10 seconds
28:59 Learn how to manage cloud cost optimization in AWS accounts
34:47 Demonstration of creating and deleting snapshots
40:01 Lambda functions can be scheduled to run automatically using CloudWatch events.
@Suresh-yp5fb can you make a summary for all the videos :)
Wonderful person
Wonderful attitude
Wonderful teaching
The world needs more people like you
I'm not exaggerating
God bless you 🙏
Thanks alot
Each and every word in the python script understood how it is going to fetch the running instances , after fetching it will check for snapshot. If that snapshot doesn't belong to any running instances or EBS, directly delete it. After deleting, again using try block once again checks the volume of snapshot if it is present or not. Really impressed with the code Abhi Bro
Implemented the cost optimization demo Abhishek it was good getting errors and rectifying those and setting up the policies with ec2 and snapshots and creating ec2 from volume creating snapshot with the help of your code I was able to implement removing stale snapshot which is not associated to the volume " This is the final response Deleted EBS snapshot snap-0c443b848464 as its associated volume was not found." Thanks a bunch Abhishek.
🚀🚀
This is the concept which i was asked in the multiple interviews and i just said i haven't worked on it and we look for instance utilizes alone something like that
Thanks for the explanations 😮😊
😍🚀
We can apply the same for s3 as well right
Wow what a quick response 🎉
It is a wonderful project. Thank you very much.
I just came across your shot video on zero to hero aws,wanted to watch all the previous videos and want to practice too
Subscribed to your channel,Thanks
Amazing
I like your way of teaching, it is very easy to learn new thing's. Thank you so much abhishek
So nice of you
Hi Abhishek, Well-explained in a friendly manner that is easily to grasp the logic, you showed here. Thankyou so much.
Thanks a lot
bro your content is really good many paid courses fail to deliver this type of content
Thanks abhishek successfully executed and understood everything crystal clear👍🙂
Ur explanation and execution is on point, very simple and engaging. Thanks for contributing your knowledge to the Devops community and the fellow Learners.
Thanks bro
Thank you so much Abhishek for AWS Cost Optimaization demo......I was working on AWS Cost Optimaization from 1-1.5 years but this approach is very efficient / time saver / chances of making mistakes are very less and able to save AWS resources cost drastically.
Thanks again🙏 and waiting for another such content🤩🤩🤩
You are welcome 🤗
Words are less to express my gratitude 🥰
Thank you so much 😀
Awesome project brother, I did it and gained insights about CloudWatch and Lambda Function!
Great to hear!
best youtube channel for devops. i am developer and enjoy your teaching keep it up bro
Absolutely detailed and crystal clear! Thanks, Abhishek! You're a maestro!!!!!
My pleasure 😊
Excellent information, Sir kindly make more videos explaining the concepts and applications of Terraform in AWS in details and how to configure AWS NETWORKING Networking with details steps explained
Noted
For some reason I didn’t find the describe volume permission before and when tried to run the lambda test it didn’t give any errors about it - but when I finally found it and added it it worked like magic thank you very much !
Thank you so much for the great and easy to follow content!!!
Thank you for bringing a such cool Projects.❤
😍
So simple language , easy to understand . Thank u so much 😊
You are welcome 😊
successfully implemented the project and also integrated with sns
done
Amazing Video🔥
thanks for giving wonderfull session for cost optimization.
Thanks anna.. Performed the demo.. everything worked and learned all good stuff. Thank you
You are welcome
Awesome explanation for cost optimization
Thanks a lot
Most welcome!
Amazing video, thank you so much Abhishek :)
Just one word Awesome!!!! Felt very happy after understanding the concept and able to successfully execute it without looking into the code....Kudos Abhishek
Kudo to you 🚀
Demo performed and executed as you have done and got the exact .. output..Thanks sir for the wonderful explanation and teaching and demos as well❤
Thanks Abhishek for the best explanation on cost optimisation and lambda functions...i have no words to thank you.....and thanks for this good work as you are providing this top notch content for free ....thanks a lot bro❤
This is super useful! Thank you Abhishek :)
Thanq so much for project ,explained in easy manner
thanks lot for helping in learning aws lambda function topics
All the best
Quality Content .
Very helpful video . Thank you Abhishek for sharing the knowledge with clear explanations of the concepts along with a neat demo . Well done and keep up such good work !
My pleasure
thank u so much abhishek sir for sharing the knowledge
Thanks Abhishek Sir. Keep teaching like this but you deserve more subscribers.
Thanks, Abhi
Welcome
Thank you Abhishek sir for such content nice and briefly explain the lambda function and project thank you again
It's my pleasure
Wonderful project 👏
Thanks
Superb teaching
welcome
Gained lot of knowledge by this video thank you sir :)
Most welcome!
Successfully completed the demo.
Well explained
I appreciate all your helpful information. I would like you to please make a video explaining how to set up a production grade eks cluster with the help of other services...it must have high security. We know how to set up eks clusters, but do not know the best practices.
I made video couple of days back about kubernetes security and same applies for eks as well
Thanks for this tutorial 👍....One Request After this aws series If its possible for you then please start a Open-shift tutorial and mainly Python tutorial with practical implementations for devops ...
I will take a note
sir, I have successfully Executed it😇
Thanks for the video anna i will add this into resume
To good explanation sir
Thanks and welcome
Hi Abhishek, hope you are doing well. You are closer to the completion of AWS course. I would like to request you to please announce the Azure 30 day course ASAP. Thank you 🙏
🥳
thanks bro.....and please make a vido on how to create multi master eks production cluster with high security
Please watch videos that I posted a couple of days back of kubernetes security.. it applies for eks as well
Thanks for the video! ✨
You're so welcome!
@@AbhishekVeeramalla Also, please make a video on AWS Solutions Architect Certification. And how to prepare for it!
Hi Abhishek, Thanks for such wonderful videos and series. Your teaching skills are awesome. Can you please make video on AWS CDK also?
Sure
Love you Abhi...my best bro !!!
😍
Great!!
Thanks man. such a fantastic help. God bless you.
Welcome
I wait today video ❤
Thanks 🙏
@@AbhishekVeeramalla Please sir I have been on the ultimate cicd implementation with argo cd but the pipeline always failed at the stage of building the docker image. it is giving me "docker command not found " although I have docker up and running and also I have created the credentials to let jenkins connect to my dockerhub registry. Please could you guide me?
very well explain
Thanks
Thank you for providing such an informative session and creating these helpful videos. Do you plan to cover topics related to determining the overall cost of resources before building anything on AWS?
Noted
Thank You !
You're welcome!
please make a complete video on prometheus architecture including jobs, exporter ,all metric type and one project on that only .It will be very helpful as i can't see any complete video on that in youtube also
Noted
You will soon touch 100K Subscribers. Advanced Congratulations Abhishek Sir
Thanks 🙏
Thank you 😍
My pleasure 😊
Thank you.
Welcome 🙏
Brother best explanation. We stopped at event bridge scheduler, how we will explain this step in Interview. I want to know it looks critical since aws is event driven function. Please continue on aws lambda in some other project.
Hey, its very simple, just select the required API action (for example when EBS is created) and Cloud watch will trigger the lambda function you provided whenever the EBS is created. That's it.
Videos are great! Could you kindly make same zero. To hero series for sre role
1st Like❤
Thanks 🙏
Cost optimization
People move to cloud because
1. Overhead of infrastructure
2. Cost of infrastructure management
Cloud cost is down only if you use it efficiently.
Taking snapshot of volume means taking backup of volume.
Even after deleting ec2, and volume aws will keep charging for snapshot of volume.
The resources you have forgotten and are being charged are called stale resources.
Cloud cost will go high.
So we as devops engineer have to look for stale resources. Eg, Snapshot that are not attached to ec2 or any volume, send notification or delete the snapshot
Sir after completion of AWS, we need Azure masterclass because company is demanding knowledge of Microsoft Azure nowadays.
I will try
Thank You ❤
Please make an video for AWS KMS
Yes
completed..!
is the lambda function even useful ? Snapshot lifecycle policy can be set up to manage the snapshots !
Bundle of thanks for such content. Can we schedule the script to run only once a month?
Yes
Project is filtering and deleting the stale resources.
We will use lambda function to write python code. By using module boto3.
Boto3 will talk to aws API and give information about stale ebs snapshots.
Since lambda function is event written you can trigger it using cloud watch.
thankyu helpfl
Hi can you please make vdo on AWS console-to-code ( New feature )
Once we will add the Cloudwatch schedule. We will be notified or something like that?
U need to add sns
Anna, please SNS integrate chesi chupinchandi asalki ardham avvateldh nenu chala sarlu try chesa
❤❤❤
Thanks 🙏
what the architecture role in cost optimization ? can you give me some insight of how the architecture involved
Super Content...So useful.....Thanks Dude..
Dude, How much python learn need for Devops????
Watch day 1 in python playlist .. I explained in detail
Hi @abhishek how we perform health check in ec2 instances can you share info here
Ok sure
Abhishek in industry we take snapshots either manually or by some script for backup, how can we incorporate the same in this project where it will delete or note only the snapshots which has been taken manually only..
abhishek I get the concept but what I am worried about is the code, like how will i be able to write the code of other kinds of scenarios. What can be the solution here?
We are doing python playlist
Sir can you make BillOps poc and put video
Tq
Hi Abhishek quick question why have you created role which has ec2 as principal and given snapshot read write access to it , I thought you keeping lambda as principle and given it snapshot read delete policy to it will work
because snapshot is a feature of ec2 not lambda
hi abhishek please explane " Aws Console code"
Love From Pakistan
👍
Hi Abhishek, Suppose there are so many resources which we want to remove which is going to take more than 15 min (max execution time for lambda) then will lambda will scale out for more container to finish that job in max time or it will just fail as timeout , pls clarify
You can split your code and invoke other lambda function from this one
But better to keep your execution time short by writing effective code .. if its not an option your split the code and invoke another lambda
🎉❤
Thanks
But sir when organization has minimum snapshot
In this case they can delete it manually.
.....
@abhishek Could you please send me the python code am not able to find in above github repo
can someone explain what can we add to our resume from this aws course please?
after aws which topic are you cover
Stay tuned for updates.
Hii Abhishek where to start aws zero to hero or DevOps zero to hero
Devops
Sir followed as you did, but The Snapshot was not deleted, when i run the test there is no error, it just shows staty id, request id. No message of snap shot deleted. What might be the issue.
did you check the volume from which you take snapshot is attached to any instance?
@@dilligpay4 yes
@dhanushgowda7593 You probably have missed adding DescribeVolumes or DeleteSnapshots permission to the role and you cannot see the error due to the usage of try/except in the script. You can see the exact error by removing those two lines (29 and 34) and then executing the function.
with your courses can i crack 3 years of exp interview as devops enginner ..? please tell me?
thanks bro. I tried with this hands-on but shapshit isnt getting deleted.wht can be the problem
Check the cloud watch logs