Day-18 | AWS Cost Optimization | Most Popular Cloud and DevOps project| Event Driven Serverless

Support my work
www.buymeacoff... Hi Everyone, My Name is Abhishek and my channel is focused on delivering Free content on DevOps and Cloud. Follow my channel for practical learning of DevOps and Cloud. Don't miss the FREE DEVOPS COURSE in Playlists.
In this video, We will learn how to implement the cost optimization project on AWS using lambda functions and event driven serverless architecture.
Private Telegram Channel For Doubts Clearing
www.youtube.co...
Instagram: / abhishekveeramalla_off...
GitHub Repo for this video
github.com/iam...
Book 1:1 with me on TopMate for career guidance
topmate.io/abh...
Public Telegram Channel For Notes and Updates
t.me/abhishekv...
About me:
========
LinkedIn: / abhishek-veeramalla-77...
GitHub: github.com/iam...
Medium: / abhishekveeramalla-av
#devops #futureofdevops #kubernetes #sre #aws #azure
DEVOPS FAQ
DEVOPS
WHAT IS DEVOPS ?
WHY DEVOPS ?
HOW TO LEARN DEVOPS ?
LEARN DEVOPS IN 60 DAYS ?
NON IT TO IT BACKGROUND ?
IS DEVOPS EASY TO LEARN ?
BEST DEVOPS COURSE
FREE DEVOPS COURSE
#AbhishekVeeramalla
BEST DEVOPS VIDEOS
DEVOPS INTERVIEW QUESTIONS
EASY DEVOPS VIDEOS
BEST WAY TO LEARN DEVOPS
PYTHON FOR DEVOPS
PYTHON PROJECTS FOR DEVOPS
LEARN PYTHON
PYTHON PROJECTS FOR AWS
AWS PYTHON PROJECTS
AWS LAMBDA FUNCTIONS
WHAT IS GITOPS ?
WHY GITOPS ?
LEARN GITOPS ?
GITOPS FREE COURSE
What is AWS ?
LEARN AWS FOR FREE
AWS COURSE
AWS COURSE FOR DEVOPS
AWS CLI Deep Dive .
.
Disclaimer: Unauthorized copying, reproduction, or distribution of this video content, in whole or in part, is strictly prohibited. Any attempt to upload, share, or use this content for commercial or non-commercial purposes without explicit permission from the owner will be subject to legal action. All rights reserved.

[@softwareasafun]

Thanks!

[@AbhishekVeeramalla]

Thanks alot for supporting the channel

[@Suresh-yp5fb]

00:07 Cloud cost optimization
05:46 Stale resources on AWS can lead to higher cloud costs
11:35 Create a Lambda function to delete unused EBS volume snapshots
17:38 A Lambda function is used to delete snapshots that are not associated with any volume.
23:21 Increase default invocation time for Lambda to 10 seconds
28:59 Learn how to manage cloud cost optimization in AWS accounts
34:47 Demonstration of creating and deleting snapshots
40:01 Lambda functions can be scheduled to run automatically using CloudWatch events.

[@swally5786]

@Suresh-yp5fb can you make a summary for all the videos :)

[@chandangowda6935]

Each and every word in the python script understood how it is going to fetch the running instances , after fetching it will check for snapshot. If that snapshot doesn't belong to any running instances or EBS, directly delete it. After deleting, again using try block once again checks the volume of snapshot if it is present or not. Really impressed with the code Abhi Bro

[@anilsree06]

Implemented the cost optimization demo Abhishek it was good getting errors and rectifying those and setting up the policies with ec2 and snapshots and creating ec2 from volume creating snapshot with the help of your code I was able to implement removing stale snapshot which is not associated to the volume " This is the final response Deleted EBS snapshot snap-0c443b848464 as its associated volume was not found." Thanks a bunch Abhishek.

[@AbhishekVeeramalla]

🚀🚀

[@veerasundar8420]

This is the concept which i was asked in the multiple interviews and i just said i haven't worked on it and we look for instance utilizes alone something like that
Thanks for the explanations 😮😊

[@AbhishekVeeramalla]

😍🚀

[@veerasundar8420]

We can apply the same for s3 as well right

[@veerasundar8420]

Wow what a quick response 🎉

[@sai-zk3bz]

I just came across your shot video on zero to hero aws,wanted to watch all the previous videos and want to practice too
Subscribed to your channel,Thanks

[@AbhishekVeeramalla]

Amazing

[@faisalraj6654]

Hi Abhishek, Well-explained in a friendly manner that is easily to grasp the logic, you showed here. Thankyou so much.

[@AbhishekVeeramalla]

Thanks a lot

[@VaibhavSupe]

Thank you so much Abhishek for AWS Cost Optimaization demo......I was working on AWS Cost Optimaization from 1-1.5 years but this approach is very efficient / time saver / chances of making mistakes are very less and able to save AWS resources cost drastically.
Thanks again🙏 and waiting for another such content🤩🤩🤩

[@AbhishekVeeramalla]

You are welcome 🤗

[@pandumaheswaram7522]

Ur explanation and execution is on point, very simple and engaging. Thanks for contributing your knowledge to the Devops community and the fellow Learners.

[@AbhishekVeeramalla]

Thanks bro

[@Vishwask22]

Awesome project brother, I did it and gained insights about CloudWatch and Lambda Function!

[@AbhishekVeeramalla]

Great to hear!

[@unkownindian11]

bro your content is really good many paid courses fail to deliver this type of content

[@PavanKumar-fc9xu]

Just one word Awesome!!!! Felt very happy after understanding the concept and able to successfully execute it without looking into the code....Kudos Abhishek

[@AbhishekVeeramalla]

Kudo to you 🚀

[@ashwanigupta9991]

best youtube channel for devops. i am developer and enjoy your teaching keep it up bro

[@nousheensafoora206]

Thanq so much for project ,explained in easy manner

[@LathasriDudyala]

Thankyou abhishek garu for all your videos. It helps lot of people.

[@rameshbattala9691]

I like your way of teaching, it is very easy to learn new thing's. Thank you so much abhishek

[@AbhishekVeeramalla]

So nice of you

[@sl4ught3r94]

It is a wonderful project. Thank you very much.

[@AmirSylviesh]

For some reason I didn’t find the describe volume permission before and when tried to run the lambda test it didn’t give any errors about it - but when I finally found it and added it it worked like magic thank you very much !

[@supriyochatterjee4095]

Excellent information, Sir kindly make more videos explaining the concepts and applications of Terraform in AWS in details and how to configure AWS NETWORKING Networking with details steps explained

[@AbhishekVeeramalla]

Noted

[@uzairbagwan4117]

Demo performed and executed as you have done and got the exact .. output..Thanks sir for the wonderful explanation and teaching and demos as well❤

[@pascaleobiorah5407]

Absolutely detailed and crystal clear! Thanks, Abhishek! You're a maestro!!!!!

[@AbhishekVeeramalla]

My pleasure 😊

[@amitbadyal7631]

Thanks Abhishek for the best explanation on cost optimisation and lambda functions...i have no words to thank you.....and thanks for this good work as you are providing this top notch content for free ....thanks a lot bro❤

[@Shrey319]

Wonderful person
Wonderful attitude
Wonderful teaching
The world needs more people like you
I'm not exaggerating
God bless you 🙏

[@AbhishekVeeramalla]

Thanks alot

[@mohanmurali7975]

Thanks abhishek successfully executed and understood everything crystal clear👍🙂

[@rajenderprasad1193]

Thanks anna.. Performed the demo.. everything worked and learned all good stuff. Thank you

[@AbhishekVeeramalla]

You are welcome

[@AshishGupta-oj3qe]

Words are less to express my gratitude 🥰

[@AbhishekVeeramalla]

Thank you so much 😀

[@1rv04ee065]

Very helpful video . Thank you Abhishek for sharing the knowledge with clear explanations of the concepts along with a neat demo . Well done and keep up such good work !

[@AbhishekVeeramalla]

My pleasure

[@devashreejavalkar8994]

So simple language , easy to understand . Thank u so much 😊

[@AbhishekVeeramalla]

You are welcome 😊

[@jitendrashimpi9964]

Thank you Abhishek sir for such content nice and briefly explain the lambda function and project thank you again

[@AbhishekVeeramalla]

It's my pleasure

[@vamsikrishnanakka838]

Thank you for bringing a such cool Projects.❤

[@AbhishekVeeramalla]

😍

[@singhbrozz1996]

thanks for giving wonderfull session for cost optimization.

[@DeepakSingh-o6n6p]

successfully implemented the project and also integrated with sns
done
Amazing Video🔥

[@mikemonchu5622]

Thank you so much for the great and easy to follow content!!!

[@KRISHNAKUMAR-yj3dx]

Awesome explanation for cost optimization
Thanks a lot

[@AbhishekVeeramalla]

Most welcome!

[@darshanks5604]

Thanks Abhishek Sir. Keep teaching like this but you deserve more subscribers.

[@NagaSailaja-eq5ke]

thanks lot for helping in learning aws lambda function topics

[@AbhishekVeeramalla]

All the best

[@Aman-fz1ew]

Quality Content .

[@PrachiBhoj-k8v]

thank u so much abhishek sir for sharing the knowledge

[@himms_sharma]

Wonderful project 👏

[@AbhishekVeeramalla]

Thanks

[@minhajkhan504]

This is super useful! Thank you Abhishek :)

[@minhajkhan504]

Amazing video, thank you so much Abhishek :)

[@karthiksundaram544]

Superb teaching

[@AbhishekVeeramalla]

welcome

[@ashishpandey8766]

Thanks, Abhi

[@AbhishekVeeramalla]

Welcome

[@Sampathkumar.Devireddy]

I appreciate all your helpful information. I would like you to please make a video explaining how to set up a production grade eks cluster with the help of other services...it must have high security. We know how to set up eks clusters, but do not know the best practices.

[@AbhishekVeeramalla]

I made video couple of days back about kubernetes security and same applies for eks as well

[@partho-lia]

Well explained

[@tanayabanerjee2380]

Thanks for this tutorial 👍....One Request After this aws series If its possible for you then please start a Open-shift tutorial and mainly Python tutorial with practical implementations for devops ...

[@AbhishekVeeramalla]

I will take a note

[@rohitdeore5928]

Successfully completed the demo.

[@premium7720]

Gained lot of knowledge by this video thank you sir :)

[@AbhishekVeeramalla]

Most welcome!

[@karthikd5292]

To good explanation sir

[@AbhishekVeeramalla]

Thanks and welcome

[@538sureshs7]

Thanks for the video anna i will add this into resume

[@minalyawale2]

Hi Abhishek, Thanks for such wonderful videos and series. Your teaching skills are awesome. Can you please make video on AWS CDK also?

[@AbhishekVeeramalla]

Sure

[@shakeebanwar4403]

very well explain

[@AbhishekVeeramalla]

Thanks

[@vikramnoel1239]

Hi Abhishek, hope you are doing well. You are closer to the completion of AWS course. I would like to request you to please announce the Azure 30 day course ASAP. Thank you 🙏

[@AbhishekVeeramalla]

🥳

[@hemantrathod9868]

Great!!

[@saideekshith1349]

Thanks man. such a fantastic help. God bless you.

[@AbhishekVeeramalla]

Welcome

[@curious-codmobile1283]

Love you Abhi...my best bro !!!

[@AbhishekVeeramalla]

😍

[@aditya8sharmaDevOps]

Thanks for the video! ✨

[@AbhishekVeeramalla]

You're so welcome!

[@aditya8sharmaDevOps]

@@AbhishekVeeramalla Also, please make a video on AWS Solutions Architect Certification. And how to prepare for it!

[@Sampathkumar.Devireddy]

thanks bro.....and please make a vido on how to create multi master eks production cluster with high security

[@AbhishekVeeramalla]

Please watch videos that I posted a couple of days back of kubernetes security.. it applies for eks as well

[@SaiKiran-tb9nv]

Please add some more use full services provided by the AWS Sir.

[@urbansounds814]

thank you ,

[@mohammed_rayees387]

sir, I have successfully Executed it😇

[@sudhansagar]

Thank you for providing such an informative session and creating these helpful videos. Do you plan to cover topics related to determining the overall cost of resources before building anything on AWS?

[@AbhishekVeeramalla]

Noted

[@saurabhbisht9280]

please make a complete video on prometheus architecture including jobs, exporter ,all metric type and one project on that only .It will be very helpful as i can't see any complete video on that in youtube also

[@AbhishekVeeramalla]

Noted

[@pawangahlot428]

I wait today video ❤

[@AbhishekVeeramalla]

Thanks 🙏

[@kodjoviamedimele3066]

@@AbhishekVeeramalla Please sir I have been on the ultimate cicd implementation with argo cd but the pipeline always failed at the stage of building the docker image. it is giving me "docker command not found " although I have docker up and running and also I have created the credentials to let jenkins connect to my dockerhub registry. Please could you guide me?

[@prashlovessamosa]

Thank you.

[@AbhishekVeeramalla]

Welcome 🙏

[@adityaxyz007]

Thank You !

[@AbhishekVeeramalla]

You're welcome!

[@nipunkochar7765]

execution time has limitatons:
min time : 3 sec
max time : 900 sec.

[@Kushbukushbu770]

Thank you 😍

[@AbhishekVeeramalla]

My pleasure 😊

[@itsnaimish7142]

thankss sir

[@reneshmlal2809]

Thank You ❤

[@Ankita-d4h4t]

Brother best explanation. We stopped at event bridge scheduler, how we will explain this step in Interview. I want to know it looks critical since aws is event driven function. Please continue on aws lambda in some other project.

[@AbhishekVeeramalla]

Hey, its very simple, just select the required API action (for example when EBS is created) and Cloud watch will trigger the lambda function you provided whenever the EBS is created. That's it.

[@saswatpriyabrat]

1st Like❤

[@AbhishekVeeramalla]

Thanks 🙏

[@Cloudnp9458]

Cost optimization
People move to cloud because
1. Overhead of infrastructure
2. Cost of infrastructure management
Cloud cost is down only if you use it efficiently.
Taking snapshot of volume means taking backup of volume.
Even after deleting ec2, and volume aws will keep charging for snapshot of volume.
The resources you have forgotten and are being charged are called stale resources.
Cloud cost will go high.
So we as devops engineer have to look for stale resources. Eg, Snapshot that are not attached to ec2 or any volume, send notification or delete the snapshot

[@harshnegi200]

completed..!

[@vasanthamurugesanenglish5882]

Videos are great! Could you kindly make same zero. To hero series for sre role

[@RahulRaj-vt6sk]

Sir after completion of AWS, we need Azure masterclass because company is demanding knowledge of Microsoft Azure nowadays.

[@AbhishekVeeramalla]

I will try

[@Iamkrishnaprasad]

Tq

[@saverhub1458]

Bundle of thanks for such content. Can we schedule the script to run only once a month?

[@AbhishekVeeramalla]

Yes

[@BharathKumarReddy2103]

❤❤❤

[@AbhishekVeeramalla]

Thanks 🙏

[@jayasuriyap8748]

Please make an video for AWS KMS

[@AbhishekVeeramalla]

Yes

[@princejaiswal823]

You will soon touch 100K Subscribers. Advanced Congratulations Abhishek Sir

[@AbhishekVeeramalla]

Thanks 🙏

[@sportworld66]

thankyu helpfl

[@yvlokeshreddy6349]

Super Content...So useful.....Thanks Dude..
Dude, How much python learn need for Devops????

[@AbhishekVeeramalla]

Watch day 1 in python playlist .. I explained in detail

[@anjalpoudel3307]

is the lambda function even useful ? Snapshot lifecycle policy can be set up to manage the snapshots !

[@Cloudnp9458]

Project is filtering and deleting the stale resources.
We will use lambda function to write python code. By using module boto3.
Boto3 will talk to aws API and give information about stale ebs snapshots.
Since lambda function is event written you can trigger it using cloud watch.

[@pujangampa5297]

Once we will add the Cloudwatch schedule. We will be notified or something like that?

[@AbhishekVeeramalla]

U need to add sns

[@pujangampa5297]

Anna, please SNS integrate chesi chupinchandi asalki ardham avvateldh nenu chala sarlu try chesa

[@mmouaz9961]

Love From Pakistan

[@AbhishekVeeramalla]

👍

[@SwatiUniyal01]

Abhishek in industry we take snapshots either manually or by some script for backup, how can we incorporate the same in this project where it will delete or note only the snapshots which has been taken manually only..

[@pavanakula1225]

🎉❤

[@AbhishekVeeramalla]

Thanks

[@SS-rc3bs]

what the architecture role in cost optimization ? can you give me some insight of how the architecture involved

[@rahulsingh-iq4gd]

Hi Abhishek quick question why have you created role which has ec2 as principal and given snapshot read write access to it , I thought you keeping lambda as principle and given it snapshot read delete policy to it will work

[@rj27thug78]

because snapshot is a feature of ec2 not lambda

[@Everydayeepic]

Hi can you please make vdo on AWS console-to-code ( New feature )

[@adityan34]

with your courses can i crack 3 years of exp interview as devops enginner ..? please tell me?

[@gouravchhabra6142]

Hi Abhishek, Suppose there are so many resources which we want to remove which is going to take more than 15 min (max execution time for lambda) then will lambda will scale out for more container to finish that job in max time or it will just fail as timeout , pls clarify

[@AbhishekVeeramalla]

You can split your code and invoke other lambda function from this one
But better to keep your execution time short by writing effective code .. if its not an option your split the code and invoke another lambda

[@Cloud-DevOps_Aspirant]

hi abhishek, can i put this COST OPTIMIZATION project in my resume, even if i don't know python as a language.????
😶😶

[@AbhishekVeeramalla]

Yes, you can

[@sanjay-g3q6g]

hi abhishek please explane " Aws Console code"

[@dhanushgowda7593]

Sir followed as you did, but The Snapshot was not deleted, when i run the test there is no error, it just shows staty id, request id. No message of snap shot deleted. What might be the issue.

[@dilligpay4]

did you check the volume from which you take snapshot is attached to any instance?

[@dhanushgowda7593]

@@dilligpay4 yes

[@Tech-xj8kx]

@dhanushgowda7593 You probably have missed adding DescribeVolumes or DeleteSnapshots permission to the role and you cannot see the error due to the usage of try/except in the script. You can see the exact error by removing those two lines (29 and 34) and then executing the function.

[@jawbreaker828]

why will a developer even forgets to delete snapshots after deleting ec2/volumes ? I am asking this because I dont know what actually happens in enterprise level , will they even forget to delete snapshot ?

[@sweditramteke8761]

yes, we usually forget to delete as we terminate 10-15 instance at a time

[@raviparhad9665]

But sir when organization has minimum snapshot
In this case they can delete it manually.
.....

[@ajayjohn1502]

😊