Day-18 | AWS Cost Optimization | Most Popular Cloud and DevOps project| Event Driven Serverless

Рет қаралды 56,661

11 ай бұрын

Support my work
www.buymeacoffee.com/abhishekprd Hi Everyone, My Name is Abhishek and my channel is focused on delivering Free content on DevOps and Cloud. Follow my channel for practical learning of DevOps and Cloud. Don't miss the FREE DEVOPS COURSE in Playlists.
In this video, We will learn how to implement the cost optimization project on AWS using lambda functions and event driven serverless architecture.
Private Telegram Channel For Doubts Clearing
www.youtube.com/@AbhishekVeer...
Instagram: / abhishekveeramalla_off...
GitHub Repo for this video
github.com/iam-veeramalla/aws...
Book 1:1 with me on TopMate for career guidance
topmate.io/abhishek_veeramalla
Public Telegram Channel For Notes and Updates
t.me/abhishekveeramalla
About me:
========
LinkedIn: / abhishek-veeramalla-77...
GitHub: github.com/iam-veeramalla
Medium: / abhishekveeramalla-av
#devops #futureofdevops #kubernetes #sre #aws #azure
DEVOPS FAQ
DEVOPS
WHAT IS DEVOPS ?
WHY DEVOPS ?
HOW TO LEARN DEVOPS ?
LEARN DEVOPS IN 60 DAYS ?
NON IT TO IT BACKGROUND ?
IS DEVOPS EASY TO LEARN ?
BEST DEVOPS COURSE
FREE DEVOPS COURSE
#AbhishekVeeramalla
BEST DEVOPS VIDEOS
DEVOPS INTERVIEW QUESTIONS
EASY DEVOPS VIDEOS
BEST WAY TO LEARN DEVOPS
PYTHON FOR DEVOPS
PYTHON PROJECTS FOR DEVOPS
LEARN PYTHON
PYTHON PROJECTS FOR AWS
AWS PYTHON PROJECTS
AWS LAMBDA FUNCTIONS
WHAT IS GITOPS ?
WHY GITOPS ?
LEARN GITOPS ?
GITOPS FREE COURSE
What is AWS ?
LEARN AWS FOR FREE
AWS COURSE
AWS COURSE FOR DEVOPS
AWS CLI Deep Dive .
.
Disclaimer: Unauthorized copying, reproduction, or distribution of this video content, in whole or in part, is strictly prohibited. Any attempt to upload, share, or use this content for commercial or non-commercial purposes without explicit permission from the owner will be subject to legal action. All rights reserved.

Пікірлер: 193

@softwareasafun 11 ай бұрын

Thanks!

@AbhishekVeeramalla 11 ай бұрын

Thanks alot for supporting the channel

@Suresh-yp5fb 4 күн бұрын

00:07 Cloud cost optimization 05:46 Stale resources on AWS can lead to higher cloud costs 11:35 Create a Lambda function to delete unused EBS volume snapshots 17:38 A Lambda function is used to delete snapshots that are not associated with any volume. 23:21 Increase default invocation time for Lambda to 10 seconds 28:59 Learn how to manage cloud cost optimization in AWS accounts 34:47 Demonstration of creating and deleting snapshots 40:01 Lambda functions can be scheduled to run automatically using CloudWatch events.

@user-yn7vt7tf4i Күн бұрын

successfully implemented the project and also integrated with sns done Amazing Video🔥

@mohanmurali7975 4 сағат бұрын

Thanks abhishek successfully executed and understood everything crystal clear👍🙂

@singhbrozz1996 5 ай бұрын

thanks for giving wonderfull session for cost optimization.

@uzairbagwan4117 10 ай бұрын

Demo performed and executed as you have done and got the exact .. output..Thanks sir for the wonderful explanation and teaching and demos as well❤

@sl4ught3r94 3 ай бұрын

It is a wonderful project. Thank you very much.

@AmirSylviesh 7 ай бұрын

For some reason I didn’t find the describe volume permission before and when tried to run the lambda test it didn’t give any errors about it - but when I finally found it and added it it worked like magic thank you very much !

@user-yi3ry3cq5q 5 ай бұрын

thank u so much abhishek sir for sharing the knowledge

@amitbadyal7631 5 ай бұрын

Thanks Abhishek for the best explanation on cost optimisation and lambda functions...i have no words to thank you.....and thanks for this good work as you are providing this top notch content for free ....thanks a lot bro❤

@Shrey319 11 ай бұрын

Wonderful person Wonderful attitude Wonderful teaching The world needs more people like you I'm not exaggerating God bless you 🙏

@AbhishekVeeramalla 11 ай бұрын

Thanks alot

@minhajkhan504 10 сағат бұрын

This is super useful! Thank you Abhishek :)

@ashwanigupta9991 17 күн бұрын

best youtube channel for devops. i am developer and enjoy your teaching keep it up bro

@unkownindian11 Ай бұрын

bro your content is really good many paid courses fail to deliver this type of content

@chandangowda6935 9 ай бұрын

Each and every word in the python script understood how it is going to fetch the running instances , after fetching it will check for snapshot. If that snapshot doesn't belong to any running instances or EBS, directly delete it. After deleting, again using try block once again checks the volume of snapshot if it is present or not. Really impressed with the code Abhi Bro

@darshanks5604 2 ай бұрын

Thanks Abhishek Sir. Keep teaching like this but you deserve more subscribers.

@hemantrathod9868 2 ай бұрын

Great!!

@partho-lia 5 ай бұрын

Well explained

@rohitdeore5928 4 ай бұрын

Successfully completed the demo.

@pandumaheswaram7522 11 ай бұрын

Ur explanation and execution is on point, very simple and engaging. Thanks for contributing your knowledge to the Devops community and the fellow Learners.

@AbhishekVeeramalla 11 ай бұрын

Thanks bro

@vamsikrishnanakka838 11 ай бұрын

Thank you for bringing a such cool Projects.❤

@AbhishekVeeramalla 11 ай бұрын

😍

@ismailriyaz9855 11 ай бұрын

Thank You Sir. Requesting you not to delete any course of yours as they are going to be helpful to recall everything watching your videos in future. Huge respect to you Sir.

@AbhishekVeeramalla 11 ай бұрын

😍

@pascaleobiorah5407 29 күн бұрын

Absolutely detailed and crystal clear! Thanks, Abhishek! You're a maestro!!!!!

@AbhishekVeeramalla 29 күн бұрын

My pleasure 😊

@VaibhavSupe 11 ай бұрын

Thank you so much Abhishek for AWS Cost Optimaization demo......I was working on AWS Cost Optimaization from 1-1.5 years but this approach is very efficient / time saver / chances of making mistakes are very less and able to save AWS resources cost drastically. Thanks again🙏 and waiting for another such content🤩🤩🤩

@AbhishekVeeramalla 11 ай бұрын

You are welcome 🤗

@ashwinichivate3905 11 ай бұрын

Excellent explanation in simple way from beginner point of view with detail step by step information. Waiting for such type of real time projects which can be added to resume for fresher & experienced one. Completed hands on from day 1 to day 18. Thanks a lot.

@AbhishekVeeramalla 11 ай бұрын

Amazing

@faisalraj6654 8 ай бұрын

Hi Abhishek, Well-explained in a friendly manner that is easily to grasp the logic, you showed here. Thankyou so much.

@AbhishekVeeramalla 8 ай бұрын

Thanks a lot

@sai-zk3bz 11 ай бұрын

I just came across your shot video on zero to hero aws,wanted to watch all the previous videos and want to practice too Subscribed to your channel,Thanks

@AbhishekVeeramalla 11 ай бұрын

Amazing

@1rv04ee065 7 ай бұрын

Very helpful video . Thank you Abhishek for sharing the knowledge with clear explanations of the concepts along with a neat demo . Well done and keep up such good work !

@AbhishekVeeramalla 7 ай бұрын

My pleasure

@jitendrashimpi9964 11 ай бұрын

Thank you Abhishek sir for such content nice and briefly explain the lambda function and project thank you again

@AbhishekVeeramalla 10 ай бұрын

It's my pleasure

@Vishwask22 5 ай бұрын

Awesome project brother, I did it and gained insights about CloudWatch and Lambda Function!

@AbhishekVeeramalla 5 ай бұрын

Great to hear!

@KRISHNAKUMAR-yj3dx 5 ай бұрын

Awesome explanation for cost optimization Thanks a lot

@AbhishekVeeramalla 5 ай бұрын

Most welcome!

@technicalfaisals 11 ай бұрын

Thank you

@saideekshith1349 11 ай бұрын

Thanks man. such a fantastic help. God bless you.

@AbhishekVeeramalla 11 ай бұрын

Welcome

@NagaSailaja-eq5ke 10 ай бұрын

thanks lot for helping in learning aws lambda function topics

@AbhishekVeeramalla 10 ай бұрын

All the best

@rajenderprasad1193 10 ай бұрын

Thanks anna.. Performed the demo.. everything worked and learned all good stuff. Thank you

@AbhishekVeeramalla 10 ай бұрын

You are welcome

@ashishpandey8766 3 ай бұрын

Thanks, Abhi

@AbhishekVeeramalla 3 ай бұрын

Welcome

@devashreejavalkar8994 6 ай бұрын

So simple language , easy to understand . Thank u so much 😊

@AbhishekVeeramalla 6 ай бұрын

You are welcome 😊

@supriyochatterjee4095 11 ай бұрын

Excellent information, Sir kindly make more videos explaining the concepts and applications of Terraform in AWS in details and how to configure AWS NETWORKING Networking with details steps explained

@AbhishekVeeramalla 11 ай бұрын

Noted

@himms_sharma 5 ай бұрын

Wonderful project 👏

@AbhishekVeeramalla 5 ай бұрын

Thanks

@AshishGupta-oj3qe Ай бұрын

Words are less to express my gratitude 🥰

@AbhishekVeeramalla Ай бұрын

Thank you so much 😀

@anilsree06 8 ай бұрын

Implemented the cost optimization demo Abhishek it was good getting errors and rectifying those and setting up the policies with ec2 and snapshots and creating ec2 from volume creating snapshot with the help of your code I was able to implement removing stale snapshot which is not associated to the volume " This is the final response Deleted EBS snapshot snap-0c443b848464 as its associated volume was not found." Thanks a bunch Abhishek.

@AbhishekVeeramalla 8 ай бұрын

🚀🚀

@mundrukrishnaprasad4430 Ай бұрын

@karthiksundaram544 10 ай бұрын

Superb teaching

@AbhishekVeeramalla 10 ай бұрын

welcome

@prashlovessamosa 11 ай бұрын

Thank you.

@AbhishekVeeramalla 11 ай бұрын

Welcome 🙏

@veerasundar8420 3 ай бұрын

This is the concept which i was asked in the multiple interviews and i just said i haven't worked on it and we look for instance utilizes alone something like that Thanks for the explanations 😮😊

@AbhishekVeeramalla 3 ай бұрын

😍🚀

@veerasundar8420 3 ай бұрын

We can apply the same for s3 as well right

@veerasundar8420 3 ай бұрын

Wow what a quick response 🎉

@sportworld66 6 ай бұрын

thankyu helpfl

@shakeebanwar4403 11 ай бұрын

very well explain

@AbhishekVeeramalla 11 ай бұрын

Thanks

@adityaxyz007 10 ай бұрын

Thank You !

@AbhishekVeeramalla 10 ай бұрын

You're welcome!

@vasanthamurugesanenglish5882 10 ай бұрын

Videos are great! Could you kindly make same zero. To hero series for sre role

@karthikd5292 6 ай бұрын

To good explanation sir

@AbhishekVeeramalla 6 ай бұрын

Thanks and welcome

@tanayabanerjee2380 11 ай бұрын

Thanks for this tutorial 👍....One Request After this aws series If its possible for you then please start a Open-shift tutorial and mainly Python tutorial with practical implementations for devops ...

@AbhishekVeeramalla 11 ай бұрын

I will take a note

@minalyawale2 10 ай бұрын

Hi Abhishek, Thanks for such wonderful videos and series. Your teaching skills are awesome. Can you please make video on AWS CDK also?

@AbhishekVeeramalla 10 ай бұрын

Sure

@premium7720 2 ай бұрын

Gained lot of knowledge by this video thank you sir :)

@AbhishekVeeramalla 2 ай бұрын

Most welcome!

@vikramnoel1239 11 ай бұрын

Hi Abhishek, hope you are doing well. You are closer to the completion of AWS course. I would like to request you to please announce the Azure 30 day course ASAP. Thank you 🙏

@AbhishekVeeramalla 11 ай бұрын

🥳

@Cloudnp9458 2 ай бұрын

Cost optimization People move to cloud because 1. Overhead of infrastructure 2. Cost of infrastructure management Cloud cost is down only if you use it efficiently. Taking snapshot of volume means taking backup of volume. Even after deleting ec2, and volume aws will keep charging for snapshot of volume. The resources you have forgotten and are being charged are called stale resources. Cloud cost will go high. So we as devops engineer have to look for stale resources. Eg, Snapshot that are not attached to ec2 or any volume, send notification or delete the snapshot

@aditya8sharmaDevOps 4 ай бұрын

Thanks for the video! ✨

@AbhishekVeeramalla 4 ай бұрын

You're so welcome!

@aditya8sharmaDevOps 4 ай бұрын

@@AbhishekVeeramalla Also, please make a video on AWS Solutions Architect Certification. And how to prepare for it!

@shrishailpatil8619 11 ай бұрын

Thank you🙏

@AbhishekVeeramalla 11 ай бұрын

Welcome

@curious-codmobile1283 8 ай бұрын

Love you Abhi...my best bro !!!

@AbhishekVeeramalla 8 ай бұрын

😍

@user-bw5di3ei3j 11 ай бұрын

I appreciate all your helpful information. I would like you to please make a video explaining how to set up a production grade eks cluster with the help of other services...it must have high security. We know how to set up eks clusters, but do not know the best practices.

@AbhishekVeeramalla 11 ай бұрын

I made video couple of days back about kubernetes security and same applies for eks as well

@sudhansagar 10 ай бұрын

Thank you for providing such an informative session and creating these helpful videos. Do you plan to cover topics related to determining the overall cost of resources before building anything on AWS?

@AbhishekVeeramalla 10 ай бұрын

Noted

@pawangahlot428 11 ай бұрын

I wait today video ❤

@AbhishekVeeramalla 11 ай бұрын

Thanks 🙏

@kodjoviamedimele3066 11 ай бұрын

@@AbhishekVeeramalla Please sir I have been on the ultimate cicd implementation with argo cd but the pipeline always failed at the stage of building the docker image. it is giving me "docker command not found " although I have docker up and running and also I have created the credentials to let jenkins connect to my dockerhub registry. Please could you guide me?

@Kushbukushbu770 6 ай бұрын

Thank you 😍

@AbhishekVeeramalla 6 ай бұрын

My pleasure 😊

@BharathKumarReddy2103 11 ай бұрын

❤❤❤

@AbhishekVeeramalla 11 ай бұрын

Thanks 🙏

@nadimkaddis7135 9 ай бұрын

thank you

@AbhishekVeeramalla 9 ай бұрын

Thank you so much 😀

@user-bw5di3ei3j 11 ай бұрын

thanks bro.....and please make a vido on how to create multi master eks production cluster with high security

@AbhishekVeeramalla 11 ай бұрын

Please watch videos that I posted a couple of days back of kubernetes security.. it applies for eks as well

@saurabhbisht9280 11 ай бұрын

please make a complete video on prometheus architecture including jobs, exporter ,all metric type and one project on that only .It will be very helpful as i can't see any complete video on that in youtube also

@AbhishekVeeramalla 11 ай бұрын

Noted

@Cloudnp9458 2 ай бұрын

Project is filtering and deleting the stale resources. We will use lambda function to write python code. By using module boto3. Boto3 will talk to aws API and give information about stale ebs snapshots. Since lambda function is event written you can trigger it using cloud watch.

@pavanakula1225 11 ай бұрын

🎉❤

@AbhishekVeeramalla 10 ай бұрын

Thanks

@princejaiswal823 10 ай бұрын

You will soon touch 100K Subscribers. Advanced Congratulations Abhishek Sir

@AbhishekVeeramalla 10 ай бұрын

Thanks 🙏

@manishapatnaik6826 4 ай бұрын

Hi can you please make vdo on AWS console-to-code ( New feature )

@RahulRaj-vt6sk 11 ай бұрын

Sir after completion of AWS, we need Azure masterclass because company is demanding knowledge of Microsoft Azure nowadays.

@AbhishekVeeramalla 11 ай бұрын

I will try

@ajayjohn1502 9 ай бұрын

😊

@saswatpriyabrat 11 ай бұрын

1st Like❤

@AbhishekVeeramalla 11 ай бұрын

Thanks 🙏

@gpapitha7378 7 ай бұрын

Sir can you make BillOps poc and put video

@jayasuriyap8748 11 ай бұрын

Please make an video for AWS KMS

@AbhishekVeeramalla 11 ай бұрын

Yes

@user-fw8mf3yt1p Ай бұрын

Brother best explanation. We stopped at event bridge scheduler, how we will explain this step in Interview. I want to know it looks critical since aws is event driven function. Please continue on aws lambda in some other project.

@AbhishekVeeramalla Ай бұрын

Hey, its very simple, just select the required API action (for example when EBS is created) and Cloud watch will trigger the lambda function you provided whenever the EBS is created. That's it.

@ameyambekar2221 8 ай бұрын

abhishek I get the concept but what I am worried about is the code, like how will i be able to write the code of other kinds of scenarios. What can be the solution here?

@AbhishekVeeramalla 8 ай бұрын

We are doing python playlist

@rahulsingh-iq4gd Ай бұрын

Hi Abhishek quick question why have you created role which has ec2 as principal and given snapshot read write access to it , I thought you keeping lambda as principle and given it snapshot read delete policy to it will work

@SS-rc3bs 4 ай бұрын

what the architecture role in cost optimization ? can you give me some insight of how the architecture involved

@saverhub1458 10 ай бұрын

Bundle of thanks for such content. Can we schedule the script to run only once a month?

@AbhishekVeeramalla 10 ай бұрын

Yes

@ReviewwithSwati Ай бұрын

Abhishek in industry we take snapshots either manually or by some script for backup, how can we incorporate the same in this project where it will delete or note only the snapshots which has been taken manually only..

@yvlokeshreddy6349 8 ай бұрын

Super Content...So useful.....Thanks Dude.. Dude, How much python learn need for Devops????

@AbhishekVeeramalla 8 ай бұрын

Watch day 1 in python playlist .. I explained in detail

@raviparhad9665 9 ай бұрын

But sir when organization has minimum snapshot In this case they can delete it manually. .....

@mmouaz9961 7 ай бұрын

Love From Pakistan

@AbhishekVeeramalla 7 ай бұрын

👍

@PavanKumar-fc9xu 7 ай бұрын

Just one word Awesome!!!! Felt very happy after understanding the concept and able to successfully execute it without looking into the code....Kudos Abhishek

@AbhishekVeeramalla 7 ай бұрын

Kudo to you 🚀

@alexevariste7615 7 ай бұрын

It took me 3 daays to realize that you have to create the policies in the policies tab on the left-side of the iam dashboard in order to attach the policy to the role lol

@AbhishekVeeramalla 7 ай бұрын

Haha

@mohamedzuhair5052 8 ай бұрын

@abhishek Could you please send me the python code am not able to find in above github repo

@gouravchhabra6142 11 ай бұрын

Hi Abhishek, Suppose there are so many resources which we want to remove which is going to take more than 15 min (max execution time for lambda) then will lambda will scale out for more container to finish that job in max time or it will just fail as timeout , pls clarify

@AbhishekVeeramalla 11 ай бұрын

You can split your code and invoke other lambda function from this one But better to keep your execution time short by writing effective code .. if its not an option your split the code and invoke another lambda

@karthikams3480 4 ай бұрын

Does devops engineer need to write coding in python

@pujangampa5297 6 ай бұрын

Once we will add the Cloudwatch schedule. We will be notified or something like that?

@AbhishekVeeramalla 6 ай бұрын

U need to add sns

@pujangampa5297 4 ай бұрын

Anna, please SNS integrate chesi chupinchandi asalki ardham avvateldh nenu chala sarlu try chesa

@kousikdittakavi3264 11 ай бұрын

Hi @abhishek how we perform health check in ec2 instances can you share info here

@AbhishekVeeramalla 11 ай бұрын

Ok sure

@sparker1170 11 ай бұрын

thanks bro. I tried with this hands-on but shapshit isnt getting deleted.wht can be the problem

@AbhishekVeeramalla 11 ай бұрын

Check the cloud watch logs

@pankajsuryavanshi8332 11 ай бұрын

Make video on boto3

@AbhishekVeeramalla 11 ай бұрын

Noted

@user-ye3re6iq5p 11 ай бұрын

after aws which topic are you cover

@AbhishekVeeramalla 10 ай бұрын

Stay tuned for updates.

@Cloud-DevOps_Aspirant 9 ай бұрын

hi abhishek, can i put this COST OPTIMIZATION project in my resume, even if i don't know python as a language.???? 😶😶

@AbhishekVeeramalla 9 ай бұрын

Yes, you can

@manojtalluri5087 11 ай бұрын

Hii Abhishek where to start aws zero to hero or DevOps zero to hero

@AbhishekVeeramalla 11 ай бұрын

Devops

@DevOps_by_Rajashekar 11 ай бұрын

Bro any fresher recruitment for AWS devops PLEASE SHARE

@AbhishekVeeramalla 11 ай бұрын

Sure

@dhanushgowda7593 10 ай бұрын

Sir followed as you did, but The Snapshot was not deleted, when i run the test there is no error, it just shows staty id, request id. No message of snap shot deleted. What might be the issue.

@dilligpay4 10 ай бұрын

did you check the volume from which you take snapshot is attached to any instance?

@dhanushgowda7593 10 ай бұрын

@@dilligpay4 yes

@Tech-xj8kx 7 ай бұрын

@dhanushgowda7593 You probably have missed adding DescribeVolumes or DeleteSnapshots permission to the role and you cannot see the error due to the usage of try/except in the script. You can see the exact error by removing those two lines (29 and 34) and then executing the function.