Real-time End-to-end DevOps project: Deploying an EKS Cluster with Terraform and Jenkins

Рет қаралды 25,294

Күн бұрын

► ▬▬▬▬▬▬ About🧾 ▬▬▬▬▬▬
In this comprehensive tutorial, we'll walk you through the process of deploying an Amazon Elastic Kubernetes Service (EKS) cluster using Terraform and Jenkins. Learn how to set up a robust DevOps pipeline and troubleshoot common issues along the way. Whether you're a beginner or an experienced DevOps engineer, this video will provide valuable insights and hands-on guidance to streamline your EKS deployments. Join us on this journey to enhance your DevOps skills and achieve efficient EKS cluster deployments
► ▬▬▬▬▬▬ Timestamps⌚ ▬▬▬▬▬▬
00:00:00 Introduction
00:00:47 Components and pipeline explanation
0:15:03 Writing a Terraform Code for Jenkins Server
0:55:33 Writing a Terraform Code for an EKS Cluster
1:14:12 Deploying the EKS Cluster using Jenkins Pipeline
► ▬▬▬▬▬▬ GitHub Link of Project 🚀 ▬▬▬▬▬▬
github.com/gauri17-pro/terraf...
► ▬▬▬▬▬▬ Subscribe 🚀 ▬▬▬▬▬▬
/ @codewithgauri
► ▬▬▬▬▬▬ Connect with me 👋 ▬▬▬▬▬▬
LinkedIn: / gauri-shirkande-9610801a9
Instagram: / code_with_gauri
► ▬▬▬▬▬▬ Disclaimer 💁‍♀️ ▬▬▬▬▬▬
This video is solely made for educational purposes
► ▬▬▬▬▬▬ Email 📩 ▬▬▬▬▬▬
gaurishirkande11111@gmail.com

Пікірлер: 188

@light-sg5sl 7 ай бұрын

Mam it takes big heart to share such project for free Truly amazing People are charging crazy for such stuff Thank you for such content! Lots of love❤

@codewithgauri 7 ай бұрын

Will keep sharing!😌🙌🏻

@user-bu3em6zg4r 3 ай бұрын

Yes. I agree with light. Thanks Madam 🙏

@sohampawaskar9335 2 ай бұрын

Great video!! Really appreciate it 💪🏼💪🏼

@giteshghure212 3 ай бұрын

Awesome Project Thank you So Much

@venkateshd1208 8 ай бұрын

Thanks for your effort. It's helpful Gauri

@yogesh.bhosale_patil 8 ай бұрын

Great Content, thank you !!😃

@bepositive108 Ай бұрын

Thanks Gauri, a huge effort has been made for us. Subscribed.

@shivmodi2319 6 ай бұрын

Amazing project! Your EKS Cluster deployment using Terraform and Jenkins is incredibly insightful. Thank you for sharing this invaluable knowledge!

@codewithgauri 6 ай бұрын

Glad it was helpful!

@sasikumar-lb2xu 4 ай бұрын

Thanks for this Video, I have some understanding of the concepts now.

@codewithgauri 4 ай бұрын

Great!

@user-lt6ke1fi6r 8 ай бұрын

Thanks for uploading these valuable contents

@codewithgauri 8 ай бұрын

It's my pleasure

@practicaldeen5333 3 ай бұрын

Miss, I really appreciate all your efforts. New Sub!

@codewithgauri 3 ай бұрын

I appreciate that!

@vetriselvaraj 6 ай бұрын

Excellent one !!!

@codewithgauri 6 ай бұрын

Thank you! Cheers!

@Learner-hg4hj 8 ай бұрын

Madam ! Appreciate all your strenuous efforts !! GOD Bless you !!

@codewithgauri 8 ай бұрын

Thank you...means a lot! 🙏🏻

@asif4world 7 ай бұрын

Thanks a lot for sharing, it's a great video with good explanation.

@codewithgauri 6 ай бұрын

Glad it was helpful!

@deadlykitanu Ай бұрын

Great video. Thank you

@goussayyad7505 6 ай бұрын

Really appreciate your efforts towards cloud computing. Keep inspiring 😊😊

@codewithgauri 6 ай бұрын

Thankss🙏🏻

@shrikantdeshpande6842 8 ай бұрын

Gouri. Best demonstration....keep it up

@codewithgauri 8 ай бұрын

Thankss!

@kaustubhpatil1260 8 ай бұрын

Very Nice Explanation of the whole process thanks for sharing such a good content .

@codewithgauri 6 ай бұрын

My pleasure

@HALASWAMYMH Ай бұрын

Thank you very much mam, it's a great video with good explanation.

@user-qo6dc4bk3x 5 ай бұрын

Thanks Gauri for sharing the valuable content. subscribed to your channel.

@codewithgauri 5 ай бұрын

Welcome!

@aarvi3500 2 ай бұрын

Thank You for Providing this valuable content. this is really helpfull.

@codewithgauri 2 ай бұрын

Glad it was helpful!

@user-lt6vq2ck9k 2 ай бұрын

Awesome Gaurav thank you giving this project

@codewithgauri 2 ай бұрын

It's okay but my name is Gauri 😅

@ervispojana118 5 ай бұрын

Thank you very much for this project.. I would appreciate more details during the video :) . Keep going like that!!

@codewithgauri 5 ай бұрын

Sure definitely will try to explain in a more detailed way!

@kumudchandra7635 7 ай бұрын

Awesome project

@codewithgauri 7 ай бұрын

Thank you

@user-bg6ro7lp8h 5 ай бұрын

Its a very rare demo video on terraform-eks-Jenkins-pipeline. Very well explained in details. thanks for making this video Gauri

@codewithgauri 5 ай бұрын

Thanks 🙏🏻

@rehantayyab82 8 ай бұрын

I was waiting for this content , already wrote my terraform code for eks , will deploy that through Jenkins Great Gauri , thanks

@003shamshuddin 7 ай бұрын

i have gone through multiple tutorials for eks setup with terraform and only you have executed code from the scratch for the most people it was already written and they just give us a walk through thank you gauri :)

@codewithgauri 7 ай бұрын

Glad to hear!😄

@OnCloudNine-wv9kv 8 ай бұрын

Watching this video was like finding the DevOps genie in a bottle! 🧞‍♂ The EKS cluster just popped out effortlessly. Thanks for the tutorial!!

@codewithgauri 8 ай бұрын

Haha nice...glad that it was useful!☺️

@SurajM-qs3wx 5 ай бұрын

Thats Awesome !! Gauri ,Khup Chan

@codewithgauri 5 ай бұрын

Thanks!🙏🏻

@travelwithdiva 10 күн бұрын

Such a great informative video, excellent

@codewithgauri 9 күн бұрын

Glad you found it useful

@RaziqueAnsari2009 8 ай бұрын

Good one...

@codewithgauri 8 ай бұрын

Thanks!

@daysbeforejudgementday3493 Ай бұрын

Thanks

@codingman8056 5 ай бұрын

Really appreciating your work, keep going, subscribing channel

@codewithgauri 5 ай бұрын

Thanks!🙏🏻

@shadhashmi3714 7 ай бұрын

Nice content 🎉 keep doing this heart for u 💔

@midhilajka4222 4 ай бұрын

best video👌👌

@codewithgauri 4 ай бұрын

Thank you so much 😀

@Alice-hh5zj 2 ай бұрын

thank you so much Gauri for sharing this project walkthrough! I found it very helpful. It would be even greater if you could include the application source code part in the current pipeline, like auto-trigger a new image build upon commits, and then use that image in the application deployment stage.

@codewithgauri Ай бұрын

Good insight. We would be coming to application deployment as well...Since working with Terraform I considered creating video on the same for now. Thanks!

@sitanshumishra7854 4 ай бұрын

Please make videos regularly on terraform and aws

@codingwallah6978 3 ай бұрын

hey tm ye project kr liye kya

@nntun03 6 ай бұрын

wow! this is so fantastic Gauri...I was looking for individual projects and trying so hard to stitch them together and you came along! thank you so much...so many new techniques too...especially tags..and using TF modules..

@codewithgauri 6 ай бұрын

My pleasure 😊

@karthiknangunuri8643 8 ай бұрын

Very nice content. Can you do few videos on real-time troubleshooting scenarios in Devops that will be a great help.

@codewithgauri 8 ай бұрын

Suree

@iamkonick 4 ай бұрын

This is so awesome, Excellent explanation. I was thinking how can I deploy one real world application with database in two different eks cluster, one for production and one for staging/development from another repositories two branches with main and release, using dockerized images of the app which is pushed to ECR.

@ajitdalvi596 2 ай бұрын

Best on terraform

@codewithgauri 2 ай бұрын

Thanks!

@shahzadhussain78692 4 ай бұрын

This is really very very intresting, can you please make a video on ECS USING JENKINS TERRAFORM AND CI/CD

@codewithgauri 4 ай бұрын

Sure

@hydro6527 4 ай бұрын

Hello Gouri,thanks a lot for the terraform videos.could you please do more videos on ansible and yaml with projects like terraform

@codewithgauri 4 ай бұрын

Yes, sure

@Raju-yz1gt 3 ай бұрын

Hi Mam Please continue doing projects related to devops, we are eagerly waiting for new things.

@codewithgauri 3 ай бұрын

Sure working on it 👍🏻

@Ravikumar-xb7io 3 ай бұрын

Thank you mam

@anilkommalapati6248 5 ай бұрын

Much obliged. What a beautiful and valuable DevOps project you have made. I am so grateful for your making such a worthy video. I learned a lot in this two-hour session. Now I am more confident. Just a small query please: Q.) Correct me if I am wrong, While creating the EKS cluster I believe we need to attach a EKS Cluster Role(EKS/EC2 role with some permissions/policy) seems this step not there but still worked. Could you please clear my doubt? Once again thank you for your time and god bless you by hiking your salary 🙂

@codewithgauri 5 ай бұрын

Thanks a lot....Speaking about your doubt, this role was created by the terraform module of an EKS so we don't need to explicitly create it.

@ibmuser13 4 ай бұрын

Thanks very much Gauri! Very helpful tutorial. Thank you for your selfless service, May God bless you! I had one question - I see you used terraform public modules .. Can we always use public modules or should we write custom modules as well? I mean, can most of our use cases be accomplished using public modules? Please shed some light on this. Thanks again!

@codewithgauri 4 ай бұрын

Glad you found the video useful. The thing is that it depends on the customer requirement. If the public modules can satisfy the needs then there's no harm in using them. But if you want more customisations in the module, then you can create your own.

@ibmuser13 3 ай бұрын

@@codewithgauri Understood! Thank you!

@abuzarkhan2327 8 ай бұрын

Mam This was awesome. Can you please make tutorials on docker jenkins? if you can please do that it will be very helpful. thank You

@codewithgauri 8 ай бұрын

You're welcome....sure we'll definitely make one video on it

@abuzarkhan2327 8 ай бұрын

@@codewithgauri i am eagerly waiting

@biswajitsutar6318 2 ай бұрын

Hi @gauri, Thank you so much for the detailed video. I have gone through so many videos, and courses before but no one explained this much in detail. I have one doubt though, can you please help me understand the private_subnet tag you have added for what reason.

@rehantayyab82 8 ай бұрын

one thing more i would like to request is that it will be more beneficial if u add timestamp in coming videos ..... thanks

@codewithgauri 8 ай бұрын

Noted

@TikTokTrendsCompilation 8 ай бұрын

Agreed. Please add this in this video and all the future videos

@user-up8uk5oz9o 7 ай бұрын

Hi , I do terraform init but have issue with the s3 bucket!!! Should I name my s3 same with yours? Appreciate your response

@codewithgauri 6 ай бұрын

Can you please share your error?

@user-bu3em6zg4r 3 ай бұрын

Thanks for this video 🙏Madam. Actually, I was looking for ECS & EKS. I find more on ECS in youtube Wanted to know the difference of ECS & EKS... suppose if I write separate K8s deployments.yaml & services.yaml can I place them in EKS?..if so, how? Suggestions: @34:48 egress_with_cidr_blocks 👉 will be more helpful if explained why 0 for from & to ports -1 to protocols etc @1:00:30 why the subnet range was changed to 192.168 (private subnet? and public subnet has to start with 10.***) @1:36:00 Thanks 🙏 for the choice (I was not aware of this, always till these days (2yrs) I will be using copy the pipeline) @1:47:00 You were providing the aws eks update-kubeconfig --name my-eks-cluster 👉 what is the purpose of this?

@travelwithdiva 10 күн бұрын

Nice one. Do we have to run this pipeline again and again if we want to make some changes like a diff version of the pod image or so, or create a separate pipeline that will deploy only the changes in the same eks cluster or the eks cluster will recreate using your pipeline and redeploy everything. What will be downtown in that case?

@codewithgauri 9 күн бұрын

I think you don't need to create another pipeline everytime. If you have checked the poll SCM for the Jenkins pipeline then it will automatically trigger the pipeline for a different version.

@travelwithdiva 5 күн бұрын

@@codewithgauri Thank you 🙂

@gurijala1 Ай бұрын

Awesome content but I have a question(may be dumb 😊). At the end of the video, you were saying when using destroy it would be destroying all the infrastructure. The Jenkins instance on AWS will remain stay. Please confirm.

@codewithgauri Ай бұрын

Yes, it should be destroying only the EKS cluster

@akashkumarpradhan5281 Ай бұрын

Hi @codewithgauri , You have used two vpc cidr ranges. Jenkins is one vpc and eks is in another. How the jenkins is able to access eks vpc without any peering?

@codewithgauri Ай бұрын

Jenkins is not always located in the same VPC as that of EKS. You must have noticed that the Jenkins might be local and still we can deploy changes to the AWS using AWS Credentials. We are not connecting them here.

@sajiyasalat 7 ай бұрын

20:50 Can I know from where did you get this ami-id.

@codewithgauri 6 ай бұрын

From the AWS console

@shrikantdesai6973 3 ай бұрын

please do Devsecops project

@codewithgauri Ай бұрын

Sure

@anujgupta4034 4 ай бұрын

@Gauri - Getting this error when we deploy the service kubectl apply -f deployment.yaml error: You must be logged in to the server (the server has asked for the client to provide credentials)

@codewithgauri 4 ай бұрын

Your user must have the EKS policy attached

@rehantayyab82 8 ай бұрын

what is SCM poll u told in video ?

@codewithgauri 8 ай бұрын

Sorry I forgot to mention, the SCM Poll is basically used to check the updates in the git repo...if there are any changes then it triggers the Jenkins pipeline. And in this case we used * * * * * which means we are going to check it after every minute

@light-sg5sl 6 ай бұрын

Hello mam, I am trying to install argocd on eks using helm chart through terraform only and trying to automate using Jenkins Can you please guide little bit on it or can you please upload video for the same Or steps after cluster creation. Thank you.

@codewithgauri 6 ай бұрын

Sure in few days we will

@shrikantdesai6973 3 ай бұрын

Please make video on how to monitor whole project with help of Cloudwatch

@codewithgauri 3 ай бұрын

Sure can we please connect on LinkedIn?

@shrikantdesai6973 3 ай бұрын

@@codewithgauri ya sure

@003shamshuddin 7 ай бұрын

can you please share some resources which helped you for terraform associate cert?

@codewithgauri 7 ай бұрын

Sure will make a video on it

@ashutoshsahu9521 7 ай бұрын

Hi I am getting an error while running Terraform validate. "Terraform provider plugin crashed" the tf cmd is running fine in local

@sayantansamanta7746 7 ай бұрын

Hi, was having the same issue But most probably the problem is Memory issue. Use t2.small or any other instance type instead of t2.micro for the jenkins-server It solved my issue Hope this helps.😊

@ashutoshsahu9521 7 ай бұрын

Thanks @@sayantansamanta7746 the issue got resolved. my pipelines are getting successful but the nginix deployment step is getting finished in 6sec and the load balancer is not getting created any idea on this

@user-ox7tl6ie2z 2 ай бұрын

hi madam ,when i will trigger the jenkins job as you exaplained I am getting error like this "+ kubectl apply -f deployment.yml error: You must be logged in to the server (the server has asked for the client to provide credentials)" can you help me this

@bizzie14 4 ай бұрын

Thanks for this great tutorial. I keep getting this error: + kubectl apply -f deployment.yaml error: You must be logged in to the server (the server has asked for the client to provide credentials). I do not know what could be the problem. Any pointers? I am logged in as root on aws and I also noticed an IAM role was created automatically.

@codewithgauri 4 ай бұрын

Have you updated your kubeconfig?

@bizzie14 4 ай бұрын

Thanks for the reply. I was able to resolve it by attaching EKS policies to the root user.

@kbadarla 4 ай бұрын

Hi @codewithgauri, I've followed exact steps including updating kubeconfig, but I keep getting error "You must be logged in to the server (the server has asked for the client to provide credentials)" while running deployment. Added EKS Cluster policy role as well. But nothing worked. Please share your thoughts.

@deva6368 3 ай бұрын

Not able to create the EKS ,Its saying its creating but not creating and getting the message like creating , do we have anything to change instance type or EKS version?

@codewithgauri Ай бұрын

I need details

@user-hz2hz6ov9o 4 ай бұрын

hi , at the last step I am getting error I am not able to deploy the application getting below error + kubectl apply -f deployment.yaml error: You must be logged in to the server (the server has asked for the client to provide credentials)

@codewithgauri 4 ай бұрын

this error can occur when you created the cluster with the Root and try to access it with a IAM user

@dhirajprasad1685 3 ай бұрын

font size is too small, by the way superv content 💥

@codewithgauri 3 ай бұрын

Will consider working on it...Thanks for the feedback!

@pandiansundaramoorthy4358 16 күн бұрын

Thanks Gauri. For you huge effort. I am getting error as Error: ceating IAM Role(node-eks-node-group-some numbers): Operation error IAM: CreateRole, https response error StatusCode: 403 (501: resource "aws_iam_role" "this" {, when I try to do terraform apply command to EKS folder. So please tell how to resolve this error. Thanks

@codewithgauri 15 күн бұрын

You need to check the policy attached to your node. It should allow to create role. Please refer the link below: stackoverflow.com/questions/70953798/iamcreaterole-access-denied-for-assumed-role

@light-sg5sl 7 ай бұрын

Mam do we use existing module in real time Or only custom module?

@codewithgauri 7 ай бұрын

Hello...Actually speaking we can use both the modules depending on the client's requirement

@light-sg5sl 7 ай бұрын

@@codewithgauri oky thanq

@mohdkamran1397 7 ай бұрын

when I am using your github link, It is showing only terraform-jenkins-eks not others

@codewithgauri 7 ай бұрын

Yes because I have only provided the link for "terraform-jenkins-eks" repository

@benjakuneepong Ай бұрын

i have error when i create pipeline configuring Terraform AWS Provider: failed to get shared config profile

@codewithgauri Ай бұрын

Can you please share your error

@kundankumar-qd8jr 22 күн бұрын

how to create ami name filter can you please give me a brief idea.

@codewithgauri 14 күн бұрын

Can you please give the details. What exactly do you want?

@prezlamen 2 ай бұрын

Font size is to small I can`t see,change DPI zoom level and increase font size

@codewithgauri Ай бұрын

Sure, we will make sure that we zoom it in future. Thanks for the feedback.

@padmakumbha5344 8 ай бұрын

What policies do you add in IAM section, pl reply me

@codewithgauri 8 ай бұрын

You can add AmazonEKSClusterPolicy

@padmakumbha5344 8 ай бұрын

@@codewithgaurithank you

@light-sg5sl 7 ай бұрын

Mam can you please clarify how we taking input and output juz little bit idea? It's confusing

@codewithgauri 7 ай бұрын

You mean for the modules?

@light-sg5sl 7 ай бұрын

Yes for modules

@codewithgauri 7 ай бұрын

See input is something you need to pass to the module and output is something that is returned by the module

@light-sg5sl 7 ай бұрын

@@codewithgauri thank you mam.

@My_RocK_WorlD Ай бұрын

Hi mam I'm getting an error when I execute the terraform plan and I'm also I cloned your repository and am still getting an error 30:00 recording time

@My_RocK_WorlD Ай бұрын

I'm very interested in practicing but getting an error 😔 could help me last project also getting error I never go forward.....

@codewithgauri Ай бұрын

Can you please share your error?

@My_RocK_WorlD Ай бұрын

@@codewithgauri thanks for responding see the error i ran all the steps as it $ terraform plan var.public_subnets subnets CIDR Enter a value: 10.0.1.0/24 var.vpc_cidr vpc Cidr Enter a value: 10.0.0.0/16 ╷ │ Error: Invalid number literal │ │ on line 1: │ (source code not available) │ │ Failed to recognize the value of this number literal. ╵ ╷ │ Error: No value for required variable │ │ on variable.tf line 7: │ 7: variable "public_subnets" { │ │ The root module input variable "public_subnets" is not set, and has no │ default value. Use a -var or -var-file command line argument to provide a │ value for this variable.

@padmakumbha5344 8 ай бұрын

Hi, for me it create 11 resources instead of 55 resources as you shown in the video please suggest how to verify

@codewithgauri 8 ай бұрын

Which code are you referring?

@padmakumbha5344 8 ай бұрын

Thank you for reply

@padmakumbha5344 8 ай бұрын

I have copied and referenced the same code you put in github

@padmakumbha5344 8 ай бұрын

In jenkins pipeline, terraform plan it shows 55 resources

@padmakumbha5344 8 ай бұрын

But build Terraform apply it created 11 resources

@EasyMysteryExplained 2 ай бұрын

hy gauri 5 month you not upload single content

@codewithgauri Ай бұрын

Apologies. Video coming soon!

@tanayabanerjee2380 3 ай бұрын

Hi Gauri, Can you please update the github link ??its not working

@codewithgauri 3 ай бұрын

Can you check it now please?

@tanayabanerjee2380 3 ай бұрын

@@codewithgauri no it's still page not found showing....

@ChakrapaniChippakurthi 3 ай бұрын

hi ...ur git hub link is not working ...can u please check it

@codewithgauri 3 ай бұрын

Can you please check it now?

@ChakrapaniChippakurthi 3 ай бұрын

yeah its working now ..thank u gauri ji @@codewithgauri

@ChakrapaniChippakurthi 3 ай бұрын

and also can u PLEASE GUIDE how to deploy Google micro services demo through jenkins and deploying on eks...

@rehantayyab82 8 ай бұрын

plz can u share jenkins pipeline script ?

@codewithgauri 8 ай бұрын

Sure

@codewithgauri 8 ай бұрын

github.com/gauri17-pro/terraform-jenkins-eks/blob/main/Jenkinsfile

@theinteger 8 ай бұрын

add "Project" in your video title

@codewithgauri 8 ай бұрын

Sure

@shrikantdesai6973 3 ай бұрын

your git hub account showing error 404

@codewithgauri 3 ай бұрын

Problem solved you can check now 🙏

@shrikantdesai6973 3 ай бұрын

@@codewithgauri thanks

@adesojialu1051 5 ай бұрын

thanks namatse, so i will i deploy an angular frontend and java backend using this approach? do i need to add nginx, docker? @codewithgauri

@codewithgauri 5 ай бұрын

First of all...you can't use the same approach to deploy an application. For that you won't be making use of Terraform. In case if you want to deploy an application on docker, then you would have to create the image for your application.

@srivijayalakshmi7962 3 ай бұрын

Error: fetching Availability Zones: AuthFailure: AWS was not able to validate the provided access credentials │ status code: 401, request id: 28f92071-4f6c-4f3b-8975-3ea12da91db5 │ │ with data.aws_availability_zones.azs, │ on data.tf line 1, in data "aws_availability_zones" "azs": │ 1: data "aws_availability_zones" "azs" {} mam i am face this error

@codewithgauri 3 ай бұрын

Please check if you're using the right keys!

@suneel.indatgmailcom 8 ай бұрын

fantastic work and I look forward to more content from you in the future! 😊👍

@codewithgauri 8 ай бұрын

Thanks!

@user-us9es8wy8p 3 ай бұрын

│ Error: Your query returned no results. Please change your search criteria and try again. │ │ with data.aws_ami.ubuntu, │ on data.tf line 1, in data "aws_ami" "ubuntu": │ 1: data "aws_ami" "ubuntu" { │ Iam getting this error, i have tried many ways, getting same pls help on this...

@codewithgauri 3 ай бұрын

Please share the entire data block