DevOps Project - Automate deploying to AWS using Terraform with GitLab CICD pipeline

Terraform Pipeline | Gitlab ci cd pipeline AWS | Terraform Project | AWS Terraform
In this Devops project you will learn how to set up a Terraform ci cd pipeline using gitlab to automatically deploy infrastructure on AWS cloud.
Throughout this terraform project you will learn all devops best practices used in the industry to learn and Practice Hands on.
Find the code in GitLab Repository: gitlab.com/N4si/cicdtf
#devops #aws #terraform
Connect with me on LinkedIn: / nasiullha-chaudhari
Helpful resources -
Terraform tutorial : • Master Terraform in 60...
CICD explained : • What is CICD Pipeline?...
Gitlab CICD tutorial : • Learn Complete GitLab ...
Terraform Official documentation: developer.hashicorp.com/terra...
Timestamps
🕒 Intro 0:00
📝 What is this project 0:04
🔧 Prerequisites for this DevOps project 0:32
🛠️ Part 1 of the project (Terraform Code) 03:44
📂 S3 state backend setup 23:55
🔧 Part 2 (Gitlab cicd pipeline) 26:02
🔗 Create Gitlab repository 26:35
📥 Push the Terraform code to Gitlab 27:37
🔄 Gitlab CICD pipeline script 29:53
🔢 Define variable 38:56
🏃 Pipeline running 45:00
🎬 Conclusion 49:50
Also checkout other DevOps projects:
Devsecops project: • DevSecOps Pipeline Pro...
Microservices project: • DevOps Project: Video ...
Simple Terraform Project: • Simple DevOps Project ...
Kubernetes Project: • Kubernetes Live Projec...
This terraform pipeline project will teach you how to properly create infrastructure on cloud like aws or azure using cicd tools like gitlab, jenkins or github.
Setting up cicd pipeline for Terraform is very common best practice followed in devops industry to provision infrastructure.
Feel free to comment your doubts if you have any :)
Support my work : www.buymeacoffee.com/cloudchamp

[@soumyadipchatterjee2267]

Mind-blowing & Hat's off to you to showcase this project step by step especially how Gitlab & Terraform hand to hand works in Production 😀❤. I have successfully created the same .

[@cloudchamp]

Let's see who can complete this first..... 👀 Please Like & share :)

[@ankitkumargupta9753]

Crisp, Clear, Amazing, Mind-Blowing What a tutorial, Loved It ❤

[@cloudchamp]

Glad you liked it

[@cloudchamp]

Make sure to share & subscribe 👍🏻

[@oc4618]

I love your tutorials. Simpe, clear and straight foward. One of the best tutorial for devops on the net. Please keep them coming

[@cloudchamp]

Thanks! Means a lot!!

[@Djsanddy]

Amazing tutorial brother. Keep up the good work.

[@cloudchamp]

Appreciate it!

[@inthecloud1043]

You explain it so perfectly bro 👍

[@cloudchamp]

Thank you 🙌

[@user-pg9yy1un1s]

only one Thala @ Abhishek Vermalla

[@kykel4948]

Fantastic tutorial! Thank you! This really helped. Yours was the most comprehensive explanation I've seen so far and just you breaking down the code of the gitlab-ci file line by line in your review was incredibly helpful. So many tutorials I've watched skim over the important details and skip steps or just fail to elaborate on what their code is doing, which contributes to the confusion. My only confusion and question is about your destroy job. How did your destroy job run without a state declared? When I tried to run mine, it would "succeed" but only as a false positive. The destroy job wasn't finding the terraform state from the previous jobs and thinking there were 0 things to destroy. I had to troubleshoot and eventually added the state as an artifact in the apply job which resolved my issues. Liked, Subscribed and even bookmarked this particular tutorial!

[@smartengineer4484]

This is very much needed project brother 👍

[@cloudchamp]

Definitely

[@rajvirkaur4411]

great tutorial. everything is explained in so detail. thank you so much

[@cloudchamp]

You're very welcome!

[@mhenterprises1873]

Thanks for this devops project 👍

[@cloudchamp]

My pleasure

[@PortgueseProBF3]

This is amazing and exactly what I needed except I'm trying to use gitlab it self as backend!

[@cloudchamp]

Glad it was helpful!

[@RZOLTANM]

Good explanation....really concise and articulate....gets to the point and also explains prerequisite videos and concepts to understand... enjoyed it! Will watch all from the all others... just subscribed!

[@cloudchamp]

Thanks man! Happy to help 😀

[@yogendrahj9365]

Crisp & Clear. Thanks mate. And please dont take me wrong your talking speed has really reduced to good level compared to initial videos and this helps learners like us to understand thoroughly. Being in the industry for 6+ years have hardly found good live projects. Please keep them coming! Thank you! All the best!

[@cloudchamp]

Thanks for this helpful feedback 😀

[@bouksy]

very interesting video . Gives very good key concepts in a very clear way. I'll put these in practise pretty soon, Thanks!

[@cloudchamp]

Let me know how it goes 👍🏻

[@vijayamarnath1860]

Great one! Keep up the good work bro.

[@cloudchamp]

Thanks, will do!

[@gamingchamp3070]

Thank you for everything you do

[@cloudchamp]

You are so welcome

[@rahulsawant485]

Great tutorial, thanks

[@cloudchamp]

You're welcome!

[@kauapozzi8629]

Just took my SAA-003 certification. Watching your videos to conquer my first IT job and portfolio

[@cloudchamp]

Best of luck to you brother

[@kauapozzi8629]

@@cloudchamp tks bro!

[@dharshansrsr976]

19:30 waiting for the second part to create keys as per the flow 😊

[@vamshikittu8635]

Awesome 👌 content bhai and funny thing is when the destroy was running the bgm was perfect sync 😂 And yes today itself I'll do this project and definitely tag you nasi bhai ❤

[@cloudchamp]

Thanks 😅

[@AkshaiReddy183]

Great job bhai 🎉

[@cloudchamp]

Thanks

[@user-pg9yy1un1s]

Appreciate it, nice work.

[@cloudchamp]

Much appreciated!

[@ragavraghu8700]

thank you!

[@cloudchamp]

You are welcome 🤗

[@gamingchamp2834]

I will try this project today bro

[@cloudchamp]

👍🏻 yes!

[@mariocortes2670]

Great explanation!

[@cloudchamp]

Thanks 😊

[@chipTuanDuc]

Thanks❤❤❤❤❤

[@cloudchamp]

You are welcome 🤗 Lmk if you need help or you complete the project 👍🏻

[@techyreport7992]

Thank you 🙏

[@cloudchamp]

You’re welcome 😊

[@harshshah4477]

It is a good project to automate the IAC though how can we configure the automation of the BE & FE codebase as well? So that whenever I commit any changes in my code base automation directly updates the code in EC2.

[@tech_channel110]

Sir give me fyp idea using devops and cloud Eg . Cloud infrastructure

[@OnCloudNine-wv9kv]

While creating the pipeline. 31.53 timestamps. how did you get the image name and the path? i tried looking that in your previous video but coudnt find it. i'd appreciate if you help me here.

[@oc4618]

can you explain the 'entry point' value on the gitlab yml. I got a bit lost and wasn't sure how you got that value

[@user-ux2hc4zw7x]

Bro which tool you used for project documentation in ubuntu 22.04?.

[@ragavand4678]

Thank you very much brother.it really helps me to understand how terraform works...

[@cloudchamp]

You are most welcome

[@Djsanddy]

can you please do a similar one for github CICD. Thanks a ton

[@zikou6405]

apply: stage: apply script: - terraform apply -input=false "planfile" dependencies: - plan the dependencies is not needed since apply and plan are in different stage so if plan stage failed the following stages will fail too if we put the plan and apply in the same stage then we need to add the dependecies line

[@sjokkz]

how can i reuse the same pipeline to deploy multiple environments with the same resources?

[@user-ux2hc4zw7x]

Bro which tool used for documenting in ubuntu!!?.

[@jac9886]

Excellent video Nasi, it helped me a lot! I just have one question left, in your repository there's a variable TF_VAR_gitlab_token: ${GITLAB_ACCESS_TOKEN} which I was particularly interested in seeing its configuration, but you didn't mention it in the video. Is there another video about it or could you explain it to me here? Thank you very much!

[@OnCloudNine-wv9kv]

Did you create s3 and dynamoDB manually or via terraform code?

[@cloudchamp]

Manually in this video but also have another terraform backend video where it’s done in terraform 👍🏻

[@sparshkhandelwal816]

15:09

[@yogendrahj9365]

Hi Nasi, i am almost there. But getting state lock error in the destroy stage. Not very sure how i can pass -lock=false for this stage manually. This work fine manually i can run this. Now im running the full pipeline and it started failing in the plan job itself saying state lock. Any leads please?

[@cloudchamp]

You can manually release the lock using terraform force-unlock command with the lock Id. -lock=false is not recommended in production environments where you have multiple people working together Let me know if still facing issue.

[@yogendrahj9365]

@@cloudchamp yes force-unlock is my first choice but silly thing is i am unable to find the lockid either in the error or state file. Below is the error i get if i run plan and cant see lock id. "Error: Error acquiring the state lock │ │ Error message: 2 errors occurred: │ * ResourceNotFoundException: Requested resource not found │ * ResourceNotFoundException: Requested resource not found │ │ │ │ Terraform acquires a state lock to protect the state from being written │ by multiple users at the same time. Please resolve the issue above and try │ again. For most commands, you can disable locking with the "-lock=false" │ flag, but this is not recommended."

[@yogendrahj9365]

something silly im missing.

[@guibhai8578]

nasi can you share some resource to learn golang

[@khaledziraoui5246]

Do u have any videos ro learn terraform please for a beginner ,appreciate it

[@cloudchamp]

Absolutely I do, check out the playlist or a 60 mins video

[@khaledziraoui5246]

@cloudchamp Thank you very much ,i will start watching them videos , ,is it possible to learn that in one month for a beginner

[@faizanmomin4417]

Hey, Brother! I am also DevOps engineer, Could you please tell me which terminal are you using, It's Looking Good Though!

[@cloudchamp]

I am using inbuilt terminal . I have Ubuntu 22 in my local

[@peace___maker]

Can I do this project in windows 11

[@cloudchamp]

Yes

[@heisenberg7049]

Hey bro ur discord link expired can u update it

[@CHARAN_REDDY18]

bruh were did you learn devops course

[@suresh.beats___]

bro why dont u explain in super putty

[@cloudchamp]

It’s the same when you do it in Linux machine mine is Ubuntu 20

[@gopalkrishnav2946]

You are too fast bro

[@cloudchamp]

Please adjust the playback speed on KZbin setting

[@gopalkrishnav2946]

Ok bro.