The Ultimate CICD Corporate DevOps Pipeline Project | Real-Time DevOps Project

The Ultimate CICD Corporate DevOps Pipeline Project | Real-Time DevOps Project
𝗘𝗻𝗿𝗼𝗹 𝗧𝗼 𝗕𝗮𝘁𝗰𝗵-𝟱 | 𝗭𝗲𝗿𝗼 𝗧𝗼 𝗛𝗲𝗿𝗼 𝗗𝗲𝘃𝗦𝗲𝗰𝗢𝗽𝘀 & 𝗖𝗹𝗼𝘂𝗱 𝗗𝗲𝘃𝗢𝗽𝘀 :
www.devopsshack.com/courses/B...
Document: github.com/jaiswaladi246/DevO...
Doubt Clearing Group: t.me/+9roGPjX1YI42Yzdl
Project Repo: github.com/jaiswaladi246/Boar...
Instagram: / devopsshack
LinkedIn: / devops-shack
TimeStamps:
00:00:00 Intro
00:00:21 Architecture Flow
00:06:01 Understanding the Phases Of Corporate DevOps
00:10:37 PHASE-1 | Setup INFRA [K8-Cluster Setup]
00:26:29 Security Scan Of K8 Cluster
00:28:34 Create VMs for Jenkins, Sonar, & Nexus
00:48:26 PHASE-2 | Git Repo
00:52:57 Configure Jenkins
00:59:21 CICD Full Stack Pipeline
01:52:21 Monitoring

[@faizanshaikh4306]

00:06 Creating a complete corporate CICD pipeline from scratch 02:10 Testing and Security Checkpoints 06:21 Setting up secure infrastructure for deployment 08:47 Implementing security measures and email notifications 13:14 Ports required for setting up Kubernetes cluster and virtual machines 15:20 Setting up Master and Slave nodes with Mobaxterm 19:44 Changing file permissions for execution 21:52 Setting up Kubernetes cluster with Cube ADM, cubet, and Cube CTL 25:54 Setting up Kubernetes cluster for deployment 28:09 Setting up virtual machines for server configuration 32:28 Setting up Docker in a virtual machine for SonarCube and Nexus servers 34:41 Installing Docker and granting permissions to execute Docker commands 38:48 Setting up SonarQube and Nexus containers 40:51 Interacting with a Docker container using a terminal 44:45 Executing Commands for Docker and Setting Permissions in Jenkins Setup 47:04 Accessing Jenkins and setting up 50:53 Granting permissions and generating token for repository access. 53:01 Setting up essential plugins for CICD pipeline 57:29 Configuring tools and creating the pipeline 59:40 Generating a Jenkins pipeline skeleton for easy configuration. 1:03:39 Setting up CICD pipeline for project compilation and testing 1:05:44 Installing Trivy for vulnerability scanning on Jenkins server 1:10:11 Setting up SonarQube analysis in Jenkins pipeline 1:12:09 Setting up environment and defining tools 1:16:28 Configuring artifacts publication to Nexus 1:18:43 Setting up credentials for Nexus access 1:23:07 Building and tagging Docker images 1:25:20 Implementing Role-Based Access Control (RBAC) 1:29:45 Granting access and permissions for deployment 1:32:04 Setting up authentication from Jenkins to Kubernetes 1:36:43 Understanding Ports and Service Types in Kubernetes 1:38:43 Load balancer feature available by default in cloud platform based Kubernetes clusters 1:43:32 Configuring Extended Email Notification 1:46:05 Configuring email and setting up notification in the pipeline 1:50:25 Demonstrating the functionality of a credential-based application 1:52:33 Setting up monitoring infrastructure 1:57:51 Installing and configuring blackbox exporter for website monitoring 2:00:15 Configuring the IP address and targets for monitoring 2:05:02 Setting up website monitoring with Prometheus 2:07:06 Setting up and running Node Exporter for monitoring system metrics on Jenkins 2:12:52 Setting up monitoring dashboards in Grafana for Jenkins and website metrics. 2:15:12 Appreciation for the team and viewers

[@abhilashpatel6852]

I can verify this is the nearly exact structure on of the reputed UK bank was following in my last project. Trust this guy. This project is so good to even you can say in interview. You are doing wonderful job brother!

[@shawtyneedtostfu]

Can it get it even if I don't know anything about devops , Ik like very basic things about it .

[@vback4238]

Awesome job Aditya! You are killing it! BEST youtube channel for corporate projects.

[@nwokobia]

Fantastic walkthrough. Thank you!

[@aslekaryogendra]

Thanks Aditya for creating this. Lot of us gets an idea to implement few things from watching your videos. 👍

[@ytuser2626]

thank you Aditya.. your vid and your explanation is crazy good you make CI/CD looks more easier and understandable.. regards from Indonesia.. keep it up Aditya 🔥

[@aamirimran9373]

You are Legend in Explaining Devops Project♥♥♥♥♥

[@vamshikittu8635]

Maza agaya bhai, and more over the phases which we actually go through before creating the whole infra setup, explained it very clearly. Thank you Adithya for sharing an Amazing project.

[@ShaikHussain-cd1du]

Woww...Aditya GREAT explanation END TO END it is crystal clear.

[@manjub9357]

Awesome Adithya👏👏👏

[@shubhamgokhale505]

Great work @devopsshack. Nice explanation of CI-CD flow and configuration of tools on Linux machine.

[@deltamakuba]

Thank you brother, I can certify this is industry standard for pipeline management.

[@parmarpavan2552]

this project was very good right now i am learning devops and i learn so many thing in this video thank you for uplod such nice video on youtube for the biggners thank you so much aditay

[@sajjuquadri1964]

Very detailed way explained even to easy such an advance concept to Fresher.

[@MrGirijeshgupta]

This is very very useful and well-explanatory video for push base approach. I was searching such kind of video since 1 month, finally I got it. Thanks Adi !!!

[@RobinFF]

have you watched it if yes then tell me can i make this for free or some paid thing is used in this project??

[@rahulsahare2632]

Hello sir iam your subscriber and I love to watch your videos, can you please make video on 3 tier practical,how frontend and back-end connect and how back-end and database connect in real time , please sir......

[@samipdaveyt]

thank you bro finally it's there ❤

[@user-vs3do5np7l]

Complete DevOps Cycle touch 😍

[@saiprakash7046]

Awesome Aditya Sir, killed it, it will helped real cases 💥💥💥

[@singlesam123]

very much appreciate it..... Brillant !!!!

[@ZubairKhan-he8os]

Thank you for the video ❤

[@user-xe8ub5iq6c]

Great video aditya. Please make a corporate three tier project which includes frontend, backend, database and micro services. Thank you.

[@venkatsai3264]

Thankyou so much bro ❤ It's really helpful

[@akashray594]

Thanks a lot. I have learned a lot from it.

[@jagginarendra]

thanks for the awesome video. learnt a lot

[@vishnurathore6283]

Thank You... I subscribed

[@Deva2596]

Thanks for the video.✌✌

[@nihalkumar5423]

awesome bro maja aa gyaa thankyou so much bro

[@mystoryanimatedhindi569]

Good job bro 👏

[@Animecartoonworld4]

Plz make a tutorial on which we came to know how to work on different different branches like dev,test,prod

[@arunprasad5808]

Thank you bro❤

[@koustavnaha]

super se vi upar

[@iamsohailsp]

Thank you so much ❤❤❤

[@SuperBg234]

thank you for this video , it was very helpfull, i really didnt understand why you didnt access the website through the ip of loadbalancer , i saw you accessing it directly throgh the ip of the slave device

[@Papabuonair]

Thank you!

[@PHOENIX-he9fl]

bro here the best option is using cloud like aks,etc. and here company level if we want many number nodes then its is one of the disadvantage to using vm as k's.

[@ahmedsaif4541]

The architectural flow described and the actual implementation of the Jenkins pipeline are not in the same order such as SonarQube Analsyis stage after trivy stage , meanwhile in the architectural flow SonarQube is before Trivy ?

[@zimiselemadani9733]

Great work @DevOps Shack, I have been trying to integrate my jenkins instance to my eks cluster but I don't go through I'm getting this error "Error testing connection : java.io.IOException: kubernetes.default.svc" is this because my jenkins is in different vpc with my cluster??

[@ahmedsaif4541]

Thank you on your effort and i really appreciate it😊, may i know why you choose to run Sonarqubbe and Nexus as containers not standalone ?

[@swayamprakashbhuyan2580]

Fire hai💪💪

[@manojkumar-jt3fw]

Aditya, please do a project using Terraform & Ansible

[@mohammadayanbutt9914]

For monitoring the jenkins, you used jenkins plugin also. you could've added "jenkins grafana dashboard" also to monitor the jenkins jobs itself. btw great project

[@techbarn_org]

How would you have implemented it? If you care to elaborate.

[@mohammadayanbutt9914]

At 2:12:00 , you can see the job name jenkins added. It scraps the jobs details at /prometheus. So simply use the jenkins grafana dashboard number and add the dashboard in grafana. Now you will see the detail of jobs itself in grafana as well node exporter resource info.

[@ayushjaipuriyar1552]

Can you do a video on Jenkins with master and slave using ec2 plugin or ECS doesn't make sense to put on EKS cause that costs extra and as best practices should we place jenkins masters, sonarcube, trivy on different instances ?

[@87suhrob]

Thank you

[@ravindraravi7435]

Thank you ^^

[@user-dl3gf3lo9e]

Thanks a lot

[@awsservices8144]

where can i find the Jenkins file in the Repo. looks like the Jenkin file is not uploaded

[@akashray594]

@devopsshack How to monitor the application with Grafana? should I put node-exporter in the slave machine and try to capture its statistics?

[@C.RonaldoCR7G]

so helpful but i think the repo you using is different from what you put in the description

[@karthicholan4689]

Kubernetes deprecrated Docker in the latest versions. Still i use Docker as Container Runtime for AWS EKS. If not how to change Container Runtime to ContainerD or PodMan from Docker.

[@everwintools839]

Can you provide this all content in Hindi, My son want to learn DevOps or mujhe yehi sabse best channel laga h industry level par sikhne ke liye DevOps

[@prabhatkumar2206]

Is there any Aws devops course is going to start?

[@Manojkumar-nt8mp]

I have a doubt!!! In realtime, Jenkins will run on https or http ? in this eg, we can see jenkins is running in http so wondering does we have SSL certficate in realtime for jenkins

[@coffeebytes3257]

Dropping gems

[@adityajain5336]

sir i have question ,you made so many instance but we use master node to all and two worker node , but used so many instance its necessary

[@naveensilver]

Finallyyyyyyyy😍😍

[@shubhamshinde6295]

Sir Please please humble request for you please make one datail video on alerting. Please please

[@user-mw7dr4el2g]

why are we creating nexus and sonarqube containers again inside the servers , any specific reason ? Could you please clarify

[@purnimashanti26]

Hi sir, great video. It would be good if you had use eks cluster instead of kubeadm. In real time, every organisation use EKS cluster. Thank you.

[@user-bt5kf3pp1t]

i was thinking the same thing and to challenge myself i'm going to implement EKS

[@jalandharbehera99]

One question I have that in real time you are deploying applications from a single jenkinsfile or there will be a separate for CI and CD for each microservices…I mean to say that suppose I want to deploy login applications and I will have two jobs one is for CI jobs and another one is CD jobs of login application….??

[@abhishekrai2211]

Is there any batch going to start for DevOps along Mobile application DevOps?

[@C.RonaldoCR7G]

please i have a quick question, how can i reopen my servers after 2days when a stopped the aws instances. i always face this diddifculties.

[@KJayaSurya-wj3qm]

Functional testing will be done on real time or seperate pipeline will be there for functional testing I have this doubt how continues testing will be done I have clarity on Continuous Integration and Continues deployment

[@sanielsainoding2735]

How was the database works and how do we access it and also licensing ? Please help

[@atmaprakashks9709]

Better to use Multi execution while Running same commands

[@yeshasreedichipalli6183]

One small request sir plz make some projects on devops azure by using microsoft azure portal

[@C.RonaldoCR7G]

i tried to git clone my private repo but it wont let me do it please i do need help

[@sudhir.july2887]

@DevOps Shack In organization we can run on root user all installations things?

[@abrahimzaman360]

using Ansible

[@sudhir.july2887]

In organization we can run on root user all installations things?

[@sivaganesh9144]

While running kubectl get nodes nodes was refused to connect what to do for this.. I'm stucked here

[@devopsshack]

Document containing the scripts & Pipelines is pinned in Group t.me/+9roGPjX1YI42Yzdl

[@user-dj8tp6kz8o]

can i use this all pipeline in production.

[@mohamedashraf-jm8if]

can i do it on an onprimis k8s?

[@amitnjoshi8691]

hello i am unbale to open the document could u please help help me out

[@TikTokTrendsCompilation]

im stuck at 25:50 , running kubectl apply says "The connection to the server localhost:8080 was refused - did you specify the right host or port?" whats the issue here?

[@faisalraza6953]

I had this issue many time, you have to copy the same config file from(Master) to all your worker nodes, path is //.kube/config, use scp to securely transfer files to any worker node, if there is no .kube in worker, just create and then copy "config" file from master to ur nodes, also check if kubectl service is working fine otherwise try to install everything from scratch from Internet it shall work.

[@rahulsahare2632]

this pipeline is for a person with how many years of experience? meance a person who write this pipeline , so how many years of experience he have we can consider?

[@ranjancom2000]

Is X server is free tool or paid version you r using

[@Heisennburg]

why not use jenkins also on a container ?

[@parmarpavan2552]

i also same question

[@pankajsingh7223]

Jenkins X in a k8s is on demand Jenkins

[@user-pc1pm1vb7p]

Bro please make a video for cicd pipeline using master slave concept. And also like suppose I have 4 branch. I triggered a build and build should happen for that particular branch in which code changes has happened not for all branches build should not start .

[@devopsshack]

👌✌🏻

[@PIYUSH-lz1zq]

​@@devopsshack for the 2nd part. Can u tell me what concept we call it as ????

[@yogesh8615]

I hav mac. You didnt give substitute of mobaxterm.

[@jeantchop8425]

Network error: connection time out whenever I try to connect my VM to mobaxterm

[@sudheerparvathaneni4280]

Java is pre-requisite for it please check it once

[@Manojkumar-nt8mp]

Can anyone help me with this doubt!! Any reason why he is using 4VM. we can install sonarqube and nexus in same VM itself, Right ? since its t2.medium

[@rishabhteli2339]

did it work for u?

[@Manojkumar-nt8mp]

@@rishabhteli2339 yes it worked for me. install docker and run sonarqube n nexus as a container

[@kannan7709]

Sir certificate for you 4th batch... Can you give

[@noahakoko1028]

@devopsshack can I add this project to my resume upon completion on my end ? Kindly advise

[@devopsshack]

Yes you can This project is useful if you want to showcase the stages and flow

[@noahakoko1028]

please attend to my latest comments @@devopsshack

[@nitinkamble-ei5od]

Can you please provide your mobile so talk on some course related doubts plz?

[@gulabnandanvar7029]

Make on video generic webhook trigger plugins, how we can use in the realtime ??

[@jaydodhiawala7785]

How much will it cost 😅to

[@akashguruvannavar6126]

I am getting network error connection is failed when I tried to connect to Master server on mobaXterm. Can I know what might have gone as wrong ?

[@tana4240]

Upgrade the volume of the VM to 30GB

[@jaitherock60]

How much cost does this entire CI-CD project will cost in AWS? if anyone has done this entire setup in AWS ,any rough estimate is also fine.

[@tanayabanerjee2380]

Hi..How much its going to cost aprox after the complete project ??

[@parmarpavan2552]

absolutely i wating your comment reply

[@komalghule2215]

Any idea?

[@kingdavid526]

Where is the project repo

[@devopsshack]

check description

[@komalghule2215]

Hi aditya, how much asw will cost to create 7 8 VM with these memory configuration?

[@komalghule2215]

Approximately?

[@ManiBalajiC]

@@komalghule2215 learn whatever you want and throw away that account.

[@MadhuSudanNeerudu]

How much is the cost of batch 4 sir

[@devopsshack]

6500

[@ramesh_kumar_verma]

Th@nkyou $!r

[@umeshn1882]

Where is the notepad file….???

[@devopsshack]

Telegram pinned message

[@umeshn1882]

Thank you so much……

[@PurvJoshi-xd6of]

@@umeshn1882 hey do you have telegram group link ? the description one is not working

[@praveens2272]

This is 2024 and no new projects will be developed by using Jenkins pipelines.

[@ashay1987]

Then ?

[@praveens2272]

@@ashay1987 which platform you are using for CI/CD

[@yogesh8615]

You don't even explain the commands that you are putting

[@VivekMittal-pu5hq]

this comment save my time

[@gopendrasingh8631]

Bhai hindi ma b bol lya kr

[@devopsshack]

Naaa

[@vijayrathi]

WTF is corporate pipeline.

[@devopsshack]

Watch your language buddy.