The Ultimate CICD Corporate DevOps Pipeline Project | Real-Time DevOps Project

The Ultimate CICD Corporate DevOps Pipeline Project | Real-Time DevOps Project
𝗘𝗻𝗿𝗼𝗹 𝗧𝗼 𝗕𝗮𝘁𝗰𝗵-6 | 𝗭𝗲𝗿𝗼 𝗧𝗼 𝗛𝗲𝗿𝗼 𝗗𝗲𝘃𝗦𝗲𝗰𝗢𝗽𝘀 & 𝗖𝗹𝗼𝘂𝗱 𝗗𝗲𝘃𝗢𝗽𝘀 𝗦𝘁𝗮𝗿𝘁𝗶𝗻𝗴 30th July:
www.devopsshack.com/courses/B...
𝗘𝗻𝗿𝗼𝗹 𝗧𝗼 𝗕𝗮𝘁𝗰𝗵-𝟱 | 𝗭𝗲𝗿𝗼 𝗧𝗼 𝗛𝗲𝗿𝗼 𝗗𝗲𝘃𝗦𝗲𝗰𝗢𝗽𝘀 & 𝗖𝗹𝗼𝘂𝗱 𝗗𝗲𝘃𝗢𝗽𝘀 :
www.devopsshack.com/courses/B...
Document: github.com/jaiswaladi246/DevO...
Doubt Clearing Group: t.me/+9roGPjX1YI42Yzdl
Project Repo: github.com/jaiswaladi246/Boar...
Instagram: / devopsshack
LinkedIn: / devops-shack
TimeStamps:
00:00:00 Intro
00:00:21 Architecture Flow
00:06:01 Understanding the Phases Of Corporate DevOps
00:10:37 PHASE-1 | Setup INFRA [K8-Cluster Setup]
00:26:29 Security Scan Of K8 Cluster
00:28:34 Create VMs for Jenkins, Sonar, & Nexus
00:48:26 PHASE-2 | Git Repo
00:52:57 Configure Jenkins
00:59:21 CICD Full Stack Pipeline
01:52:21 Monitoring

[@faizanshaikh4306]

<a href="#" class="seekto" data-time="6">00:06</a> Creating a complete corporate CICD pipeline from scratch <a href="#" class="seekto" data-time="130">02:10</a> Testing and Security Checkpoints <a href="#" class="seekto" data-time="381">06:21</a> Setting up secure infrastructure for deployment <a href="#" class="seekto" data-time="527">08:47</a> Implementing security measures and email notifications <a href="#" class="seekto" data-time="794">13:14</a> Ports required for setting up Kubernetes cluster and virtual machines <a href="#" class="seekto" data-time="920">15:20</a> Setting up Master and Slave nodes with Mobaxterm <a href="#" class="seekto" data-time="1184">19:44</a> Changing file permissions for execution <a href="#" class="seekto" data-time="1312">21:52</a> Setting up Kubernetes cluster with Cube ADM, cubet, and Cube CTL <a href="#" class="seekto" data-time="1554">25:54</a> Setting up Kubernetes cluster for deployment <a href="#" class="seekto" data-time="1689">28:09</a> Setting up virtual machines for server configuration <a href="#" class="seekto" data-time="1948">32:28</a> Setting up Docker in a virtual machine for SonarCube and Nexus servers <a href="#" class="seekto" data-time="2081">34:41</a> Installing Docker and granting permissions to execute Docker commands <a href="#" class="seekto" data-time="2328">38:48</a> Setting up SonarQube and Nexus containers <a href="#" class="seekto" data-time="2451">40:51</a> Interacting with a Docker container using a terminal <a href="#" class="seekto" data-time="2685">44:45</a> Executing Commands for Docker and Setting Permissions in Jenkins Setup <a href="#" class="seekto" data-time="2824">47:04</a> Accessing Jenkins and setting up <a href="#" class="seekto" data-time="3053">50:53</a> Granting permissions and generating token for repository access. <a href="#" class="seekto" data-time="3181">53:01</a> Setting up essential plugins for CICD pipeline <a href="#" class="seekto" data-time="3449">57:29</a> Configuring tools and creating the pipeline <a href="#" class="seekto" data-time="3580">59:40</a> Generating a Jenkins pipeline skeleton for easy configuration. <a href="#" class="seekto" data-time="63">1:03</a>:39 Setting up CICD pipeline for project compilation and testing <a href="#" class="seekto" data-time="65">1:05</a>:44 Installing Trivy for vulnerability scanning on Jenkins server <a href="#" class="seekto" data-time="70">1:10</a>:11 Setting up SonarQube analysis in Jenkins pipeline <a href="#" class="seekto" data-time="72">1:12</a>:09 Setting up environment and defining tools <a href="#" class="seekto" data-time="76">1:16</a>:28 Configuring artifacts publication to Nexus <a href="#" class="seekto" data-time="78">1:18</a>:43 Setting up credentials for Nexus access <a href="#" class="seekto" data-time="83">1:23</a>:07 Building and tagging Docker images <a href="#" class="seekto" data-time="85">1:25</a>:20 Implementing Role-Based Access Control (RBAC) <a href="#" class="seekto" data-time="89">1:29</a>:45 Granting access and permissions for deployment <a href="#" class="seekto" data-time="92">1:32</a>:04 Setting up authentication from Jenkins to Kubernetes <a href="#" class="seekto" data-time="96">1:36</a>:43 Understanding Ports and Service Types in Kubernetes <a href="#" class="seekto" data-time="98">1:38</a>:43 Load balancer feature available by default in cloud platform based Kubernetes clusters <a href="#" class="seekto" data-time="103">1:43</a>:32 Configuring Extended Email Notification <a href="#" class="seekto" data-time="106">1:46</a>:05 Configuring email and setting up notification in the pipeline <a href="#" class="seekto" data-time="110">1:50</a>:25 Demonstrating the functionality of a credential-based application <a href="#" class="seekto" data-time="112">1:52</a>:33 Setting up monitoring infrastructure <a href="#" class="seekto" data-time="117">1:57</a>:51 Installing and configuring blackbox exporter for website monitoring <a href="#" class="seekto" data-time="120">2:00</a>:15 Configuring the IP address and targets for monitoring <a href="#" class="seekto" data-time="125">2:05</a>:02 Setting up website monitoring with Prometheus <a href="#" class="seekto" data-time="127">2:07</a>:06 Setting up and running Node Exporter for monitoring system metrics on Jenkins <a href="#" class="seekto" data-time="132">2:12</a>:52 Setting up monitoring dashboards in Grafana for Jenkins and website metrics. <a href="#" class="seekto" data-time="135">2:15</a>:12 Appreciation for the team and viewers

[@abhilashpatel6852]

I can verify this is the nearly exact structure on of the reputed UK bank was following in my last project. Trust this guy. This project is so good to even you can say in interview. You are doing wonderful job brother!

[@shawtyneedtostfu]

Can it get it even if I don't know anything about devops , Ik like very basic things about it .

[@nwokobia]

Fantastic walkthrough. Thank you!

[@vback4238]

Awesome job Aditya! You are killing it! BEST youtube channel for corporate projects.

[@aslekaryogendra]

Thanks Aditya for creating this. Lot of us gets an idea to implement few things from watching your videos. 👍

[@vamshikittu8635]

Maza agaya bhai, and more over the phases which we actually go through before creating the whole infra setup, explained it very clearly. Thank you Adithya for sharing an Amazing project.

[@ytuser2626]

thank you Aditya.. your vid and your explanation is crazy good you make CI/CD looks more easier and understandable.. regards from Indonesia.. keep it up Aditya 🔥

[@aamirimran9373]

You are Legend in Explaining Devops Project♥♥♥♥♥

[@MrGirijeshgupta]

This is very very useful and well-explanatory video for push base approach. I was searching such kind of video since 1 month, finally I got it. Thanks Adi !!!

[@Viralclips-b6]

have you watched it if yes then tell me can i make this for free or some paid thing is used in this project??

[@shubhamgokhale505]

Great work @devopsshack. Nice explanation of CI-CD flow and configuration of tools on Linux machine.

[@samipdaveyt]

thank you bro finally it's there ❤

[@singlesam123]

very much appreciate it..... Brillant !!!!

[@akashray594]

Thanks a lot. I have learned a lot from it.

[@ShaikHussain-cd1du]

Woww...Aditya GREAT explanation END TO END it is crystal clear.

[@ZubairKhan-he8os]

Thank you for the video ❤

[@patilarun05]

Fabulous job. Good work. Keep it up.

[@parmarpavan2552]

this project was very good right now i am learning devops and i learn so many thing in this video thank you for uplod such nice video on youtube for the biggners thank you so much aditay

[@jagginarendra]

thanks for the awesome video. learnt a lot

[@user-vs3do5np7l]

Complete DevOps Cycle touch 😍

[@deltamakuba]

Thank you brother, I can certify this is industry standard for pipeline management.

[@venkatsai3264]

Thankyou so much bro ❤ It's really helpful

[@Deva2596]

Thanks for the video.✌✌

[@devopsshack]

Document containing the scripts & Pipelines is pinned in Group t.me/+9roGPjX1YI42Yzdl

[@Travel_grp84]

❤❤❤ be happy and great work so amazing .. learned alot of things that in i have stuck ❤❤

[@nihalkumar5423]

awesome bro maja aa gyaa thankyou so much bro

[@sajjuquadri1964]

Very detailed way explained even to easy such an advance concept to Fresher.

[@RohitAlam-zr7on]

Hey bro, thank you so much for helping me out. You are hero bro

[@manjub9357]

Awesome Adithya👏👏👏

[@vishnurathore6283]

Thank You... I subscribed

[@Papabuonair]

Thank you!

[@saiprakash7046]

Awesome Aditya Sir, killed it, it will helped real cases 💥💥💥

[@Travel_grp84]

Thanks sir... best wishes for in your life ❤❤❤🎉🎉

[@koustavnaha]

super se vi upar

[@arunprasad5808]

Thank you bro❤

[@Bhikhmangi_Kaum]

Good job bro 👏

[@user-xe8ub5iq6c]

Great video aditya. Please make a corporate three tier project which includes frontend, backend, database and micro services. Thank you.

[@Animecartoonworld4]

Plz make a tutorial on which we came to know how to work on different different branches like dev,test,prod

[@user-dl3gf3lo9e]

Thanks a lot

[@iamsohailsp]

Thank you so much ❤❤❤

[@87suhrob]

Thank you

[@ravindraravi7435]

Thank you ^^

[@rahulsahare2632]

Hello sir iam your subscriber and I love to watch your videos, can you please make video on 3 tier practical,how frontend and back-end connect and how back-end and database connect in real time , please sir......

[@swayamprakashbhuyan2580]

Fire hai💪💪

[@naveensilver]

Finallyyyyyyyy😍😍

[@ahmedsaif4541]

Thank you on your effort and i really appreciate it😊, may i know why you choose to run Sonarqubbe and Nexus as containers not standalone ?

[@SuperBg234]

thank you for this video , it was very helpfull, i really didnt understand why you didnt access the website through the ip of loadbalancer , i saw you accessing it directly throgh the ip of the slave device

[@coffeebytes3257]

Dropping gems

[@PHOENIX-he9fl]

bro here the best option is using cloud like aks,etc. and here company level if we want many number nodes then its is one of the disadvantage to using vm as k's.

[@manojkumar-jt3fw]

Aditya, please do a project using Terraform & Ansible

[@mohammadayanbutt9914]

For monitoring the jenkins, you used jenkins plugin also. you could've added "jenkins grafana dashboard" also to monitor the jenkins jobs itself. btw great project

[@techbarn_org]

How would you have implemented it? If you care to elaborate.

[@mohammadayanbutt9914]

At 2:12:00 , you can see the job name jenkins added. It scraps the jobs details at /prometheus. So simply use the jenkins grafana dashboard number and add the dashboard in grafana. Now you will see the detail of jobs itself in grafana as well node exporter resource info.

[@ahmedsaif4541]

The architectural flow described and the actual implementation of the Jenkins pipeline are not in the same order such as SonarQube Analsyis stage after trivy stage , meanwhile in the architectural flow SonarQube is before Trivy ?

[@ayushjaipuriyar1552]

Can you do a video on Jenkins with master and slave using ec2 plugin or ECS doesn't make sense to put on EKS cause that costs extra and as best practices should we place jenkins masters, sonarcube, trivy on different instances ?

[@purnimashanti26]

Hi sir, great video. It would be good if you had use eks cluster instead of kubeadm. In real time, every organisation use EKS cluster. Thank you.

[@user-bt5kf3pp1t]

i was thinking the same thing and to challenge myself i'm going to implement EKS

[@C.RonaldoCR7G]

so helpful but i think the repo you using is different from what you put in the description

[@zimiselemadani9733]

Great work @DevOps Shack, I have been trying to integrate my jenkins instance to my eks cluster but I don't go through I'm getting this error "Error testing connection : java.io.IOException: kubernetes.default.svc" is this because my jenkins is in different vpc with my cluster??

[@everwintools839]

Can you provide this all content in Hindi, My son want to learn DevOps or mujhe yehi sabse best channel laga h industry level par sikhne ke liye DevOps

[@akashray594]

@devopsshack How to monitor the application with Grafana? should I put node-exporter in the slave machine and try to capture its statistics?

[@vishwavishwa8036]

Waiting for multi stage and Build and Release corporate project

[@awsservices8144]

where can i find the Jenkins file in the Repo. looks like the Jenkin file is not uploaded

[@KJayaSurya-wj3qm]

Functional testing will be done on real time or seperate pipeline will be there for functional testing I have this doubt how continues testing will be done I have clarity on Continuous Integration and Continues deployment

[@Manojkumar-nt8mp]

I have a doubt!!! In realtime, Jenkins will run on https or http ? in this eg, we can see jenkins is running in http so wondering does we have SSL certficate in realtime for jenkins

[@shubhamshinde6295]

Sir Please please humble request for you please make one datail video on alerting. Please please

[@atmaprakashks9709]

Better to use Multi execution while Running same commands

[@jalandharbehera99]

One question I have that in real time you are deploying applications from a single jenkinsfile or there will be a separate for CI and CD for each microservices…I mean to say that suppose I want to deploy login applications and I will have two jobs one is for CI jobs and another one is CD jobs of login application….??

[@prabhatkumar2206]

Is there any Aws devops course is going to start?

[@yeshasreedichipalli6183]

One small request sir plz make some projects on devops azure by using microsoft azure portal

[@karthicholan4689]

Kubernetes deprecrated Docker in the latest versions. Still i use Docker as Container Runtime for AWS EKS. If not how to change Container Runtime to ContainerD or PodMan from Docker.

[@adityajain5336]

sir i have question ,you made so many instance but we use master node to all and two worker node , but used so many instance its necessary

[@sudhir.july2887]

@DevOps Shack In organization we can run on root user all installations things?

[@sudhir.july2887]

In organization we can run on root user all installations things?

[@user-mw7dr4el2g]

why are we creating nexus and sonarqube containers again inside the servers , any specific reason ? Could you please clarify

[@abrahimzaman360]

using Ansible

[@abhishekrai2211]

Is there any batch going to start for DevOps along Mobile application DevOps?

[@sanielsainoding2735]

How was the database works and how do we access it and also licensing ? Please help

[@rahulsahare2632]

this pipeline is for a person with how many years of experience? meance a person who write this pipeline , so how many years of experience he have we can consider?

[@sivaganesh9144]

While running kubectl get nodes nodes was refused to connect what to do for this.. I'm stucked here

[@user-dj8tp6kz8o]

can i use this all pipeline in production.

[@forlarhherastus6082]

Thank you for this. Please I need your help, I’m getting the error “open trivy-fs-report.html: permission denied” error while trying to build my pipeline

[@003shamshuddin]

why didn't you use owasp dp check?

[@C.RonaldoCR7G]

i tried to git clone my private repo but it wont let me do it please i do need help

[@vishwavishwa8036]

what kind of database you are using?

[@amitnjoshi8691]

hello i am unbale to open the document could u please help help me out

[@ranjancom2000]

Is X server is free tool or paid version you r using

[@Manojkumar-nt8mp]

Can anyone help me with this doubt!! Any reason why he is using 4VM. we can install sonarqube and nexus in same VM itself, Right ? since its t2.medium

[@rishabhteli2339]

did it work for u?

[@Manojkumar-nt8mp]

@@rishabhteli2339 yes it worked for me. install docker and run sonarqube n nexus as a container

[@C.RonaldoCR7G]

please i have a quick question, how can i reopen my servers after 2days when a stopped the aws instances. i always face this diddifculties.

[@jeantchop8425]

Network error: connection time out whenever I try to connect my VM to mobaxterm

[@sudheerparvathaneni4280]

Java is pre-requisite for it please check it once

[@mohamedashraf-jm8if]

can i do it on an onprimis k8s?

[@noahakoko1028]

@devopsshack can I add this project to my resume upon completion on my end ? Kindly advise

[@devopsshack]

Yes you can This project is useful if you want to showcase the stages and flow

[@noahakoko1028]

please attend to my latest comments @@devopsshack

[@tanayabanerjee2380]

Hi..How much its going to cost aprox after the complete project ??

[@parmarpavan2552]

absolutely i wating your comment reply

[@komalghule2215]

Any idea?

[@Heisennburg]

why not use jenkins also on a container ?

[@parmarpavan2552]

i also same question

[@pankajsingh7223]

Jenkins X in a k8s is on demand Jenkins

[@user-pc1pm1vb7p]

Bro please make a video for cicd pipeline using master slave concept. And also like suppose I have 4 branch. I triggered a build and build should happen for that particular branch in which code changes has happened not for all branches build should not start .

[@devopsshack]

👌✌🏻

[@PIYUSH-lz1zq]

​@@devopsshack for the 2nd part. Can u tell me what concept we call it as ????

[@MindMazeMedia-qn1dy]

nexus doesnt work in the browser .Any solutions?

[@TikTokTrendsCompilation]

im stuck at <a href="#" class="seekto" data-time="1550">25:50</a> , running kubectl apply says "The connection to the server localhost:8080 was refused - did you specify the right host or port?" whats the issue here?

[@faisalraza6953]

I had this issue many time, you have to copy the same config file from(Master) to all your worker nodes, path is //.kube/config, use scp to securely transfer files to any worker node, if there is no .kube in worker, just create and then copy "config" file from master to ur nodes, also check if kubectl service is working fine otherwise try to install everything from scratch from Internet it shall work.

[@dhruvmalixcs]

pls reply if found the soln

[@prp999]

Good project, but too much complicated configs inside Jenkins, i guess you can do the same using UI, rather writing all those script manually.

[@yogesh8615]

I hav mac. You didnt give substitute of mobaxterm.

[@kannan7709]

Sir certificate for you 4th batch... Can you give

[@vishwavishwa8036]

Is this CICD or only CI?

[@jaitherock60]

How much cost does this entire CI-CD project will cost in AWS? if anyone has done this entire setup in AWS ,any rough estimate is also fine.

[@kingdavid526]

Where is the project repo

[@devopsshack]

check description

[@akashguruvannavar6126]

I am getting network error connection is failed when I tried to connect to Master server on mobaXterm. Can I know what might have gone as wrong ?

[@tana4240]

Upgrade the volume of the VM to 30GB