AWS CodePipeline (CI / CD) Tutorial with CDK

[@et4493]

Dude, heartfelt, thank you for the absolute pain you've been through to get this tutorial out. I truly understand the pain of troubleshooting for HOURS nonsensical permissions and unclear documentation. You're an absolute champ

[@joesilva-rodriguez9]

Cool. This is something all companies want. It's really cool that you're making youtube videos for people that want to do this like myself.

[@DjBabu-ef1ew]

Finally found what I was looking on KZbin for a long time. Thank you so much

[@BeABetterDev]

You're very welcome!

[@richardjin3035]

This is EXACTLY what info I’m trying to find. Thank you so so much for making this video ❤ I cannot express how happy I was when found this video. Thank you 🙏

[@onedaytimewin]

hi, yes please make a video on adding unit tests to the code pipeline! it would take an avg dev to next level!

[@pythonfamily]

I really appreciate all these tutorials, thanks a looot

[@SKR1912]

You are amazing !!! Thanks for all the hard work you do to make our life easier :) I have cdk version 2.82.0 and the steps mentioned in the video works flawless without any change.

[@MarkJones-xb8vy]

Nice simple, concise walkthrough covering potential gotchas! Thanks alot :)

[@mackkaputo8989]

Discovering the Channel, Great content. Love it🙌

[@BeABetterDev]

Thanks Mack! welcome to the channel :D

[@davemeech]

Awesome video. We're in the midst of creating a similar CI/CD pipeline for our CDK project as well. Given that it's been a year since this video and you said you were in the process of exploring this topic at the time, is there anything you've learned since that might change anything about the sample pipeline or the ideal CI/CD you described in your other CI/CD video?

[@najeed23]

Great video, was able to follow very easily. Would love to see you add onto this where we can use a dynamo and potentially an index on it that the lambda can write to as well as the unit tests you mentioned and alerts that can be added to the stack.

[@BeABetterDev]

Thanks for the great suggestions Najeed! I'm currently working on adding Unit Tests and hope to post an update within a month or so. Cheers

[@erikslorenz]

Thanks! While I tend to do more with azure and Google cloud I always love learning more about the architecture because it applies across everything I actually find I understand more when I use the same concepts with different execution

[@BeABetterDev]

Glad I was able to help Erik!

[@PetersExcapades]

bros got the best mouse ever!!! great video thank you!

[@shadaabsikander2873]

great waiting for unit testing too

[@farukada]

Nice video, I'm using a little bit different approach in my video. But your explanation is very good!

[@gshan994]

Thank you ...I wanted to do CICD using code pipeline for my project and I will use your video for reference. Only thing is that I am using python and I feel there will be changes in Shell step. Apart from that you are doing a good job. Also I felt like instead of passing account names and regions in each step. You can add them in a config and then reference it here. Or use context.json to have your account data and access keys. AWS recommends Context approach. I have used it in multi acc env deployments.

[@BeABetterDev]

Thanks for the recommendation! I haven't come across Context but will take a look. Do you have any documentation suggestions to learn more?

[@gshan994]

@@BeABetterDev i will share a video with the setup i have currently in my day today work.

[@balajig4764]

@@gshan994 hi bro

[@gshan994]

@@balajig4764 hi

[@bolonabolona]

15:11 Adding Stage & Manual Approval

[@PaulliMr]

Great job! And right it time for me when I need it. Thanks so much :)

[@BeABetterDev]

You're very welcome Paulli!

[@kahlilkahlil9172]

Could u help to create the ECS deploy version of this pipeline ?

[@MrFaberX]

Great tutorial!

[@thisisgurkaran]

You are doing an amazing job Sir. I think you for your videos. Subbed and liked.

[@BeABetterDev]

Welcome aboard!

[@greggschofield142]

Great Video - please can you show us how to deploy to different AWS accounts (e.g. dev, qa, prod etc) at each stage of the pipeline? I gave this a go and having issues with bootstrapping and establishing the trust relationships between the central tools and environment accounts. Cheers!

[@jyotisable8936]

Great work !

[@BeABetterDev]

Thanks a lot!

[@dnial6992]

Absolute incredible! Can you do tutor on CICD with react-git action?

[@code1530]

What do you use to create your system diagram?

[@oferezr10]

Is there a way to do just that but with python?

[@mrrishiraj88]

Good day

[@alexeypolishchuk7010]

Great tutorial! Thanks! Everything is clear. I like that it's not required to use a Codecommit and we can setup a CodePipelineSource with gihub repository. Is it possible to use same solution with Gitlab?

[@BeABetterDev]

Thanks so much Alexey! Its definitely possible to use other source code providers. I'm not sure if Gitlab is supported out of the box but I know for a fact Github is. You may want to check out the console to see if Gitlab is a selectable option.

[@navwickramasinghe5226]

Does the CDK code automatically create the IAM policies that is required for cross account deployment of the CF stacks?

[@pankajjoshi6658]

Can you please help me on these. What triggers updatepipeline? What is selfmutate .? What if i disable selfmutation?

[@arjunsv8496]

can i use this for deploying aws appsync as well?

[@paritoshmehta4048]

How do we delete the stack when using CDK pipelines?? I have been searching for days

[@marcin2x4]

When adding new stages, git push updates the code in the repo but CDK Deploy seems to be not happening. Has anyone noticed similar issue?

[@ignaciotrullenque6763]

Hi! i have a question, for python is the same process? because when i launch the cdk i dont have the same folders.

[@Baresi_moi]

This is awesome. Followed through nicely but keep getting an error "Need to perform AWS calls for account ****, but no credentials have been configured' when I try to deploy. I get same error earlier when I try to attach execution policies. Any help please?

[@BeABetterDev]

Hey Francis! Have you run aws configure in your CLI to configure your AWS credentials?

[@MajdSoufan95]

Thank you for creating this! Couple of notes: Can you provision the secret that stores the Github token in CDK? Can you provide more complex lambda solution(with npm packages) where you would need to bundle it, zip it, and deploy it?

[@gshan994]

yes you can provision secret that you obtained from github and you can use cdk to deploy it

[@BeABetterDev]

You can provision the secret I would just be careful about storing access keys in source control :P

[@brunocupido731]

You're really a great instructor, I started experimenting with CDK watching your videos, can you tell me if it's possible to create the pipeline without the artifact bucket?

[@chair_force]

Anyone know if they fixed the issue at 3:45 ?

[@mananmishra7433]

Any one know ho to accelerate these code pipelines ? or how can we reuse the file assets that are being created every time we run the code pipeline

[@blanky_nap]

Awesome and very interesting/helpful video! Looking forward to see the next one. Could you please youse python instead of typescript? Thanks!

[@gshan994]

Hi, I use python for cdk and I will be doing same cicd for my project but in python. If you want I will make a video on it,

[@adriandrozman3404]

My build step is failing because it can't install the lambda dependencies (Cannot find module '@aws-sdk/util-dynamodb' or its corresponding type declarations)

[@BeABetterDev]

Hi Adrian, can you make sure you are running the latest version of cdk? Other than that I'm not sure why you would be receiving this error.

[@adriandrozman3404]

@@BeABetterDev Hey, I found the issue, I was using a separate package.json for managing the lambda dependencies, instead of using the project root package.json file. Also, any tips on how to create a unit test stage ? preferably with jest? thanks!

[@BR-lx7py]

Is CDK production ready in your opinion? The fact that you had to downgrade to an older version, and not assigning to a variable @5:20 makes me question that. What is the reason for this latter?

[@hasanbiyik01]

At the moment, CDK even doesn't have L2 construct library for HTTP API. It needs time imho.

[@gshan994]

I use it in production and it doesnt gave me any error at such, But one thinng is that CDK is based on cloudformation. So if something that you are trying is not allowed on cloudformation then it will not work on cdk too. But if you come across any errors then der is a community called cdk.dev who help you out very quicky and solve your doubts about cdk since these are the ppl who have built cdk.

[@BeABetterDev]

Hi B R, I've been using it for all my production systems at work for over a year. I haven't really had much problems with it at all. I think the downgrading is just due to the CDK Pipelines construct which is still a developing product. The error at 5:20 is probably something to due with my lack of knowledge of TypeScript and probably not anything to do with CDK itself - but who knows. Hope this helps

[@yumingu2076]

Thanks ! I have learnt a lot. I have a question. I have github token set up in secret manager. I changed aws-cdk version from 2.9.0 to 2.8.0. But when I run cdk deploy it fails with the error message below. "CREATE_FAILED | AWS::CodePipeline::Pipeline | Pipeline/Pipeline (Pipeline9850B417) Internal Failure". I don't know how to fix it. Can you give me some suggestions? Or tell me what log I should look at to fix it myself.

[@BeABetterDev]

Hi Yumin, Two things can be going wrong here so here's some things I would check: 1) Did you delete the packagelock.json AFTER you changed the version from 2.8.0 to 2.9.0 ? Also, you you run npm build after that? 2) Did you create the github access token with the correct permissions? I was running into the same "Internal Failure" error when I was trying to set this up and it was very frustrating. The way I figured out the problem is by using AWS CloudTrail. Cloudtrail shows you the API calls being made to AWS and shows the exact exceptions encountered. What you should do is run cdk deploy, observe the failure, and then go into cloud trail and search for "Exception" or "Error". You should be able to find the reason the failure is occurring. Hope this helps.

[@yumingu2076]

​@@BeABetterDev Hi @Be A Better Dev I always use cloudwatch to query and troubleshoot my application. I didn't know cloudtrail could be used to solve the problem with cloudfomation. I queried the logs of cloudtrail. ``` "errorCode":"ResourceNotFoundException","errorMessage":"Secrets Manager cannot find the specified secret. ","re​​questParameters":{"secretId":"github-token"}" ``` That's totally my fault. My Secrets name is not right. It is clearly stated in the video, but I missed it because of my poor English. After I fixed it, 'cdk deploy' completed successfully. I am excited to have a new understanding of what cloudtrail can do. it's really a good experience. Thank you very much!

[@rickharold7884]

Cool

[@dimikaydoesthings]

Hope this is tracked or anyone in the comments is looking for the same, how does one cleanup a Stage deployed stack ?

[@jordixboy]

isn't the idea of stacks have everything grouped per project? I mean, 1 stack per project

[@BeABetterDev]

You're very welcome

[@jordixboy]

@@BeABetterDev it's a question, could you answer please ?

[@RRR-oq9vw]

Its not as easy as BBD make it look

[@Leonardo.novak00]

half life

[@liquidcode1704]

haha bro don't feel bad... I know how inferior it feels to be screen sharing with the team and then have to pull up github desktop cause the cli has some buggy issue cause the cert or vpn or some garbage lmfao