Stream Processing Example using Spring Cloud Data Flow, Kinesis Data Streams, EKS | Tech Primers

This video covers how we can leverage Spring Boot, Spring Cloud Stream in EKS for Stream processing using Kinesis Data Streams
⏱ Chapter Timestamps
====================
0:00 - Introduction
0:10 - Architecture
3:05 - Create EKS Cluster
6:37 - Project creation using start.spring.io
11:24 - Creation of Dockerfile
11:50 - Building the project
12:33 - Building docker image
14:08 - Tag & Push docker image to registry
15:30 - Creation of k8s.yml
16:52 - Creation of Kinesis Data Streams
18:58 - Deployment in EKS cluster
22:28 - Publishing to Kinesis Data Streams
22:58 - Kinesis Data Analytics
26:54 - Accessing the app using ELB
27:44 - Summary
📌 Related Links
=============
🔗 Github code sample used in the video -
🔗 Getting started with eksctl - docs.aws.amazon.com/eks/lates...
🔗 Spring Cloud Kinesis sample - dataflow.spring.io/docs/recip...
📌 Related Videos
===============
🔗AWS Primer: • AWS Primer
🔗 System Design Primer: • System Design Primer
🔗 Containers Primer: • Let's talk Containers ...
🔗 Kubernetes Primer: • Kubernetes Primer
💥 Join TechPrimers Slack Community: bit.ly/JoinTechPrimers
💥 Telegram: t.me/TechPrimers
💥 TechPrimer HindSight (Blog): / techprimers
💥 Website: techprimers.com
💥 Slack Community: techprimers.slack.com
💥 Twitter: / techprimers
💥 Facebook: TechPrimers
💥 GitHub: github.com/TechPrimers or techprimers.github.io/
🎬Video Editing: FCP
---------------------------------------------------------------
🔥 Disclaimer/Policy:
The content/views/opinions posted here are solely mine and the code samples created by me are open sourced.
You are free to use the code samples in Github after forking and you can modify it for your own use.
All the videos posted here are copyrighted. You cannot re-distribute videos on this channel in other channels or platforms.
#KinesisDataStreams #EKS #SpringCloudStream

[@aswarthanarayanareddyb176]

This is where we are again proud to be tech primers subscriber, thanks for the awesome content.

[@TechPrimers]

Thanks Bhupathi! Cheers!

[@KartikMakker]

Really awesome and detailed video!. Thankyou!

[@amintalukder7189]

Great video,,, Love it. thanks.

[@TechPrimers]

Glad you enjoyed it

[@parvkapadia4217]

Just FYI, Spring Cloud Streams config also uses a dynamodb table.. it is also automatically gets created when you run the application

[@TechPrimers]

Is it, i did not provide any permission for dynamodb resource in my IAM role, still it worked with only Kinesis. Weird!

[@sanjayprawat]

So the whole application development and walkthrough is completed and AWS is still creating K8S cluster 🤣🤣 It's been years since they introduced EKS, still no improvement? GCP takes less than 2-4 mins to create a cluster. Btw awesome demo, complete end to end is always nice to watch. Also, the Annotation based programing using Spring Cloud Stream is deprecated now and new approach is to use Functional style instead of Source/Sink/Processor.

[@TechPrimers]

Can't agree more. I think it's to do with other services, which generally take a bit longer than in GCP. Oh ok. So people are moving away from annotation...

[@asdfasdfasdfasdf219]

Do you have a tutorial to set up the command line with that look?

[@sakethmanupati]

Does this not work with localstack instead of actual kinesis? I could not find a way to configure this with localstack

[@chitthiaayeehai]

Dude how ur iterm is showing commands ? That wd be a gr help... pls do share

[@cobar2]

Is this compatible with boot 2.7, spring-cloud-dependencies 2021.0.3?

[@mysavingclub]

Can you tell which plugin you use for auto completion in yml file and how to setup that Thanks in advance

[@TechPrimers]

Hi Vijay. Check my IntelliJ tips n tricks video, i have shown there. It’s called live templates. I preload them before hand

[@garywhitewolf]

Spring cloud data flow, I should use eks or ecs?

[@TechPrimers]

If you are new to containers use ECS. If you know abr containers n k8s, go with EKS