Robust Architecture to ingest Stream Data into Elastic Search by using Kinesis Part 1

[@VinodKumar-de3eq]

you are doing great

[@user-vt2hi6hw9j]

This is such a great video I have ever found! I need do a log tracker for my team with kinesis/firehose/S3/Anthena as you did, but I have a question is that, can we connect S3 with Anthna directly? Or say, we have to need AWS glue to do so ?

[@AbhayNayak]

good stuff!

[@manojravichandran9737]

Good Architecture

[@MrArtod]

I have question about how authN/Z works on Kinesis stream. Let's say I have a mobile app sending high rate data to my stream. How can I make sure that data comes from authorized users? Should I put the Kinesis behind API Gateway (I suspect it adds latency) or can I send data directly to stream (then how authN works in this case)?

[@showmethemoney824]

can you show similar arch for cdc as well? or do you have another arch suggestion ?

[@joydeepchakraborty1966]

can you share a video where EC2 instance send the log theough kinesis from the scratch

[@MohammedNadeem-do9ew]

Hey nice video . But i am new to aws kenisis . I just wana know how we can use the aws kenisis in consumer and producer concept.

[@user-xe6xs2xb7h]

hey soumil thanks for the video I want to send kinesis firehouse data delivery logs to my local elasticsearch using logstash kinesis input to pull logs is it possible to do it ?

[@SoumilShah]

Well you have to use firehose with http Then you need to write logic to send data to elk to whatever address in this case your local elk

[@SoumilShah]

docs.aws.amazon.com/firehose/latest/dev/httpdeliveryrequestresponse.html

[@sharemomentsindian]

@Soumil :- your voice is quite clear which software you used to record and show these end to end

[@SoumilShah]

I use a tool called OBS Microphone I use is YeTTI blue