Microservice | Distributed log tracing using Spring Cloud Sleuth & Zipkin | PART-7 | Javatechie

This tutorial will walk you through the steps of building a spring boot project with Microservice architecture also we will learn Real time integration of
1.spring cloud eureka
2.Spring cloud API Gateway
3. Hystrix
4.cloud config server
5. ELK Stack Centralize logging
6. Spring Cloud Sleuth & Zipkin (Distributed log tracing)
#javatechie #SpringBoot #Microservice
#SpringCloud #Sleuth #zipkin
GitHub:
github.com/Jav...
Blogs:
/ javatechie
Facebook:
/ 919464521471923
Guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community , you are free to use source code from above mentioned GitHub account

[@siddharth1278]

you are doing brilliant work sir. thanks

[@sarojsahoo8763]

Also in real time I think Kafka Messaging Queue will push the data to Zipkin server and Zipkin will store it in some databases like Elasticsearch/Mongo/Cassandra

[@vaibhavsrivastava4645]

Your videos are very concise and easy to understand. Thanks for spreading knowledge.

[@Javatechie]

Thanks buddy 😊

[@christianpelayo4629]

Learn a lot from you sir thank you. Can you also do a tutorial about this project, to deploy as a docker container?

[@Kuchbhitubers]

Please provide video for Eureka as service discovery and zuul as api gateway

[@Javatechie]

Vivek already uploaded please go through my microservice playlist

[@abhilash438]

@basant - I guess you added the same tutorial twice in the playlist. Can you please correct or did you miss to add any other tutorial.

[@ravindrabangalore2990]

Hi , its generating trace id but its not showing in zipkin ui can you plz help me

[@veyselozdemir]

Nice one. Thanks for preparing this

[@1729sagar]

@basant Is trace id equivalent to Correlation ID?

[@ashwaniomgupta]

What will happen if the Zipkin server is down, is logs transactions will be lost? Can we see them once Zipkin is up?

[@MohammadWasimKhan]

Great content man. 👍 Please help me with one query : Why traceId and spanId is same for orderService ?

[@Javatechie]

Try attempting multiple time you will find your answers buddy

[@keongthon5443]

When use only spring cloud sleuth it not show trace id and span id right ?

[@dac5961]

Awesome Video Basant. You are doing invaluable service to developers community. Thank you so much.

[@Javatechie]

Thanks buddy 😊

[@krantimansingh7888]

Can we create a custom span ID. ? If yes, then how ?

[@Javatechie]

I believe we can but will check and update

[@krantimansingh7888]

@@Javatechie I am not able to find any related documentation for it. Kindly update if you find something.

[@salemalowi7261]

How to secure zipkin?

[@Javatechie]

Am not sure but I believe we need to create zipkin server manually then need to enable security by adding spring security starter dependency

[@souravmanna9090]

Could you please make one video on dynatrace or any other production like monitoring tool. It would be very helpful.

[@Javatechie]

It's paid buddy. If i could get some free trial then definitely i will give a try

[@skumars1234]

Very much helpful video. Thanks a lot Basant!!! But have a doubt, Can we implement Sleuth alone for just getting those metadata in logs?

[@Javatechie]

No we need to push those metrics from our app to sleuth

[@johnday3645]

So we can add sleuth/ zipkin within elk stack ..so that in addition we get microservice flow logs for debugging Is my above statement correct ?

[@Javatechie]

Yup correct

[@SunilRathod-d9r]

love to see your videos sir, keep doing..!

[@rameshy2415]

Hello Sir it's great video ,just wanted to know how can I trace my request if i will be using Kafka in between of microservices??

[@Javatechie]

You need to check in Kafka tool or lenses ui

[@mannut1209]

Awesome . Awesome learning with Java Techie ..Thank you . can we use Ribbon for the LOAD balancing ? are you planning to implement the same ?

[@Javatechie]

Yes we can use ribbon as I did poc with one instance so didn't added this concept yet .but if required I will plan to add one tutorial on same

[@technicalsource8236]

In other group I think of

[@prashhanthnelakanti4992]

Can you plz share zipkin jar . I have searched all the way in the google but no luck ☹️

[@Javatechie]

Directly get it from Maven central repository

[@ChandanKumar-ou9fr]

Hi bro, I am able to work with Zipkin. But I am running multiple instances of Order and Payment services on different ports. In Zipkin, it is showing only IP and not on which port my requests are getting redirected by Eureka. How to get Ports also in Zipkin dashboard?

[@Javatechie]

Zipkin won't show your port . It will show your service name based on service name you can find out port in your Eureka server

[@ChandanKumar-ou9fr]

@@Javatechie But at timestamp 2:00 you said that we'll be able to find exactly which instance of our service will go down, whether it is 9090 or 9091. How to find that out for a request?

[@krishnapanigrahi6926]

2020-09-05 22:00:29.298 INFO [order-service,,,] 8076 --- [ restartedMain] c.e.S.SlauthDemoOrderServiceApplication : Started SlauthDemoOrderServiceApplication in 7.371 seconds (JVM running for 7.986) i am getting response in this format ..service name is printing , but Traceid and other metadata are not printing. But in Zipkin UI i am getting all those metadata.

[@Javatechie]

Spring boot version ? Am not sure about it in each spring version something gona changed by developer So please checkout the spring boot official documentation if you are using latest version

[@krishnapanigrahi6926]

@@Javatechie spring boot version is 2.3.3

[@ahmedelsabagh6990]

Great explanation! Thank you very much

[@chandragie]

Thanks a lot for this brief yet practical explanation!

[@maheshd3506]

Nice explanation and thanks for your efforts

[@krupabhavsar3827]

Great explaining. able to understand the concept

[@karthickk9096]

Nice May I know how to get all the log messages in one place in Microservices

[@Javatechie]

Use elastic logstash and kibbana . already i uploaded it please checkout my microservice playlist

[@uma4525]

Zipkin jar is not running in windows. Can anyone help me out?

[@Javatechie]

What error you are getting

[@uma4525]

@@Javatechie BeanCreation Exception with name ArmeriaServer. I am using zipkin- server-2.23.2-exec.jar and amazon correto jdk 11

[@Javatechie]

Not getting you why you want to sync AWS with zipkin

[@uma4525]

@@Javatechie am not using aws. Amazon correto is a jdk which am using

[@nadiaqoudhadh4863]

🎯 Key Takeaways for quick navigation: 00:00 *Understanding Google Cast* 00:29 *Microservices communication* 00:58 *Importance of separate applications* 04:55 *Log Tracing Using* 05:18 *Doesn't Support* 05:42 *Service Name* 05:55 *Dependency Updates* 06:11 *Spring and Dependencies* 06:28 *Enabled to Import* 06:39 *Good Two Products* 06:56 *Cloud and Register* 07:09 *Fine Payment Services* 07:22 *Good Base Here* 07:35 *Base and Care* 07:49 *Give the Path* 08:04 *Registered Services* 08:30 *Services President Tried* 08:42 *Good Care Service* 09:03 *Service Not Able* 09:18 *Click Switch Off* 10:16 *Last When Is* 10:50 *Trace Your Service* 11:01 *Service Differences* 11:14 *Trace Your Services* 11:30 *Microservices Variations* 11:52 *Service Stability* 12:05 *Feel Good Service* 12:28 *Track the Requests* 12:42 *Click Off Services* 12:55 *Payment Service Request* 13:07 *Follow Service History* 13:21 *Dependency Satisfaction* 13:35 *Order and Payment Services* 13:49 *Multi-Microservices* Made with HARPA AI

[@swagatdishri749]

Very helpful and interesting topic.Thanks

[@harishk8664]

Please make one video on splunk framework.

[@krishnamohan5771]

What is the purpose of sleuth dependency?

[@sathiskumarp]

Nice explanation. Thank you

[@mannut1209]

centralized logging vs distributed logging

[@utsavvatsa6705]

Please keep playlist link in the description. Becomes very helpful when randomly ending on a video from a search

[@Javatechie]

Its there in video description utsav

[@ravindranathareddygr8703]

Hi Sir its very useful to see Microservices Ecosystem integrated. For this series could you please add OAuth2 for Security. Please do a video on OAuth2 sir and a video for this series.

[@Javatechie]

Yes am trying jwt to integrate in same microservice series

[@manoharsitaram3300]

really outstanding learned some decent stuff.

[@vinodgoud9539]

You are doing great job, which one to prefer ELK or Sleuth for distributed logging

[@Javatechie]

Both having different purposes Elk used for centralize logging where sleuth used for distributed tracing

[@henrymoravillarreal4665]

Awesome video man, really helpful!

[@sathiskumarp]

Hello sir, In the production environment I wanted to see the number of microservices hit and payload for each request. How do I get it?

[@Javatechie]

Use ELK or check in splunk

[@sathiskumarp]

Thank you for your response. So, In splunk we can track the total number of hits for each service. What is ELK?

[@Javatechie]

Buddy please search in my channel you will get both the content

[@governmentexams1416]

How can I persist all log for long time

[@girishathanikar7967]

How to hold historical logs on zipkin ui

[@Ramkumar-uj9fo]

While both involve deduction in some sense, they operate in different domains and contexts. Data science focuses on deriving insights from data through statistical analysis and machine learning techniques, while Spring Sleuth is specifically designed for tracing and monitoring the flow of requests through a distributed system.

[@unemployedcse3514]

I think u could have even showed tracing failed request also ,any ways good tutorial 😊

[@sebkounta2831]

Really Appreciated !! Thanks a lot

[@tejassontakke8382]

Hello @Java Techie, your tutorials help a lot from a learning perspective. Thanks for posting such constructive and hands-on tutorials. Just one query regarding this tutorial, Is it possible to check the request payloads on the Zipkin UI portal while tracing the request when the request is traversing from around various microservices using the sleuth and Zipkin. Please let us know. Thanks in advance.

[@Javatechie]

No we can't view payload use elk and check complete request payload in kibana log

[@tejassontakke8382]

@@Javatechie sure. Thanks.

[@vikashgupta-kj4qq]

Excellent, How can we identify or relate (span -> microservice version) which microservice instance is creating the problem. Like : SpanId : ftyytyuiyi -> Microservice A : v1 SpanId : dsfsdffs -> Microservice A : v2

[@RaviVerma-bg6ul]

great video mannn. thanks

[@yashrao7236]

Hi Basant, I've been watching many of your videos and those are very helpful. Thank you. My question is, Will sleuth-zipkin work across kafka ? Elaboratively, one microservice is pushing data to kafka and other microservices are reading the data from kafka. Will this approach for distributed tracing work in that case? If not, then can you please suggest how can we work around. I've heard Jaeger has capability to do it. Please make tutorial on that .🙏

[@Javatechie]

Am not sure whether we can use this distributed tracing using Kafka or not .

[@yashrao7236]

@@Javatechie sir if you know some other approach then please create video for that also

[@Javatechie]

Sure I will try to explore about this

[@muninkumbhakar3887]

Very nice explaination!

[@ajay-lu5gh]

nice.. thank you..

[@Kaushikraj9845]

Thanks. The Examples/scenarios are for synchronous model..will it work for asynchronous and non spring boot applications?

[@naragoud428]

well explained..Thanks .

[@Arun-zy8wi]

God bless you man

[@arunlepuru]

can you create one video please for one flow from controller to database to show in the zipkin trace

[@Javatechie]

Zipkin used to track microservice api call not application flow

[@arunlepuru]

@@Javatechie ok..actually need to trace JPA repository what is the method it called when flow start

[@Javatechie]

Create your custom metrics using reflection api or use spring app around advice on repository later

[@terencechia9986]

Does it matter if I use in spring.zipkin baseUrl instead of base-url in the application properties?

[@T_Sub4ik]

thnx bro

[@sauravdubeydam]

Need help regarding new relic logs how to push the logs to new relic

[@Javatechie]

I am not aware that relics will check and update you

[@stormgamingworld1430]

Bro can you make a video to implement message queue for the above project .i have do the project but i want to add message queue approach

[@dharmendramaurya7741]

Awesome Video

[@razatech22]

You're very kind hearted man... Love your videos

[@Javatechie]

😀 thanks Ahmad

[@thoeunkimhab3772]

nice One 🎉

[@imanmohammadpour3808]

docker exec -it javatechie ls /data/spring-related-tutorials

[@kishordige9721]

Thanks

[@abanisahoo5926]

Very nice video 👌

[@aalsicoder2333]

can you add tutorial to containerize this project using Kubernetes.

[@tejabtitare5169]

Awesome 👍👏

[@ameerm7894]

Excellent

[@TELUGUABBAYITAMILPONNU]

Thank you so much for great videos.. what happens when other external services not implemented zipkins or sluth .. Second question is does we able to see external services logs if they are implementing same log trace plugins

[@sarojsahoo8763]

But in real time it should be a separate spring boot project i guess

[@priyhanspriytam1813]

Excellent

[@abanisahoo5926]

Thank you so much sir🙏