Elasticsearch + Docker Compose: Part 2 - Elastic Agent, Fleet Server, APM

[@evermightsystems]

Written Summary Here: elasticsearch.evermight.com/docker-elk-2-agent-fleet-server-apm

[@ClausPolanka]

Thank you so much for this video. Great job in explaining.

[@valeriyisaev251]

Thank you, tracing worked. I can't configure sending metrics from a C# application. The created metrics and .NET platforms do not arrive. Can you tell me what the reason is?

[@evermightsystems]

Thanks for your message, i haven't tried instrumenting a .net app yet. You can send us samples of your code via email and I'll let you know if i see anything obvious. You can contact us through website here: evermight.com/contact, then we can start exchanging emails

[@davidlovrity4841]

Amazing Videos, I am curious about 1 thing. around 10:08 mark you are updating the output on the fleet settings page. however, the fleet server hosts never gets updated. when you go to add additional integrations it sends you back there so you can add the URL, for enrollment purposes. should I be installing the Agent that it wants on the machine Directly or do we do it via the docker-compose yaml? Thanks again for all these videos.

[@evermightsystems]

Thanks for your comment. I produced a follow up video on doing integrations: kzbin.info/www/bejne/fnvRZIungdZmfsk Hopefully that answers queston? If not, just send email through our website because youtube keeps skipping my comment notifications

[@incongnito12]

heya thanks so much for your vids. just asking.. do you mind doing a video on the ssl / tls side of things? i have a self signed certificate for my spring boot application which the elastic agent needs to access (via an integration) but constantly fails -> due to error x509 signed by unknown CA

[@evermightsystems]

Make sure your self-signed certificate was signed by your own CA, or some how have your elastic agent be able to use the same self-signed certificate for verification. Send me email through evermight.com/contact if you need extra assistance!

[@dave8826]

Thank you, one question, where do you change the JVM heap? it's set to 1.4 GB by default

[@evermightsystems]

I haven't done it before, but according to this documentation, for test purposes you can do this: www.elastic.co/guide/en/elasticsearch/reference/current/docker.html You just need to set envrionment variable ES_JAVA_OPTS in your docker compose with the appropriate parameters. For a production-like use case, you can follow these instructions: www.elastic.co/guide/en/elasticsearch/reference/current/advanced-configuration.html#set-jvm-options Meaning you bind mount the directory /usr/share/elasticsearch/config/jvm.options.d/ through tyour docker-compose settings. THen you can add any options to the jvm.options.d directory Hopefully that works! if you ned more assistance, just contact us through our website to schedule an online collaborative session evermight.com/contact

[@dave8826]

@@evermightsystems Sure, I added to the docker-compose.yml configuration below enviroments, but also you need to give more RAM to elasticsearch in the .env configuration also. Thanks!

[@asifkhan-rb8tl]

thanks brother

[@CharakamVeeraDeshik]

I'm getting queue is full in apm logs, getting 503 Can you please explain why this problem is occurred

[@evermightsystems]

You would need to open the log files and see what they show. To support you, please email us through our website and you can attach the relevant elastic agent log files. Thanks!

[@mathas604]

Thank you for the video. Appreciate it. Maybe later you can show us how to do parsing in logstash for container logs. Which is the filebeat input is docker type. Example filebeat monitor nginx @ keycloak container

[@evermightsystems]

Apologies for late reply! Thank you for suggestions ! I plan to have a more focused logstash lecture series once we hit 2000 subscribers! Hopefully we get there!

[@krissemmy]

Nice work 👏🏾👏🏾

[@Shaq2k]

In theory; great stuff. In reality, your video or written code is not possible to follow Part 1 didn't work at all Part 2 works partially, but: you refer to containers with es-cluster in the name, but none of the containers contain that. They are named es-filebeat01-1 for example At some point in the written guide I'm told to go to Observability > APM > Services, but there is nothing there, so....

[@evermightsystems]

Sorry it didn't work in your case. Perhaps the next video that gives line by line explanation of the codebase will be useful? If you need assistance you can email us. Thank you!