I thought native histograms would be promoted to stable on this major release. Nevertheless, exiting times ahead for this project!
@OpenObservabilityTalks3 ай бұрын
Exciting times indeed! thanks for following the show
@horovits3 ай бұрын
don't lose hope, the GA is still not finalized ...
@sergiykulanov58373 ай бұрын
A big thank you to this podcast for shedding light on such practices. We've harnessed the power of CNCF's open-source tools to enhance our CI/CD pipeline's observability, explicitly using a "Tekton (CloudEvents) --> FluentBit --> OpenSearch" scheme. This setup lets us capture many metrics, shedding light on the development process. It has transformed our CI/CD analytics, helping us make better decisions and refine workflow processes. I highly recommend exploring this approach for anyone looking to boost their pipeline's transparency and efficiency using open-source CNCF tools.
@horovits3 ай бұрын
thanks for the feedback, glad you liked the episode! Which organization are you at, using this stack? BTW you mentioned using CNCF tools, but just for accuracy - from the stack you mentioned only FluentBit is on the CNCF. Anyway all are solide open source projects 🙂
@sergiykulanov58373 ай бұрын
@@horovits At KubeRocketCI, we use Tekton as our workflow engine. Honestly, Tekton doesn’t provide out-of-the-box rich pipeline analytics. The only build-in metrics are those related to controllers and basic ones. Solutions like Prometheus and OpenTelemetry can be used to collect these metrics. But we’ve adopted cloud events. You can build multi-dimensional reports by adding Kubernetes labels or any other metadata. For example, what is the average build time for a Java application, the slowest pipeline step, etc.? Another CNCF project, External Secret Operator, has been widely adopted to make real GitOps with Argo CD.
@Techy_Adi4 ай бұрын
Really Insightful!
@sabertabataba5 ай бұрын
discusses recent updates and advancements in the Prometheus ecosystem. It covers new features, integrations, and tools that enhance Prometheus's capabilities for monitoring and observability. Key topics include improvements in data storage, querying, and visualization, as well as updates on related projects and community contributions.
@GustavoPantuza9 ай бұрын
Great conversation! Very clarifying.
@Bourn779 ай бұрын
David never disappoints. Good session.
9 ай бұрын
Great talk! Thanks
@horovits9 ай бұрын
Thanks!
@iliyastrakovich Жыл бұрын
Thanks!
@OpenObservabilityTalks Жыл бұрын
glad you enjoyed the episode!
@danielerea8703 Жыл бұрын
Open Source -> Open Tofu -> Open World 🎉🎉 GREAT!!!
@marloraske5203 Жыл бұрын
Promo SM 😳
@ivan8or Жыл бұрын
does collecting metrics take up enough resources to be concerned over only using 25% of them
@王磊-p3q Жыл бұрын
uses a lot!!!
@AndreyTulenev Жыл бұрын
Thank you
@amjads8971 Жыл бұрын
Guys really amazing discussion but who has time to go through an hour long session with just talking. I think some demos would be great if it can incorporated or share some architecture diagrams on devops implement workflows etc
@OpenObservabilityTalks Жыл бұрын
@amjads8971 thanks for the feedback, and glad you liked the discussion. OpenObservability Talks is in a podcast format, many of our followers consume it over popular podcast apps such as Spotify, Apple Podcasts, Google Podcasts and others. as such, the format is conversational, a fireside chat, while demos and diagrams lend themselves less well. The show notes oftentimes provide additional links with further written material or videos to augment the fireside chat.
@samzong Жыл бұрын
cool !
@aireddy Жыл бұрын
This session is very informative, Thank you George for clarifying differences between DevOps vs Platform engineering and importance of soft skills, collaboration with multiple teams.
@horovits Жыл бұрын
Thanks @Aireddy glad you found it useful. Curious to hear your perspective and experience with Platform Engineering as well!
@aireddy Жыл бұрын
@@horovits We are part of platform engineering team and takes cares of runtime environment, security controls, business continuity, Observability, secrets management, remediating vulnerabilities, fraud prevention and many more functions as part of the platform ecosystem. No matter what we call the name at the end of the day we don’t any customer impact In terms of availability, reliability, data protection and privacy.
@gelidvoum12072 жыл бұрын
Can you provide links/names of the projects you mentioned? Thanks
@OpenObservabilityTalks Жыл бұрын
Certainly, you can find all the links in the summary post by Horovits: logz.io/blog/prometheus-roadmap-latest-updates/
@matthines8882 жыл бұрын
Another fantastic episode, congrats on the big growth in '22!
@OpenObservabilityTalks Жыл бұрын
Thanks, glad to have you on our followers!
@rafb1452 жыл бұрын
bye bye Kyle Davis Amazon Web Services (AWS) Permanent Full-time · 2 yrs 4 mos Senior Developer Advocate - Bottlerocket OS and Amazon Linux May 2022 - Present · 8 mos Technical Product Manager / Senior Developer Advocate - OpenSearch Sep 2020 - Apr 2022 · 1 yr 8 mos Edmonton, Alberta, Canada
@OpenObservabilityTalks2 жыл бұрын
Prep work for the first release : discuss.opendistrocommunity.dev/t/preparing-opensearch-and-opensearch-dashboards-for-release/5567 New analytics features: opensearch.org/blog/feature/2021/08/streaming-analytics/ Observability plugin : opensearch.org/docs/latest/observability-plugin/index/ Service Graph processor in Opentelemetry: github.com/open-telemetry/opentelemetry-collector-contrib/issues/9232 Here is the OpenSearch roadmap on GitHub: github.com/orgs/opensearch-project/projects/1 Vision for OpenSearch Dashboards: github.com/opensearch-project/OpenSearch-Dashboards/issues/1405 Here is the issue on OpenSearch decoupling from the backend: github.com/opensearch-project/OpenSearch-Dashboards/issues/1388 Here is the vision on storage: github.com/opensearch-project/OpenSearch/issues/2578 OpenSearch operator : github.com/Opster/opensearch-k8s-operator Operator Roadmap : github.com/Opster/opensearch-k8s-operator/blob/main/docs/designs/dev-plan.md OpenSearch Meetup Main Page: www.meetup.com/OpenSearch/ Conferences: OpenSearch Con September 21st in Seattle: www.meetup.com/OpenSearch/events/285152025/ 1 month to Kubecon Europe: events.linuxfoundation.org/kubecon-cloudnativecon-europe/ o11yfest.org/ 2022.berlinbuzzwords.de/
@tinyentropy2 жыл бұрын
great insights, thanks. where do I find the links, though?
@OpenObservabilityTalks2 жыл бұрын
They are in the chat replay but I am going to post them here in the comments too.
@jkowall3 жыл бұрын
Nice discussion. I’m surprised the profiling that APM tools have been doing continuous and dynamic profiling for 10+ years were not included in the discussion.
@iogbole2 жыл бұрын
He mentioned sampling profiling at 17:42 . The other type of profiling that APM tools have been doing is called instrumentation profiling, and it has a few drawbacks: 1) Bytecode instrumentation - Continuous profiling using eBPF doesn't require instrumentation. No interference/intrusion with the app's code. 2) High Performance overhead: Most APM tools will only collect traces at a pre-defined interval or when it perceives an abnormality based on pre-defined events (e.g calls per min is > x or standard deviation is > y) - these are all mechanisms to alleviate the performance bottleneck with instrumentation profiling. Continuous profiling, on the other hand, is "AlwaysON". You can sample the app at 100 times per sec if you like - at a low overhead. Again, thanks to the advancements in eBPF.
@OpenObservabilityTalks3 жыл бұрын
Resources for the episode: www.brendangregg.com/ebpf.html blog.px.dev/ docs.px.dev/about-pixie/roadmap/ www.businesswire.com/news/home/20210504005480/en/New-Relic-Joins-Cloud-Native-Computing-Foundation-Governing-Board-and-is-in-the-Process-of-Contributing-Pixie-Open-Source-for-Kubernetes-Native-Observability netflixtechblog.com/how-netflix-uses-ebpf-flow-logs-at-scale-for-network-insight-e3ea997dca96 logz.io/blog/istio-instrumenting-microservices-distributed-tracing/ opensearch.org/blog/update/2021/06/opensearch-release-candidate-announcement/ thenewstack.io/tracing-why-logs-arent-enough-to-debug-your-microservices/ www.theregister.com/2021/06/29/kubernetes_spend_report/