Building a Large Scale Multi-Cloud Multi-Region SaaS Platform with Kubernetes Controllers

Don't miss out! Join us at our next Flagship Conference: KubeCon + CloudNativeCon North America in Salt Lake City from November 12 - 15, 2024. Connect with our current graduated, incubating, and sandbox projects as the community gathers to further the education and advancement of cloud native computing. Learn more at kubecon.io
Building a Large Scale Multi-Cloud Multi-Region SaaS Platform with Kubernetes Controllers - Sébastien Guilloux, Elastic
Controllers in Kubernetes are implemented through a pattern that reconciles entities towards their desired state. This pattern can actually be extended to cover a large set of use cases, beyond the scope of Kubernetes, while still relying on Kubernetes libraries such as controller-runtime. Come learn how Elastic is building a large-scale multi-cloud multi-region platform on top of Kubernetes, and what design decisions it led to. In this presentation we’ll describe an architecture made of hundreds of Kubernetes clusters, and talk about the challenges we have faced along the way. For example, by going into some details about how some of our controllers don’t actually work with etcd and the apiserver as their backend. They use a different datastore, and reconcile resources in different clusters than the one they are deployed into. We’ll also describe how some CNCF tools help achieve that scale (ArgoCD, Crossplane, Helm, Backstage, cert-manager, etc.).