GopherCon 2022: Rebecca Bilbro - How to Build a Distributed System (and Should You?)

This talk tells the story of how we used Go to build our very own, eventually consistent, distributed system, currently deployed in production clusters across the US, Germany, and Singapore. As our system is described, key topics will be introduced that you’ll need, to understand distributed systems in practice (e.g. replication, consistency, and consensus). We will walk through how our team leveraged tools like gRPC, Kubernetes, LevelDB, and Prometheus to implement two new open source projects that serve as the heart of our system. Confessions of all the ways we messed up will also ensue - from struggling to debug protocol buffer errors, to tangling up send and receive goroutines, to reasoning about the phases of replication. Finally, Rebecca will explain why rolling out their own system made sense for their use case, and why it might also make sense for you. It won’t be the prettiest story, but we hope you’ll benefit from the lessons we learned, including the most important one - that you can build your own distributed system.

[@myrachoantonio8832]

that was amazing! thank you, CAP is all about the decisions and company preference huh!

[@davidkarr1034]

It would have been useful to mention the strategies you did not use. For instance, hearing all of your distributed database implicit requirements, I was surprised to not hear Apache Cassandra mentioned. It fulfills all of those obvious requirements.

[@zeevallin]

Really valuable learnings. Thank you for the talk!

[@hectoralvarado9778]

Great talk. Reflection of how we usually start to build our systems and the challenge, wrongly done and big monetary consecuences haha

[@GabrielPozo]

It's a really interesting talk, thanks for sharing!

[@rfyiamcool4878]

good talk