Mastering Chaos - A Netflix Guide to Microservices

Want to attend #Qcon or #DevSummit for free? Here's your chance!
Write an article for #InfoQ and you could win a ticket! Show off your expertise and contribute to the tech community.
Join the contest now: www.infoq.com/articles/infoq-...
💪 Knowledge is power!
#ArticleContest #TechArticles #WinATicket
----------------------------------------------------------------------------------------------------------------
Josh Evans talks about the chaotic and vibrant world of microservices at Netflix. He starts with the basics- the anatomy of a microservice, the challenges around distributed systems, and the benefits. Then he builds on that foundation exploring the cultural, architectural, and operational methods that lead to microservice mastery.
Download the slides & audio at InfoQ: bit.ly/2m1dqeA

[@StingSting844]

Can't express how high quality this talk is. Wonder if he was a teacher before!

[@jordantaylor8549]

Yah I was wondering the same thing . Very top tier presentation and speaker

[@JamesJansson]

When you are the lead developer for a large org, it is your job to be an educator at a high level.

[@ThunderAppeal]

Youre full of shit. You have no idea of any of this.

[@yahorsinkevich4451]

I would say this is a perfect talk that describes how to writer microlyth and how NOT to design microservices based arch

[@StingSting844]

@@ThunderAppeal Yeah thats why I have come here to learn!

[@PeterMoueza]

A timeline : 12:30 EVcache client 16:05 Hystrix Tests 17:55 combinatorial 23:07 consistency 24:53 multi regions failure 26:20 stateless 27:45 stateful 28:40 cache Squid 30:00 EVCache 39:20 API Gateway 45:00 Actions 45:40 AWSreinvent 48:00 RCP 49:20 Conway's law 52:49 cache caching

[@ardonjr]

Tip: Replace the 'mn' between the numbers for a colon like so: 12:30 because that will create real timestamps ;)

[@PeterMoueza]

@@ardonjr Good advice, thank you !

[@tanveerhasan2382]

Bless your heart

[@PeterMoueza]

@@tanveerhasan2382 Thank you so much

[@erikbaldwin3049]

Zo

[@sandy.aggarwal]

Watched again 3 years later and it's still so relevant.

[@Inquisidor9408]

it doesn't get old

[@sundeepreddythirumuru5266]

One of the best talks I have seen on building systems of high scale, high availability, failure resilient and agility in undergoing change.

[@arthurkeech]

One of the best technical talks I've ever seen.

[@ErnstFluttert]

Great talk, which is still relevant in 2020! Especially the practical examples, and the solutions they applied. Loved the analogy with the human body. Thnx Josh!

[@Mike.e]

Excellent talk. Envious of your delivery! Thank you!

[@OliFubar]

I am sad I found this 3 years late, I've been developing microservices for the past 3+ years but I still learnt a lot from this. A huge belated thanks to you Josh!

[@sairampareek]

And I found this 3 years later you commented

[@martinmogusu]

This is a really informative talk on microservices, with real challenges and real solutions. The human body analogies make a lot of sense, there's a lot we can learn from nature...

[@tidal4774]

One of, if not the most comprehensive and analogous talks on the subject with relevant, real world stories from someone who has lived it. Thank you.

[@clarkpeng8106]

what I've learnt important from this video is keeping perfecting your tools & architecture.

[@ashimov1970]

1:51 "how amazing the human body is and how something as simple as an act of breathing or interacting with the world is actually a pretty miraculous thing. And it’s actually an act of bravery to a certain extent. There are so many forces in the world, so many allergens and bacterial infections and various things that can cause problems for us." - watching this on Feb 12, 2021 makes me admire this guy and the company he dedicated part of his miraculous life.

[@souvikghosh8068]

I come back to this video once in a while to remind myself how cool the software engineering can be.

[@igrai]

very good and a very open talk, no generalities - really an insider's look into these challenges - awesome!

[@sirnawaz]

Brilliant talk! ... and the references to the various biological systems of the human body, throughout the talk, makes it even more interesting. It is amazing to see how various aspects of microservice architecture find similarities with other things created by the nature itself. On a microscopic level, we can draw analogies to the multiple-core, memory fences and cache-coherence as well.

[@gashinamu]

One of the best tech talks I've ever watched.

[@infoq]

Happy you like it. You can find more on www.infoq.com/

[@wartem]

good stuff

[@OrdinaryFemmale]

this beast is *ONLY* working for netflix for the last +20 years, that's pretty amazing! thank you for this video, great presentation!

[@jegtugado3743]

This talk is amazing. I'm far from being a system architect but this gives me a bigger perspective on how amazing systems like Netflix is built.

[@joechen2800]

Using organization as examples are really self-explanatory. Brilliant talk!

[@bdpyne]

Really fantastic talk. He used analogies well, making abstract concepts more concrete. My most important takeaway was the evolving nature of architectures. Architectures are challenged both by external factors (customers) and internal factors (operations, customer support, etc.).

[@cardboard3161]

Speaker: "Breathing is a miraculous act of bravery." 2020: "Challenge accepted."

[@Yusuf-ok5rk]

he is breathing in micro doses so that he can serve a continuous presentation

[@prakhargupta629]

Few years into corporate job and I had forgotten how many things are there in Computer Science. This talk brought me back to college.

[@midnightsyntax3333]

Excellent presentation! The slides are super clear and specific. 5/5 kernels

[@ChidambaramVelayudham]

Absolutely Awesome. Love the way how Josh presented. Appreciate you for sharing the knowledge.

[@CoolHandMikeYT]

This is a really great talk to understand problems and solutions with microservice oriented archtecture at a large scale.

[@apurvsawant5703]

This is one of the best videos to get insights into micro services architecture.

[@Patrickdaawsome]

Note to self: Write down summary starting from the 51:25. P.S. I watched the whole thing and absolutely loved it.

[@andrewferguson6901]

in case you didn't write it down where you could find it

[@jonopens]

Such a fantastic metaphor to communicate the intent of microservices. As a younger programmer, that really resonated with me.

[@infoq]

If you are interested in microservices content you can check our collection on InfoQ. www.infoq.com/microservices

[@UberOcelot]

As someone who doesn't deal with this side of architecture, this is a fantastic talk. Micro-services are just a division scheme, not really an architecture. To get things really running smoothly this provides some great insight to where the real work starts.

[@Innovate22]

The Alton Brown of software engineering nailed this presentation 👏👏👏

[@janicknorman9396]

Amazing explanation.

[@markmd9]

I just realized that on the globe we have more than 2 millions people that have interest in microservice architecture

[@CodewithRSV]

This should be mandatory viewing for anyone working in a microservice architecture.

[@usun_current5786]

This is the most useful presentation I've ever seen regarding large scale platforms. Shared in my org, hopefully we'll lift a lot from here for future extensions.

[@antonvedel3028]

His analogies to the human body make great sense. Awesome video. Thank you.

[@Newtube_Channel]

They dont.

[@somescams]

@@Newtube_Channel Exactly.

[@madd5]

They do. But a regular monolithic application can also be analogous to a living organism.

[@SartajHundal]

Turning Occam's Razor into a lecture. Well done.

[@andreelyusef3235]

We need more of these kind of lectures. Spot on sir please do contribute more.

[@cthackers]

"The structure of any system designed by an organization is isomorphic to the structure of the organization." Melving E.Conway

[@jidnyasadhavale6664]

So Informative. Tech talks are the best way to get insight into how huge applications are built, complexities involved, challenges and solutions.

[@a0flj0]

Actually, no. What you get, mostly, from tech talks, is various tech people advertising their pet technology, in a way that appeals to other tech people. If you really want to really get into big systems, find work on one, and do thorough research - tech talks are a good start, but often leave important things out, and only show you the pictures of the car's body, without teaching you to work on the engine. To learn about cars, you go to grease monkey school, not to car shows. The reason for our industry being insanely hype driven is probably at least partially that people expect to actually learn something from tech talks, instead of considering them simple pointers to start research from.

[@aceintheblackhole]

one of the best talks i've seen at any conference on any subject. i'm actually using it as a real-world resource for my system design interview preparation because it's very informative in many ways (especially for a beginner in distributed systems like me :) ). thank you for making this available!

[@ahmadbaiazid976]

probably one of the best guides on youtube for microservice arch

[@deepsue]

Thanks, this analogy, and learning is still happening and needs to be implemented in multiple applications/organization

[@LesterFD]

copying and learning from nature is always something beautiful. natural sciences like physics, chemistry do it since centuries. It's a good time for computer science to learn from methods, that are applied for many thousands of years.

[@JiaxinLiu]

Hystrix is very cool! Thanks for sharing!

[@AsimMittal]

One of the best tech talks period

[@the.abhisheksinha]

nicely explained .. I wish Netflix gets all such videos on Netflix and show us how do they architect and design their mammoth system

[@kibiz0r]

AKA: Obfuscating Chaos - A Netflix Guide to Creating Dysfunctional Organizations Basically, a dev noticed: Hey, these two components could benefit from having isolated processes. And a manager said: Wait, could this also be used to stop Team A from complaining about consuming Team B's code? Thoughtful dev replied: Well, it depends on the specific components... Some components are fundamentally coupled, so they can't survive a partition anyway, and introducing one for the sake of team boundaries will just create more technical problems without solving the underlying social problems. Manager blinked twice, and after he rebooted he said: But they'll shut up about each others' code? Dev: I mean, technically. They'll just complain about API contracts instead -- Manager: Perfect. Dev: -- which is arguably worse, because as soon as you have a multistep process or something involving callbacks or dependency injection, you have a huge mess, and that's even if you can sidestep the CAP theorem for all of your use cases, which is a really big assump-- Manager: Yeah, yeah, whatever. So how soon can we do this?

[@rogeliomoisescastaneda7396]

Amazing! thanks for sharing

[@AnotherDevelopersWorld]

Amazing talk, would definitely recommend this to anyone

[@thaituandat31]

I understand that Netflix is not only "NETFLIX" now. Thanks for your team, too. Amazing topic.

[@timriley1501]

How can anyone even give a thumbs down to this? Very interesting and informative video.

[@ankitsorathiya2304]

Thanks Josh, It was an insightful talk, Thanks for sharing how netflix evolved over period of time.

[@ybenihime8757]

Awesome stuff, after watching this in 2020, i got myself thinking what changed in the architecture to this actual year.

[@sathvikvutukuri9179]

The way you explained microservices referring human body is mind blowing. Yes nature is the biggest Wikipedia or GitHub of everything. How much we learn or analyse or extract knowledge decides human evolution.

[@himanipku22]

Thanks for reminding me I don't have to think about breathing.

[@lexdemonica]

Such valuable insight from an articulate and knowledgeable insider. TYVM

[@0011usagi]

Very great talk!

[@DeepakSharma_Tao]

Thanks Josh...very nice presentation!

[@fredveasley]

Excellent talk! Very informative.

[@sexysurd007]

Amazing concept, content, communication and presentation...

[@justdavebz]

This is gold!

[@madixit75]

One of the best tech talk👍

[@jaikantchandrakumaran3423]

Amazing talk! Great work Josh keep it up.

[@island_rhythms]

Awesome talk! Love it

[@DannyLIVEWIRE]

This was awesome! Thank you Josh!

[@OneMinuteNotes]

Its one of the best story regarding microservices implementation. Cool

[@vivekach1]

Thanks for sharing.. Awesome :)

[@stupidaccountlinking]

I'm loving the Zuul proxy layer. That's hilarious. A while back I wrote a program that required keys, and I named the keygen tool Zuul. (Also made it play some chiptunes for historical reasons)

[@ronfisher4751]

Very good stuff Josh you are a smart man and a great presenter of complex information

[@eugeneleroux6140]

Superb video - thanks!

[@andreeadianaratiu5091]

Great presentation and nice analogies.

[@Vietnamkid1993]

Amazing talk!

[@udensijoshua9024]

Awesome delivery. This content is divine

[@p3k1n0]

I could watch an entire season of this stuff. Way better than the standard Netflix products.

[@dorcohen3522]

A disclaimer: if you don't have to scale different parts of your application independently, don't bother to go microservice. It won't solve any of your issues. Splitting an inherently coupled monolithic application will turn it into a distributed one, which is worse by any metric. Domains should be loosely coupled with or without microservice architecture. If your monolithic application is modular enough, there should be no problem to deploy it separately whenever needed.

[@emmanuelgelatimesa2712]

The best presentation ever :)

[@pumbo_nv]

Wow. That was impressive. He has really interesting job.

[@raghavendrakrishnamurthy4041]

Awesome presentation!! Top class!

[@sribalajirao]

Awesome post.. really worth viewing..

[@jasonamaroreinert4499]

Great work. I know most of all of this content (whoopdie do I know), have been building microservices (via a standard reverse proxy/load balanced REST API-first architecture) since 2007, and yet this is still an amazing watch and important to keep instilling. That's because knowledge isn't a one-time thing, or a time-oriented thing at all but rather a means to solidifying a way. I love that this content is out there and presented this well because these stories are still happening out there even 15-20 years later!

[@prashanth0458]

I read the news of netflix introducing own bugs into their own system to make it more efficient long back, today I am watching how it is done. Good video with latest technological stuff like redundancy is good, bugs infection, support for multiple languages, region server failure routing etc..

[@OwaisAhmedMuhammad]

Simple and valueable. A very nice and practical talk on Microservices

[@andrewmadge]

Great video! thank you for putting this on youtube

[@Larry21924]

This is absolute perfection. I recently read a similar book, and it was absolute perfection. "Mastering AWS: A Software Engineers Guide" by Nathan Vale

[@pradeeprao822]

Amazing stuff..Thanks for the video :)

[@kim-uk1wv]

For shared client libraries. What about requiring each service to make their own wrapper classes/library that only exposes the parts they need. Then, to make it safer against changes, they also create their own unit-tests for their wrapper classes? Or if they use almost the entire client library they could just create their own set of unit-tests for the original library and skip the wrapper. When a shared client library is changed its test runner runs all the different wrapper library unit-tests. Then if anything brakes they can just contact the team responsible for the service owning the broken tests and work out a solution together.

[@a0flj0]

How do you solve API versioning and transitive dependency conflicts in the same library? He explained pretty well what the problems with shared libraries is.

[@mingjunduan5916]

Amazing

[@deathbombs]

19:40 dodged getting Yahoo'd

[@ronaldogeldres1969]

Love this video

[@conduit242]

"It started out innocently enough with Python..." So many things do...🤣

[@igatmatthew2283]

Innocuously*

[@lour.222]

scrapy comes to mind.....

[@parthyadav01]

@@lour.222 hahaha...

[@gbrivate]

Well done.

[@chrisalister2297]

Built my system on MS ASP back in 2002. I was already using something more or less like micro-services and using ASPCache(like EVCache). Competitors would have issues/shut downs while mine systems kept trucking along with very little down time. Think of worker ants in colonies. All working towards a common goal.

[@luisdmoralesh]

really good talk still in 2024 if you're new to microservices

[@joelsosa5894]

Awesome :)

[@tobiasfuchs7016]

2:33 This visualization so beautiful and mesmerizing, and you immediately get the human body analogy. The whole presentation sure was hard work, and well worth it.

[@guseynismayylov1945]

it's not accurate though, it shows that microsevices are one directional, which is not true.

[@mattcargile]

Man! I really feel sad watching this like I missed the technology boat to be a part of something incredible! Like my life will never mean as much as this talk.

[@letscifucan]

This Lecture was awesome.

[@CornerPocket1]

awesome discussion !

[@chungyuwaiki]

Great talk and hope i will understand much more years later.