How Slack Works

  Рет қаралды 154,951

InfoQ

InfoQ

Күн бұрын

Пікірлер: 52
@zss123456789
@zss123456789 4 жыл бұрын
*Timestamps* 0:00 Intro (Keith Adams) 1:26 Agenda 2:37 Scale and Style 6:18 Architecture Overview 8:19 Logging in 14:11 MySQL Shards 18:18 RTM.start payload 19:51 Message server 24:32 Deferring Work 27:39 Putting it all together 31:41 Challenges 32:59 Challenge 1: Mains Failure 34:14 Challenge 2: Rtm.start for large teams 35:02 Challenge 3: Mass reconnects Plan of attacks 35:50 Scale-out mains 37:04 Rtm.start for large teams 38:33 Mass reconnects 41:45 Stuff left out 43:19 Wrapping up 44:20 Questions
@pathoslp
@pathoslp 4 жыл бұрын
🐐
@cerberuspandora
@cerberuspandora 5 жыл бұрын
I love how honest this guy is
@ridhwaans
@ridhwaans 4 жыл бұрын
which part
@wonderstruck.
@wonderstruck. 3 ай бұрын
Very interesting talk. Usually you hear people from huge established companies discussing massive arch migrations, or brand new startups showing off their flashy new stack. This was a very humble, grounded talk on what it’s like to work in a real system architecture-what works for them, and what could be improved as they scale.
@tommyls4357
@tommyls4357 2 жыл бұрын
I love how articulate he is. He comes across as a smart guy. I'd like to work with him.
@BillaCode
@BillaCode Жыл бұрын
I realised after 4 years of experience working in software field, I still don't have basic knowledge of making a high scalable app. Great video, thanks for sharing this great knowledge
@sanjay_nk
@sanjay_nk 4 жыл бұрын
Handling great scale with simplicity in design. Excellent !!
@Super21Nash
@Super21Nash 4 жыл бұрын
Slack in 2016 was a pretty new app, and I completely respect the devs decisions to favor faster deployment. I have experience with a product which is almost 10 yr+ old and - we are still scrambling for DB alerts.
@nitrovent
@nitrovent 3 жыл бұрын
I feel with you. We have a large SharePoint Farm solution that is ~10 years old we work on
@janvikalra_
@janvikalra_ 4 ай бұрын
SUPER insightful and detailed deep dive. thanks for sharing!
@simonc997
@simonc997 3 жыл бұрын
At 18:00, can someone help me understand what he means by the left and right heads, writing left and writing right?
@karana2260
@karana2260 3 жыл бұрын
active-active can run into collisions when same data is updated in both parallely. Think your profile updated from phone and laptop simultaneously and one gets updated on Master1 and other on Master2. which one is the correct one? Time stamps could solve these collisions but manual intervention is needed sometimes there too. To solve this I think they have partitioned the queries (based on team id Keith says, but I think it would be more complex ) such that certain group goto Master 1 only and nver to master 2 , and vice-versa. Avoiding conflicts.
@zacklight
@zacklight 2 жыл бұрын
​ @Karan A Yeah it made no sense if the parition was just based on teamId because in that profile example the teamId's should be the same and so both requests go to the same master without introducing any conflict...
@shimaozheng9968
@shimaozheng9968 2 жыл бұрын
@12:19 what does it mean when he mentioned the time to the shard is arbitrary? It means it just randomly picks up a shard and record it? What's the benefit of doing in this way vs. consistent hashing?
@gilad-drori
@gilad-drori 2 жыл бұрын
Maybe due to the thundering hoard effect.
@augusto3113
@augusto3113 5 жыл бұрын
I just wish the "Microsoft Teams" would watch this and learn to not suck
@arunsatyarth9097
@arunsatyarth9097 4 жыл бұрын
There is nothing great about this design btw.
@lattelover7186
@lattelover7186 4 жыл бұрын
@@arunsatyarth9097 No need a fancy architecture if the classic one get the job done and still easier to maintain.
@arunsatyarth9097
@arunsatyarth9097 4 жыл бұрын
@@lattelover7186 I didnt say the word "fancy". I just said there is nothing in particular here for Teams folks to look at and learn as OP suggests.
@YourAliasIsNotAvailable
@YourAliasIsNotAvailable 3 жыл бұрын
@@lattelover7186 "easier to maintain" on a 1M loc monolith php app... Do you even code?
@pengdu7751
@pengdu7751 4 жыл бұрын
this may be a dumb question but why is there a message server in the first place? why a separate service?
@omerocak4710
@omerocak4710 4 жыл бұрын
search "control and user plane separation" on google. it has many benefits. efficiency, security, isolation, capacity, scaling, easy managing, maintenance, failure-handling, etc.
@NickolayKutovoy
@NickolayKutovoy 4 жыл бұрын
I will not be surprised that it wasn't easy to support websockets/two way communication in LAMP at that time and this was easiest/fastest solution
@while-loop
@while-loop 3 жыл бұрын
Also likely to handle live websocket connections. You can only support 65k connections per server so scaling 80 full blown web apps just to handle dumb websocket connections may be overkill.
@nindinindi6405
@nindinindi6405 2 жыл бұрын
Nice
@neuemage
@neuemage 7 жыл бұрын
Discord is best team app
@fuhuoyeyou
@fuhuoyeyou 4 жыл бұрын
too honest.
@tenshi7angel
@tenshi7angel 5 жыл бұрын
Would prefer to use Discord, but beggars can't always be choosers. Oh well.
@lokthar6314
@lokthar6314 6 жыл бұрын
a PHP Monolith? Slack is a really great piece of Software but those design decisions though..
@8Trails50
@8Trails50 5 жыл бұрын
Their team was experienced with PHP. Time to market is key. Everything else is overrated for a start up. Now they can do whatever they want since they are successful.
@tejaswis2755
@tejaswis2755 2 ай бұрын
40 times a day of code push 😮
@Textras
@Textras 6 жыл бұрын
ahh GDRP
@emrahteamwork2583
@emrahteamwork2583 2 жыл бұрын
GRPC or GDPR?
@James-mk8jp
@James-mk8jp 5 ай бұрын
Slack is slow as sh*t great job keith
@o1egm
@o1egm 6 жыл бұрын
Very poor design...
@TremendousSax
@TremendousSax 4 жыл бұрын
What's poor about it?
@yvrelna
@yvrelna 2 жыл бұрын
It's not a poor design. It's a design that allowed Slack to scale from a small start-up to one of the largest and best communication platforms. It's a very successful design. Good architecture and good design isn't one that contains all the hip buzzwords. Good designs are often very boring, and that's ok. That means an adult is in charge of the operations, not the hippies who sprinkled the latest immature fad and then leave the mess to someone else. The result is what matters, Slack is a very slick communication platform. Its architecture design may not contain sexy buzzwords, but it is what allows it to outshine all the other competitors who have buzzwords-driven design. That's not a "poor design".
@wonderstruck.
@wonderstruck. 3 ай бұрын
It’s a very real design. You wouldn’t pass a system design interview with this, but it is what you’ll likely find on Day 1 of your new job. It’s nice to know the design decisions of real systems and what could be done better.
@VahidOnTheMove
@VahidOnTheMove Жыл бұрын
Poor presentation. He shows a slide and talks about something else.
@Dstonephoto
@Dstonephoto 3 жыл бұрын
Sweet lord, this is the most SV-esque mumble job ever.
@ronysaha3966
@ronysaha3966 6 жыл бұрын
Flock is better
@jvm-tv
@jvm-tv 3 жыл бұрын
It works for them and obviously a successful product but God! what a boring architecture! I wouldn't want to work there.
@phenomenal325
@phenomenal325 Жыл бұрын
Lol is slack still even a thing or in business? Pretty sure the markets owned by Microsoft teams now.
@SreeAn
@SreeAn 4 жыл бұрын
too boring, nothing much to learn for people preparing for system design interviews. I wasted 20 minutes, don't do that mistake.
@zbbentley
@zbbentley 4 жыл бұрын
...learning about the architecture of famous, successful companies making bags of money isn't applicable to system design interviews? Boring is *good*. I give system design interviews. I give massive points for boring, easy to operate, and easy to understand.
@igboman2860
@igboman2860 3 жыл бұрын
@@zbbentley and cheap total cost of ownership. ie cheap to build and maintain
@adityashah133
@adityashah133 3 жыл бұрын
Who do we have here? Someone who's too smart for our entire era. The title clearly says how Slack works or at least worked at the time this video was made. Now, since you found this video boring, assuming after coming here yourself, I wouldn't ever want to hire you adding already to the fact that you watched this video for preparing for a job interview? For system design? The whole idea of system design is that it may be different for every product, and you need to build one depending on what resources you have, what your timeline is and most importantly, what you really know for sure, say the fundamentals. If there was a standard and a fixed path, I'm sure this video wouldn't even exist. You wasted 20 minutes, but to everyone a favor and don't take any interviews. You wouldn't want to waste their time too.
@vishanthbharadwaj
@vishanthbharadwaj 3 жыл бұрын
Point is if u see this design u should have enuf knowledge to figure out the flaws and improve it on ur own
@foreverursabhi
@foreverursabhi 3 жыл бұрын
He didn't go in very deep, I'll give you that, but if you really found it boring, you'd not be trolling KZbin trying to win SD interviews. Let's chalk it up to the fact that you didn't hear some fancy words you might have expected, like Kafka, Cassandra, leaderless replication, and consistent hashing.
The Evolution of Reddit.com's Architecture
33:11
InfoQ
Рет қаралды 92 М.
小丑教训坏蛋 #小丑 #天使 #shorts
00:49
好人小丑
Рет қаралды 54 МЛН
Une nouvelle voiture pour Noël 🥹
00:28
Nicocapone
Рет қаралды 9 МЛН
Mastering Chaos - A Netflix Guide to Microservices
53:14
InfoQ
Рет қаралды 2,3 МЛН
Building Real-time Apps with Go | Azim Pulat
54:58
Azim Pulat
Рет қаралды 64 М.
Real-Time Delivery Architecture at Twitter
43:34
Parleys
Рет қаралды 57 М.
Scaling Instagram Infrastructure
51:12
InfoQ
Рет қаралды 283 М.
Managing Data in Microservices
52:07
InfoQ
Рет қаралды 142 М.
OAuth 2.0 and OpenID Connect (in plain English)
1:02:17
OktaDev
Рет қаралды 1,8 МЛН
Architecting a Modern Financial Institution
49:46
InfoQ
Рет қаралды 79 М.
Scaling Pinterest • Marty Weiner • GOTO 2014
45:53
GOTO Conferences
Рет қаралды 26 М.