Do we have any Paid Data Structure and Algo Course ?

why not take advice from the others and redo the video on the kafka part

i didn;t get whats purpose of this video, cloud already fault tolerant , whenever i am designing something i assume its on cloud with two region. Other videos are nice , but sorry for this

Is it possible to just explain it in really simple way? After 6 minutes I still doesn't understand about what are you talking about. For the what reason you give this examples for SQL scaling problems for the whole video??? Redicilous...

Wrong information... Remove the video and make another one after study more about the technology

Its always nice to see visuals. Thanks mate. Keep up the good work :)

Thank you for the insightful video. However, there are a few things I am confused about. Any advice would be greatly appreciated: 1. Why do we need a WebSocket for Twitter? What are the benefits over SSE? We might encounter several related issues, such as how to handle recovery from a crashed server if we choose WebSocket, right? 2. How do you handle pub/sub with Kafka for hundreds of millions of users? Is your Kafka topic based on user_id? It seems like a giant chat room with all the users?

This is high level Design for my brain 🧠

Can you help to make an app like this, please contact

if topic A have 2 partition and 3 consumer in consumer group then 1 of consumer should wait and ask to leader to join the group

If topic A have 3 partition and consumer group have 3 consumer then 1 partion = 1 consumer if topic A have 4 partition and consumer group have 3 consumer then one of the consumer read from 2 partition and other 1=1 if topic A have 3 partition and we have 2 group of 3 consumers then each consumer of every group read from 1=1

dude this laser pointer is giving me flashbacks from school lmao

I understand so little yet it was so interesting to see how networking problems were circumvented

This video feels like it's written by ChatGPT. Some serious hallucination going on here

This is not so good.. No concept of Inverse index. Poor way of description. This is not web crawler

Why do you need blob store in first place. I just can't understand this part. Storing those web-pages isn't your job. You just need to count frequencies, Summaries of each pages. etc etc. To check, if the web-page is changed from your last visit, you can do checksum based optimisation,,, for each section of the webpage, create checksum, also, create checksum of entire page. This way, u can reduce memory usage on blob store.

I hope this channel grows exponentially. This is amazing content! Thank you, and well done! :)

I love this video. It's informative and really well made. I also love to read the comments on these videos as, no matter how good your architecture is, there is always something to improve. Looking forward to see an update on this (especially regarding the data extraction process). But once again. This is awesome content. Keep going :) :)

Though this video is good but it seems to be too simple and also shallow. I came here after watching your google search system design which seemed more complete. If possible please create an updated video with more details and precision.

I was having a feeling that I would have to crawl the youtube videos for a quality video on Google System design! But BRAVO! I find this video as the first video with the highest views. Great job!

I am fanning out after watching this video 😊

"Jupiter" name gives off final boss vibes

Excellent explanation and clear language! I'm starting out in Python and wanted to challenge myself. Thank you for the lesson!

awesome video dude!

RabbitMQ is push based model , consumer does not poll , rabbitMq tries to push as soon as it gets the message

what is the software used here to create presentations and interact with Apple Pencil?

Love your channel mate. Very helpful for interview prep

First view 😀

they got cooked on the Tyson fight

Can I ask what should a NoSQL database table schema look like? Should it looks like 0:05 ?

You say consumers when you should be saying consumer groups when talking about Kafka fanout. Otherwise a nice explanation

Great content. It is not clear how to fetch the user's tweet when the key is slowflake id and it is distributed over multiple nodes ?

What about emqtt

Why not Use CDC?

really nice :), thanks

Very good video! Thanks for sharing! One tiny thing, I would prefer NFS over Blob Store like S3 to keep the downloaded pages. A webpage will keep references to lots of resources, like json/css/javascript files. The bold/highlighted words are more important than plain text. That's very important information for ranking. If we don't keep the css files, those information will be lost. So we need to keep them together with the HTML file. It will be very complex to keep those information for multiple files in a single webpage in metadata if we use S3. So I suggest just download the web page with everything to a folder in NFS, and ask indexer to help themselves.

nitpick. We lost quantity when we went from model to table on order_product table

I'm still quite confused on why we prefer queue + Flink (stream processing) instead of just ingesting data directly from sources using spark.

I think you missed a huge aspect about when you to choose between SQL vs NoSQL. At the end of the day, its more about picking the right tool for the job, and less about the scale of the data. If you need ACID transactions, use SQL. If you're okay with eventual consistency then NoSQL might be easier. The scale of your data is just one minor aspect you need to consider when building a system. I'd argue you can scale both types of DBs just as much as each other but it'll all come down to what kind of trade offs you're willing to make. Its not uncommon to have a combination of both NoSQL and SQL DBs, they are not mutually exclusive.

I have faced issues while accessing data in nosql databases. 🥲

Postgresql offers the same power as MongoDB when it comes to json, so there's no sense to choose MongoDB even if you want to store your data in denormalized form.

hi @interviewpen , it's diwali can i get one coupon code so that i can buy your sytem design course, it's diwali , love from india

I have a question. Everytime when a user logs in, the system will generate a session token regardless of if it is a good user or a bad user. How this session token differentiates between the good and bad user?

Good stuff! However, what is also important apart from schema, that relational database has relatively slow writes/updates because of their index structure (B-tree) and storage mechanisms. Apache Cassandra, afaik, has LSM tree and mem tables. MongoDB has async I/O journaling and also has LSM tree (or does it?) in addition to B-tree. I, personally, dont like any relational DB, but "right tool for the right job" :)

this is gold

do most large scale companies use nosql then in favor of ease of storing and accessing data?

I'm i missing something or he didn't design the model in nosql ?

Hey nice video, but I'm confused about 1 thing: You mentioned that the CDNs are caches themselves, but then we're adding an additional cache layer? This seems redundant, no? Even if you go with the requirement of leaving NY data close to NY users, why can't you can still implement this algorithm at the CDN level?

Amazing video, thanks a lot ❤

Great video! Would like to have seen NATs included in the comparison.