2. CAP Theorem | High Level Design for Beginners | CAP Partition Tolerance explained

I have explained what is CAP theorem and what all possible combination we can use and when to use which property.
➡️ Join this channel to get access to member only perks:
/ @conceptandcoding

[@gaming_with_ajey]

Partition Tolerance is : System is up and running Even If there is some network partition among nodes. that means, system is able to tolerate partition. Hence partition Tolerant.

[@abhishekvithal8060]

@Concept && Coding Is this correct ??

[@ConceptandCoding]

Correct

[@nitink8148]

You have explained it in a far better manner than many utubers!

[@ConceptandCoding]

thank you

[@kirtisingh2955]

Legit I just switching between your playlist from java to spring to SD. Great effort!!

[@RG-ed3lv]

thanks !! waiting for more and more uploads in this playlist!

[@prateekjain8374]

sir u have explained it so well.. that even if somebody ask me about CAP... I can now clear his/her concept on CAP

[@ConceptandCoding]

thank you

[@geekydanish5990]

Thanks awsome explaination keep posting more !!!

[@anshu-littlebitofeverythin21]

You explained the concept very well. Keep doing it. Thanks for sharing knowledge

[@ConceptandCoding]

thank you

[@nileshkumarvishwakarma]

time kab jata hai pta hi nhi chlta, you got teaching skills man hatsoff!!

[@ConceptandCoding]

Thank you very much for the feedback

[@TarunJain-is1im]

Best explanation found ever. Thanks!

[@ConceptandCoding]

Glad it was helpful!

[@swapnilsaxena81]

Sir, you have explained this so well !!

[@ConceptandCoding]

Thank

[@abhishek-94]

Hi, in the 3rd example when the system itself is down(so it is not partition tolerant), we only have consistency but we don't have availability either(so it is not CA)

[@SaritBurman]

Same thought here

[@subhamacharya4472]

Thanks for this explanation 🙂

[@heroChaddi]

Bro CA m agar tumne poore system ko hi down kar diya toh phir yeh system ko CA kyu bol rhe, yaar availability bhi toh band kardi system down krke??!!

[@LearnGrow-wd1en]

Well Explained , this concept is a bit hard to understand . With your examples it was super easy to digest. Thanks

[@ConceptandCoding]

Thanks

[@ishitaamod5109]

very nicely explained!

[@dhruvpurwar6642]

Great one!!

[@vamsikrishna_16]

Great Explaination

[@skillupshivam]

preparing for interview, this is very very helpfull for me, thank you so much for creating this playlist and video.

[@ConceptandCoding]

Thanks

[@kalravsharma178]

Best explanation!!

[@ConceptandCoding]

Thank you

[@tarunkundhiya5196]

Great explanation!! The key point that other videos don't tell: Partition Tolerant: Whether the system is able to take requests in case of some network failure in the system. The second thing Availability can be confused with the above definition "If the system is not taking requests how we are achieving availability?' This thing is confusing (individual DB nodes are available but the system itself is not) the A in CAP theorem is talking about whose availability of DB nodes or the system itself. This is confusing. What do you think about this ? how to clear up this concept?

[@vigupta-uq1pn]

same doubt :\

[@ayushshshsh]

same doubt

[@programmershub3887]

best explaination

[@buntykumar7270]

Good explaination

[@ramijsardar6678]

Great Explanation,

[@ConceptandCoding]

Thank you

[@chauhansingh7797]

really great

[@ConceptandCoding]

thank you

[@Mohnishagrawal-zl9ke]

Can you few ways in which CAP theorem is somewhat mitigated in the real work such as using QUORUM consensus, etc..

[@jeetendragarg7718]

Very well explained

[@ConceptandCoding]

thanks

[@kushagrabajpai7944]

So if System is down will it be considered under CA and vice versa?? btw thanks a lot for this great lecture!!

[@SapnaKumari-bm7mn]

please share the rough worksheet it is very helpfull.

[@AbheyBhatia]

Please explain with examples stating which DBs are supported in each case and why? Thanks

[@ConceptandCoding]

sure

[@bobbysadhwani991]

Great Explanation bhaiya but, in absence of Partial Tolerance, the combination is Consistency & Availability which means a system is not up and running but it is consistence & avalaible. How it is possible?

[@ConceptandCoding]

Yes it's (CA) is not possible in distributed systems it's hypothetical.

[@kishorkshirsagar1163]

at 15:04 ( You said if there is a partition ) you should have said if there is breakdown

[@sarthakbhatia7639]

Understood

[@pritammohapatra876]

Why are you not using CQRS pattern with messages brokers?

[@harishaseri]

Hi , I have quick doubt. When we want to achieve CA so we cant have partition tolerance . so you said that we have to take down the whole system(may be i have misunderstood this) . so in that case we have loss Availability right . so now system is not CA itself . please correct me if i am wrong

[@ConceptandCoding]

Let me try to explain: When we choose "CA" , what we assume that Partition can not even happen in the system. And if partition can not happen, then only thing left is CA. But if Partition happened, means our assumption is false, then we can not choose CA, then we have to choose CP or AP. So CA, can exist in a non distributed world (with a single DB) where never partion can happen.

[@sushil1922]

@@ConceptandCoding understood

[@rambeersharma2091]

Very nice but please explain the partition in details

[@gurupreetsingh8347]

Hey at the length of 16:35, u explain how we can achieve CA without P by down the whole system whenever P occurs just to maintain the C but in this case System is also not available that means we couldn't not achieve A too and at the end we only got achieved C , right ? in the use case of CA system should available to o right ? can you explain it ? , I don't understand how we achieved A here even though our system is down

[@rahulbhatt8583]

For a application to be distributed, it has to support Partition Tolerance, either compromising consistency or availability. A distributed system having CA property is hypothetical and it cannot exist in real world examples. What he means is we can achieve CA without P, by having only one server(then no distributed application). CP - Banking system need consistency so they block all the write operation if any of the node fails, thus system is unavailable, (to provide C and P) AP - Application compromises on Consistency and user can see two different values of a same variable. (to provide A and P) CA - No Partition tolerance at all, means there is only one server, which always have a fresh copy and no need of replication to any nodes, hence not a distributed system. (to provide C and A)

[@OMPRAKASH-fh3so]

Is availiablity means all the node sholud be respond or the system is availabe in case of failure?

[@ConceptandCoding]

availability means a distributed system can continue operating and responding to requests, even if some nodes are failing. It doesn't require all nodes to be responsive simultaneously but focuses on the overall system's ability to remain functional during failures.

[@harishaseri]

I have quick question regarding above lecture . right now it is not that we are just having distributed databases only , now days we have distributed application as well(like KZbin or insta) . I mean we have multiple servers or app servers . how does the CAP Theorem can be applied here . because here consistency concept is not applicable . may be partition tolerance we can apply . so basically here we can only think of AP only right ? I am not sure if my question is clear to you or not . In simple terms , how can we apply CAP Theorem on Distributed Application(not database application) ?

[@ConceptandCoding]

See even we have distributed app server but database is not distributed (let's say it's centralised) then CAP can be applied and if we see, out system is only C not fulfilling AP. And if we have distributed database, irrespective whether we have distributed app server or not, then again CAP theorem can be applied and whatever we discussed in the video that is applicable.

[@TanuKansal-nn4el]

Hi sir, I have a doubt, In case of CP, As you told,,, user doesn't know which db node it is requesting,,, even if A gets down user can still request for data,,, and it will get response from B also. So can't we say in this case there is availability of system?

[@ConceptandCoding]

in a CP system, if node A goes down after processing a request and another request comes in, the system relies on the remaining available nodes (like B) to handle the request. The system ensures that B has the necessary data by either replicating the data from A to B before A goes down (as its following Consistency). So we can say with CP, availability get reduced a bit

[@arimardanyadav4500]

### **Introduction:** - Discusses the concept of CAP Theorem (Consistency, Availability, Partition Tolerance) and its relevance in distributed systems. - Emphasizes the importance of considering CAP constraints early in system design to avoid costly changes later. ### **CAP Theorem:** - **CAP:** Stands for Consistency, Availability, Partition Tolerance. - **Desired Properties of Distributed Systems:** These three properties are desirable in a distributed system. - **CAP Trade-off:** You cannot have all three properties simultaneously. You must choose two out of the three. - **Example:** - Consider a distributed database with nodes in India and the US. - A user's data is replicated across both locations. - A distributed system should ideally be consistent (same data everywhere), available (responding to requests), and tolerant to partitions (network disruptions). ### **Understanding Each Property:** - **Consistency:** Ensures that all nodes have the same, up-to-date data at any given time. - **Availability:** Guarantees that every request is successfully processed by at least one node. - **Partition Tolerance:** Allows the system to continue functioning even if communication between nodes is disrupted. ### **Why CAP Properties Cannot Co-Exist:** - **Case 1: CA (Consistency and Availability) - Not possible with Partition Tolerance** - **Scenario:** A partition occurs, separating nodes A and B. - **Conflict:** Node A writes updated data, but node B cannot access it due to the partition. - **Result:** Inconsistency between nodes. - **Case 2: CP (Consistency and Partition Tolerance) - Not possible with Availability** - **Scenario:** A partition occurs, separating nodes A and B. - **Strategy:** To maintain consistency, only one node (A) is allowed to process writes. - **Result:** Node B becomes unavailable for writes during the partition. - **Case 3: AP (Availability and Partition Tolerance) - Not possible with Consistency** - **Scenario:** A partition occurs, separating nodes A and B. - **Strategy:** To maintain availability, both nodes can process writes. - **Result:** Potential for inconsistent data between nodes. ### **CAP Trade-off in Real-world Systems:** - **Importance of Partition Tolerance:** In today's distributed systems, network disruptions are common. - **Choosing between CP and AP:** - **CP:** Choose this option for systems where consistency is critical, even if it means some temporary downtime. - **AP:** Choose this option for systems where availability is paramount, even if it means some data inconsistency. ### **Key Takeaways:** - **Understanding CAP is crucial for effective distributed system design.** - **Early consideration of CAP constraints can prevent costly changes later.** - **The choice between CP and AP depends on the specific needs of your system.** - **Partition tolerance is a key factor in modern distributed systems.**

[@apurvaagrawal2384]

I have a doubt...i know there would be flaw in it...please try and answer... I think all 3 are possible, If A updates B, C together always, there is no connection between B and C. So it is partition tolerant as if B and C connection breaks no effect, consistent becoz A is updating B and C so data will be same there, And available because both nodes will be available

[@ConceptandCoding]

Nope, can you tell how Application will write in B and C together? Is it possible? If yes, then how?

[@tejeswarpala2841]

Great explanation. but not so great audio. : -)

[@ConceptandCoding]

All latest videos are made from new mic, so i have improved this part tejeswar

[@kumarnishchay9065]

Can i get the notes and the materials that you are making in this KZbin videos ?

[@ConceptandCoding]

Hi, sorry i did not saved it but will do from future

[@shantanumapari6679]

I did not understand how system achieves CP?

[@ConceptandCoding]

This concept mostly resolved through DB design

[@AnkushJaswals]

20-05-2023 Thanks.

[@ConceptandCoding]

thanks

[@AnkushJaswals]

@@ConceptandCoding Hi Today I booked 1:1 session with you on topmate. It is scheduled for 8-8:30 today. 22-5-2023

[@AnkushJaswals]

You didn't joined. I hope everything is ok at end.

[@ConceptandCoding]

@@AnkushJaswals oops i missed it. Let me reschedule it

[@AnkushJaswals]

@@ConceptandCoding Thanks.

[@rekhavs9547]

Sir, can these videos in future be in English?

[@ConceptandCoding]

I will add captions to these hindi videos

[@rekhavs9547]

Thanks sir@@ConceptandCoding

[@Rock28099]

I have one doubt. CA- here if network parition has happened then the system will shut down. Hence we indirectly compromise the AVAILABLITY too. Correct? Similary, In CP, if network parition happens then the system remains up therefore indirectly we are achieving the AVAILABLITY. Isn’t it??

[@amritsatapathy7820]

In CP, we cannot achieve AVAILABLITY because we will have to down the nodes without latest data (otherwise system will reflect different data since the nodes could not be updated due to parttion in system.). If we dont , we cannot achieve Consistency.(same data in all nodes) As for CA, a distributed system having CA property is hypothetical. It cannot exist in real world. We can achieve CA without P, by having only one node (meaning one node, no replicas, so we dont have a distributed system). Hope this helps !

[@Rock28099]

@@amritsatapathy7820thanks, bro. But the system following CP doesn’t go down na. Isn’t it? Shreyansh also said the same. If the system is the following Partitioning then when Network partitioned happens the system breaks into two partitions where devices in partition 1 can communicate and send data to each other and the same with devices in network partition 2 but if some devices from partition. 1 tries to communicate with the device of partition 2 then there will be a delay because the network partitione happened. If the system follows consistency and Partitioning and then still goes down then what is the meaning of following up?

[@amritsatapathy7820]

​@@Rock28099 Yes bro, the overall system will not go down, but the nodes/devices in partition 2 will be down or specifically, they are shut down so that no requests are served by those nodes and system is kept CONSISTENT. (because if not, they will give diiferent data violating Consistency). So, during this time, if any requests are going to devices of partiton2, we may/may not get a response. Here , the Availablity then gets violated.

[@Rock28099]

@@amritsatapathy7820 thanks bro… all clear now

[@ravikumar-lg3yn]

Please try to give explanation in English

[@ConceptandCoding]

sure Ravi

[@amazing_quotes7432]

I cannot access ur java tutorials?

[@ConceptandCoding]

It's for channel members buddy

[@amazing_quotes7432]

@@ConceptandCoding how can i be a member?

[@ConceptandCoding]

@@amazing_quotes7432 pls check out the first video, i have shared the process buddy kzbin.info/www/bejne/fZaqaWxrh5p4qrc

[@dpynsnyl]

the explanation is a bit clouded.

[@ConceptandCoding]

Sorry for that, pls do comment what is not clear, i will try to answer that

[@shreyashs]

Bro its wrong....AC is not possible. For that PACELC is introduced

[@ConceptandCoding]

It is possible. PACELC is just an extension of CAP by introduction of Latency. But it never says it is introduced because AP is not possible. That's my view but we can discuss more on this.

[@krishnachaitanya9986]

PACELC is introduced for a use case of Partition itself is not available in a distributed system(DS), then it can choose between Latency and Consistency. 1. Partition is available in DS, it can trade off between Consistency and Availability 2. System is running with out partition, it can trade off between Latency and Consistency So it reverses CAP theorem with PAC and adds else condition for Latency and Consistency, so the name PACELC (Partitioned Availability Consistency Else Latency Consistency)

[@ConceptandCoding]

@@krishnachaitanya9986 thanks Krishna. Very nicely explained the PACELC

[@krishnachaitanya9986]

Thank you and kudos to your effort 🙏

[@adityajaiswal3943]

Stop replying to only the good comments with the "thank you" BS. Reply to the actual questions of the users!!

[@rhythmjayee9707]

Reach++