Database Replication | Synchronous vs Asynchronous | System Design Tutorials | Lecture 18 | 2020

  Рет қаралды 67,132

sudoCODE

sudoCODE

Күн бұрын

Пікірлер: 132
@sudocode
@sudocode 4 жыл бұрын
Hello peeps! Hope you like the video. Apologies about the traffic noise in the start. Was recording this late at night in my home town in India. :)
@hookcrook795
@hookcrook795 3 жыл бұрын
No problem at all.... This video was really helpful and I sincerely encourage you you to please make more videos like these.Thanks a ton!!
@abhishekrohira4167
@abhishekrohira4167 3 жыл бұрын
Hi, Firstly I would like to thank you for creating such great videos on System designs. I have just one thing to ask that I can't the reference links in your description for couple of videos. Can you please share across those links, will help me to dig deep in the topics you covered. Thanks in advance
@sudarshanrbhat7686
@sudarshanrbhat7686 3 жыл бұрын
This is great content, thank you so much. could you please do more content on db replication and faults and failure handling like the previous video in the series.
@adibesoya11
@adibesoya11 Жыл бұрын
Can anyone help me how i can actually implement it, i hve understood the concept but to to implement
@romasahoo4326
@romasahoo4326 2 жыл бұрын
I was searching all over the internet for System design videos that are basic and which I can easily understand. This series helped me a lot in understanding the basic concepts. Nicely explained. Now I'm thinking about why I didn't start searching a little early 🙂. Please add the reference links in your description. I can't find them. Thanks again Yogita.
@Mridul389
@Mridul389 4 жыл бұрын
Conceptually you are the best teacher mam...
@sudocode
@sudocode 4 жыл бұрын
Thanks Mridul
@sahild8623
@sahild8623 2 жыл бұрын
Hello Yogita, Great informative video as always but was really looking forwards to learn more about the different replication models which you were touching upon briefly throughout the video. You seem to stress a lot on exploring the additional resource links in the description of the video. But unfortunately, they seem to have been missed somehow. This has been the case in past few of the videos too. Could you please update the descriptions of video to have those links added? Thanks in advance.
@skylarw19
@skylarw19 9 ай бұрын
loving this video series - finding it very helpful!
@srndrpec
@srndrpec 3 жыл бұрын
No resources in the description
@manjulathavajhala5549
@manjulathavajhala5549 2 жыл бұрын
@sudoCODE, Yogita, thanks for the detailed explanation. Could you please update the links as you mentioned, couldn't find them in the description box. Thank u.
@swapnendusanyal8420
@swapnendusanyal8420 2 жыл бұрын
Hey, I am a bit confused about synchronous replication and how it solves consistency issues in case of high latency between the replicas. You explained that the write is initiated on the master and is broadcasted to all the replicas. The replicas execute the write command and send back acknowledgments. What happens if there is a read during this process? It is quite possible that a read request on the master is going to be different from the read request to one of the replicas. Do we accept that inconsistency? In a write and read-heavy system, this will happen a non-trivial number of times.
@priyamroy2032
@priyamroy2032 2 жыл бұрын
i think till the master sends acknowledgement to the writer service for synchronised replication for example updating a order, other services like for example invoice service won't enquire about that particular transaction even if it accessing the inconsistent replicas. They might want to enquire about already consistent transactions. Hope this makes sense may be..
@harvendrasinghrathore2848
@harvendrasinghrathore2848 24 күн бұрын
No synchronous replication won't lead to inconsistency, as most of the DBs use 2nd transaction isolation level which is REPEATABLE_READ which takes exclusive lock on write, so until the write get completes it won't release the lock. and EXCLUSIVE lock won't able to read the data
@binyammamo6454
@binyammamo6454 3 жыл бұрын
Thank you so much, I've watch couple of videos but you are the one that makes me get it!
@nikhilgoyal8340
@nikhilgoyal8340 3 жыл бұрын
Hi Yogita, I really liked the series, especially the real-world analogies given at the start. However, I would request you to please add the resources in the description, as they are missing in many videos.
@sudocode
@sudocode 3 жыл бұрын
Sure 😊
@zainabmahmood1449
@zainabmahmood1449 2 жыл бұрын
i want to know more on data replication engine,i want you to make a complete vedio for data replication project,how it works....the way you teach is greate. thanks
@itisnewiin4360
@itisnewiin4360 3 жыл бұрын
I understand very easily by the way you teach. So please make a in depth video of database replication as it becomes very important when data transaction is very large.
@nirajsharma7384
@nirajsharma7384 3 жыл бұрын
You are going great job. Please make more detailed video database replication .
@sudocode
@sudocode 3 жыл бұрын
Sure I will
@shridhar_rao
@shridhar_rao 2 жыл бұрын
my notes below: Replication: Pros - Fault tolerance, secondary mains, latency reduction, cqrs, Performance improvement, availability. Cons - dissynchronization(replication lag) -> Data inconsistency. Solution for data consistency Read after write consistency To be continued.... #SR7
@kalyanbellamkonda8653
@kalyanbellamkonda8653 4 жыл бұрын
Really good content mam
@sudocode
@sudocode 4 жыл бұрын
Thanks Kalyan
@jinalkumarpatel5138
@jinalkumarpatel5138 4 жыл бұрын
Short and sweet introduction to replication. Though you mention it is short information of big topic, in replication if primary goes down then one of secondary become primary and in case of asynchronous how to make sure that secondary selected out of consistent only.
@sudocode
@sudocode 3 жыл бұрын
That depends on implementation level.
@shubhangipandey8165
@shubhangipandey8165 2 жыл бұрын
Hi Yogita, Thanks for providing such good and clear content! I was looking for the links you said (in video) to be their in description but cannot find any here. Is there someother resource i need to check other than the courses ?
@anitajaiswal2312
@anitajaiswal2312 Жыл бұрын
+1
@mohammedashik94
@mohammedashik94 Жыл бұрын
Please explain about eventually consistent
@shahulhameed-xc1to
@shahulhameed-xc1to 11 ай бұрын
Superbly made ❤
@pappu2405
@pappu2405 Жыл бұрын
Awesome one, Thanks for sharing.
@veena2669
@veena2669 2 жыл бұрын
Very good videos. Thanks for the content.
@tirupatirao7521
@tirupatirao7521 3 жыл бұрын
I was confused with aerospike db for implementing a ratelimiter algorithm to store and access atomic counters in faster way, as it has many read write polices between master and slaves. Finally this video clears my doubts to understand such systems.
@mahendranath2504
@mahendranath2504 3 жыл бұрын
Thank you so much 👍🏼🎉⭐🙏
@gulshankumar-jc2kg
@gulshankumar-jc2kg 2 жыл бұрын
thanks for knowledge sharing...😊
@manirathinam8620
@manirathinam8620 2 жыл бұрын
Very useful video..thanks a lot!
@sudocode
@sudocode 2 жыл бұрын
Glad it was helpful!
@aayush135
@aayush135 2 жыл бұрын
Very good video with wonderful explanation. ✨✨
@neerajmahapatra5239
@neerajmahapatra5239 2 жыл бұрын
I don't know but whenever I see your explanation it feels like my big sister is teaching me.. Although I don't have one 😐... Amazing content can't imagine it's for free..
@sudocode
@sudocode 2 жыл бұрын
This made my day 💙
@cajaykiran
@cajaykiran 2 жыл бұрын
Thanks for the very helpful video.
@akshitakokate3414
@akshitakokate3414 11 ай бұрын
so can you please tell me more about table replica
@nigamkrtiwari
@nigamkrtiwari 2 жыл бұрын
Thanks for this amazing video ❤ 🙏 i have a doubt when I insert bulk data in million then slave started 100% cpu utilisation and due to the same my server -read stop working till the operation completed. Pls suggest how I can handle this situation? Thanks in advance 🙏
@thantcinhtun8155
@thantcinhtun8155 2 жыл бұрын
a very good explanation.
@official-DRFRE
@official-DRFRE 2 жыл бұрын
Thank you so much it is really helpful.
@GauravSharma-wb9se
@GauravSharma-wb9se 2 жыл бұрын
how all replica DBs will be locked for read operation when master is updating using synchronous approach ? that time also read can happen and reader can get wrong data if update is not completed from master. ?
@debsworld3784
@debsworld3784 Жыл бұрын
Hi Yogita, while we do understand the different methods to update the replicas , be it hybrid , sync or async , in case of a transaction driven app , as you said , can be banking , which of these has to be used since I see a glitch in all three in terms of data consistency for example Hybrid - R1 is updated and main DB says write complete , user is accessing R2 which means user wouldn’t get the updated data . So isn’t it like it should first update the replica which user is accessing and all others later ?
@shashibarnwaldavmo
@shashibarnwaldavmo 3 жыл бұрын
hi, thanks for the video Yogita :) , one doubt is whether the snapshots are also distributed across all the nodes or specific to a node
@vikaszv9591
@vikaszv9591 3 жыл бұрын
U forgot to add or mention about the latency topic in any video. Pls check and make a video on that as well.
@sanketskhandekar
@sanketskhandekar 3 жыл бұрын
Hi, I like the video I am unable to find resources in the description.
@roberto-rodriguez
@roberto-rodriguez 3 жыл бұрын
Awesome video. Thanks you very much!!
@PANKAJKUMAR-nu6oc
@PANKAJKUMAR-nu6oc 3 жыл бұрын
Very insightful mam
@sudocode
@sudocode 3 жыл бұрын
Thanks a lot
@jibranjaved6165
@jibranjaved6165 2 жыл бұрын
Nice! So database system will take care of copying data to slaves, it is matter of configuration on database system level....what about routing read n writing request to the respective db node,would that b implemented on the application level via some gateway to filter n send to respective db i.e., read or write???eagerly curious :-))
@kanigoyal1693
@kanigoyal1693 3 жыл бұрын
Hi.. I could not find the link to the docs u mentioned? Could u pls share that
@mritun1978
@mritun1978 3 жыл бұрын
Excellent Explanation. Keep it up 👍
@shivamojha7999
@shivamojha7999 4 жыл бұрын
Nice Ma'am!
@NeerajSharma-xf1xk
@NeerajSharma-xf1xk 3 жыл бұрын
what is row based replication & statement based replication ? Please explain.
@ravikumar-yq5df
@ravikumar-yq5df 4 жыл бұрын
Awesome content.
@sudocode
@sudocode 4 жыл бұрын
Thanks
@ChandraShekhar-by3cd
@ChandraShekhar-by3cd 4 жыл бұрын
Thanks a lot for the nice explanation. Shared the channel link to the coding community sites to acquire the greater number of audience for such an informative topics of system design. Pls do post video on system design example - facebook feed, google serarch, instagram working , uber architecture. Thanks
@sudocode
@sudocode 4 жыл бұрын
That's very kind of you! Thanks a ton.
@UECAshutoshKumar
@UECAshutoshKumar 5 ай бұрын
Thank you
@suchismitagoswami5609
@suchismitagoswami5609 3 жыл бұрын
That's a great video. Would love to see a lesson on multi-master replication, and how to handle conflicts in those cases.
@sujan_kumar_mitra
@sujan_kumar_mitra 4 жыл бұрын
Nice explanation.
@sudocode
@sudocode 4 жыл бұрын
Thanks
@ManojSinghblog
@ManojSinghblog 2 жыл бұрын
Clear concept
@pashandnash
@pashandnash 3 жыл бұрын
Neat explanation
@jihyehong7371
@jihyehong7371 3 жыл бұрын
I liked your video. The explanation is simple and easy to understand but can you please add the links that you mention in your video? I cannot find them
@abhimanyudwivedi6651
@abhimanyudwivedi6651 2 жыл бұрын
Mam you always say "links in description" for further read. I couldn't find anything in the description.
@DevOL-001
@DevOL-001 3 ай бұрын
Thank you 🌹
@subee128
@subee128 7 ай бұрын
Thank you very much
@henry129ification
@henry129ification 4 жыл бұрын
Nice video !! A replication primer for sure :)
@sudocode
@sudocode 4 жыл бұрын
Hehe. Thanks
@rupeshjha4717
@rupeshjha4717 4 жыл бұрын
Nice explanation!! Also, it would be great if explain a bit about multi-leader replication, and how to handle conflicts in that case. Please keep on making videos!! Thanks for sharing your knowledge ma'am!!
@sudocode
@sudocode 4 жыл бұрын
Thanka a lot Rupesh. Yes I will definitely make video on leader election, consensus, paxos etc.
@imranshaikh115
@imranshaikh115 3 жыл бұрын
Greate content thanks a lot. But I have a doubt that in all the replication methods (sync or async or hybrid) If one of the replications (write in R1, R2, R3) write fails (suppose in R3 write fails) then how to manage that situation. So in this case Data inconsistency problem might occur. Correct me if I am wrong. Thanks again for producing beautiful content.
@vishalverma-wx7eo
@vishalverma-wx7eo 5 ай бұрын
You have not added resources in the description. I only see paid courses websites
@balakrishnabilla
@balakrishnabilla 3 жыл бұрын
Excellent !! I dont see any references or links in the description as you mentioned...
@sudocode
@sudocode 3 жыл бұрын
let me check the links.
@ericphan5857
@ericphan5857 2 жыл бұрын
Streaming is like broadcasting all database in cloud and accessing is available all time as soon as new data uploaded
@SahilSharma-ug8xk
@SahilSharma-ug8xk 3 жыл бұрын
Nice👌🏻
@shashanksingh4708
@shashanksingh4708 Жыл бұрын
I'm confused between this and CQRS .
@zmxncbv95
@zmxncbv95 2 жыл бұрын
Please try to create a database replication course.
@sudocode
@sudocode 2 жыл бұрын
Can’t promise. Will do if there’s a lot of ask for it.
@crackdatastructurealgorith1650
@crackdatastructurealgorith1650 3 жыл бұрын
What will happen if Replica fail to update? What will be the best approach to handle this ?
@dukesoni5477
@dukesoni5477 Жыл бұрын
thank you..😊😊
@ShaniPolandVlogs
@ShaniPolandVlogs 4 жыл бұрын
Awesome content ☺️
@sudocode
@sudocode 4 жыл бұрын
Thanks Shani 😊
@ero_sennin_
@ero_sennin_ 3 жыл бұрын
Thanks for this !!
@petersilva037
@petersilva037 Жыл бұрын
the way you explained synchronous replication feels incomplete. To me, if the replicas are serving the reads (as described a minute before.) then there is a time when some of the replicas have done the write and sent their ack, and others have replicas have not yet done so. At that point the replicas which have not yet acknowledged will be reporting the old value, and those that have acknowledged should return the new one. I suspect there is another round of of packets to circulate to confirm (commit) that the write has succeeded, and only after the second round trip should the master answer that the write has succeeded.
@btsjiminface
@btsjiminface 8 ай бұрын
love the video
@venugopalbv2069
@venugopalbv2069 3 жыл бұрын
Yes please, replication primer 👍
@montaajam8605
@montaajam8605 3 жыл бұрын
Very good video ! Thank you
@sudocode
@sudocode 3 жыл бұрын
Glad you liked it!
@colinmaharaj
@colinmaharaj 2 жыл бұрын
I'm thinking of created an application service that will act as a db read cache. But pass thought writes.
@ashishverma-mj1kl
@ashishverma-mj1kl 3 жыл бұрын
couldn't be more perfect!
@tirupatirao7521
@tirupatirao7521 3 жыл бұрын
If we also able to demo this theories
@sudocode
@sudocode 3 жыл бұрын
I am trying to build demos.
@MiravMehtaishere
@MiravMehtaishere 3 жыл бұрын
There could have been an overall slide for this video on strategy, like you have done for caching video
@kannavsharma3288
@kannavsharma3288 2 жыл бұрын
great vid
@souravsinghtomar8573
@souravsinghtomar8573 2 жыл бұрын
Big ups
@rbelatamas
@rbelatamas 2 жыл бұрын
Thank you so much!
@manan5
@manan5 4 жыл бұрын
Another great Video! :)
@sudocode
@sudocode 4 жыл бұрын
Thanks again!
@shridhar_rao
@shridhar_rao 2 жыл бұрын
Thanks
@ameyresa3277
@ameyresa3277 2 жыл бұрын
hi really great explanation, it will be nice if you add subtitle for people like me who rly hard to understand spoken English (I'm not native English speaker), it'll really help me, thank you in advance :)
@abarag8
@abarag8 3 жыл бұрын
Hi Yogita, nice videos very informative - keep it up! I don't see links to additional resources in description from past few videos - Can you please check it once? I would love to read/explore more on these topics using the links you have in mind. Thanks :)
@sudocode
@sudocode 3 жыл бұрын
Will check and try to update.
@sreejeshraj4800
@sreejeshraj4800 Жыл бұрын
@@sudocode Hi Yogita, do you have the additional resources? In many videos, they are not there in the description. Thank you for the great content!
@NeerajPahuja
@NeerajPahuja 4 жыл бұрын
Great video! Can you make a video on data models? For example Relational/Document/Graph/wide-column? Their applicability, use-cases and examples?
@sudocode
@sudocode 4 жыл бұрын
Guess what? I already did :) kzbin.info/www/bejne/hZDGaJ-wg8eWgdE
@hi2ritesh
@hi2ritesh 3 жыл бұрын
Hi Yogita, thanks for sharing these wonderful videos. it is really helping us to understand the concepts. One Question though - in every video you mentioned the link for additional content but i never found it. Generally it has details about past and future video, link about your linkedin and hangout... i am not sure if i am looking at the right place. Please suggest.
@AnkurKumar-vx3xv
@AnkurKumar-vx3xv 3 жыл бұрын
Hey I am getting same problem . Have you found it
@hi2ritesh
@hi2ritesh 3 жыл бұрын
@@AnkurKumar-vx3xv no
@organicKick
@organicKick 3 жыл бұрын
In synchronous replication only one of replica is in sync with primary db, correct me if wrong.
@sudocode
@sudocode 3 жыл бұрын
It depends on the implementation. All replicas can be first synced before committing writes.
@shivamojha7999
@shivamojha7999 4 жыл бұрын
Ma'am please share notes of these lecture.
@sudocode
@sudocode 3 жыл бұрын
Will try!
@rajmehta7114
@rajmehta7114 2 жыл бұрын
Hey Yogita, Can you please explain what happens in case of synchronous replication where there is data exchange from both sides at the same time? example: data variable x is updated to 1 at time t1 on primary DB, and at the same time t1,data variable x is updated to 2 on secondary DB. How does DB handle these situations? do database engineers keep a check on race conditions while configuring the replica setup?
@sudocode
@sudocode 2 жыл бұрын
This is a classic concurrent event case. In distributed systems there is no way to conclude the exact ordering of concurrent events, so it depends on the consensus algorithm used to reach and agree on a result.
@gurupreetsingh8347
@gurupreetsingh8347 3 жыл бұрын
hello sudoCode, as you explain very welll but still want to know more details the things, please attach some online linkes or materials for every topics from where we can get the full/details context.... Thanks In Advance :)
@vanxu1735
@vanxu1735 4 жыл бұрын
hmm the location of Ireland seems a bit off..
@sudocode
@sudocode 4 жыл бұрын
Yeah. Sorry for that Van 😑
@dueed
@dueed Жыл бұрын
I can hear the traffic in the background xD
@thepardhu100
@thepardhu100 3 жыл бұрын
Master slave is a wrong terminology, leader worker is the right one
@ramjas5351
@ramjas5351 2 жыл бұрын
where is link , are you getting lazy
@VritraOfficial
@VritraOfficial 2 жыл бұрын
sorry no hates but she looks like Github LOGO
@sudocode
@sudocode 2 жыл бұрын
Thank you it’s an honour 😃
@gurupreetsingh8347
@gurupreetsingh8347 3 жыл бұрын
hello sudoCode, as you explain very welll but still want to know more details the things, please attach some online linkes or materials for every topics from where we can get the full/details context.... Thanks In Advance :)
БАБУШКА ШАРИТ #shorts
0:16
Паша Осадчий
Рет қаралды 4,1 МЛН
-5+3은 뭔가요? 📚 #shorts
0:19
5 분 Tricks
Рет қаралды 13 МЛН
#behindthescenes @CrissaJackson
0:11
Happy Kelli
Рет қаралды 27 МЛН
Jaidarman TOP / Жоғары лига-2023 / Жекпе-жек 1-ТУР / 1-топ
1:30:54
Database Replication & Sharding Explained
6:53
Hayk Simonyan
Рет қаралды 33 М.
Database Replication Explained | System Design Interview Basics
17:52
Big Tech Coach
Рет қаралды 11 М.
Directory based sharding
5:47
sudoCODE
Рет қаралды 21 М.
Database Sharding and Partitioning
23:53
Arpit Bhayani
Рет қаралды 113 М.
БАБУШКА ШАРИТ #shorts
0:16
Паша Осадчий
Рет қаралды 4,1 МЛН