Disabling Garbage Collection helped Instagram save money and get better performance

System Design for SDE-2 and above: arpitbhayani.me/masterclass
System Design for Beginners: arpitbhayani.me/sys-design
Redis Internals: arpitbhayani.me/redis
Build Your Own Redis / DNS / BitTorrent / SQLite - with CodeCrafters.
Sign up and get 40% off - app.codecrafters.io/join?via=...
In this video, we delved into Instagram's 2017 blog post discussing their optimization strategy of dismissing Python garbage collection. By disabling this feature, they achieved a 10% efficiency boost, translating to significant cost savings at scale. The blog highlighted Instagram's use of Django in a multiprocess mode to maximize hardware utilization, alongside techniques like "copy on write" and memory management strategies. However, their initial theory regarding ref counts on code objects was debunked through practical experimentation, emphasizing the importance of validating assumptions before implementation.
Recommended videos and playlists
If you liked this video, you will find the following videos and playlists helpful
System Design: • PostgreSQL connection ...
Designing Microservices: • Advantages of adopting...
Database Engineering: • How nested loop, hash,...
Concurrency In-depth: • How to write efficient...
Research paper dissections: • The Google File System...
Outage Dissections: • Dissecting GitHub Outa...
Hash Table Internals: • Internal Structure of ...
Bittorrent Internals: • Introduction to BitTor...
Things you will find amusing
Knowledge Base: arpitbhayani.me/knowledge-base
Bookshelf: arpitbhayani.me/bookshelf
Papershelf: arpitbhayani.me/papershelf
Other socials
I keep writing and sharing my practical experience and learnings every day, so if you resonate then follow along. I keep it no fluff.
LinkedIn: / arpitbhayani
Twitter: / arpit_bhayani
Weekly Newsletter: arpit.substack.com
Thank you for watching and supporting! it means a ton.
I am on a mission to bring out the best engineering stories from around the world and make you all fall in
love with engineering. If you resonate with this then follow along, I always keep it no-fluff.

[@NabajyotiBorah-x7p]

to all those managers and clients who think for just two lines of code why you need this much time and money, look here it is about the experience of the person you pay for, not code lines, because they know the internals after working for so many years how the code works

[@amitrastogi1405]

Awesome blog and step by step approach for solving the problem. Thanks for covering this Arpit!

[@LeoLeo-nx5gi]

This is truly amazing, and trust me if I was to read this blog alone would have just stopped it after few paras but when you explained man!!! things were so so clear. Thank you so much!!

[@achyuthreddyi]

amazing !!!. Thank you for this series and this giving us a lot of curiosity to dig deeper into the internals

[@user-xf7yg5ci3t]

Awesome! It was thriller movie with a lot of twists and turns! Thank you so much for the explanation!

[@aniketmahangare8333]

Thank you so much for covering this Arpit.

[@sum1t_gupta]

Thanks for great work man , phenomenal explanation

[@AshishKumar-qe4hq]

Best video ever, thanks Arpit

[@zombiebaloon9166]

Beautifully explained buddy

[@ankit-jangid]

there are really good blogs are out there. But Arpit you put efforts to explain and do deeper with all the details and in very simple way that really helps alot to engage and generate interest in engineering. as real engineering is figuring out the solutions and improvements which you deliver at best. thank you for your efforts !!

[@sharinganuser1539]

Now it makes sense...thanks a ton...I have been trying to understand that ...

[@itsonmylist1247]

Great video would love to see a video on abstraction for writing better and maintainable code

[@daegu_1]

amazing. thanks for explanating

[@dinakarullas4856]

Loved it!!!

[@trendinginsaan1285]

In just a couple of minutes, my brain is filled with dopamine. really respected video

[@chinmayagrawal]

37:32 I believe sandybridge processors are the intel 2nd gen processors which were built on 32nm microarchitecture(launched in 2011) If in case anyone thinks Instagram using 12 years old CPU, then this blog is written in jan 2017, so at that time that cpus are just 6 years old

[@AsliEngineering]

Thank you Chinmay :)

[@user-zs6bp4qu8j]

Awesome !

[@sanskaragarwal582]

Brilliant!

[@soniamathew250]

which mic are you using? if you are fine sharing.

[@NabajyotiBorah-x7p]

Ok, for the f***k sake I have been working in python for 3 years and today I came to know that it only runs on a single thread, fkkkk That's why I watch your system design videos to get in in-depth understanding of the language , I hope you create more about python in future

[@farhanishaq7]

Is it possible to recover deleted insta chats bro?

[@AmitSharma-yb9vc]

Thanks for the video, I started binge watching your youtube videos. One request, Please don't use subtitles like this, I found them pretty disturbing.

[@AsliEngineering]

I have been experimenting lately and seeing what works and what doesn't.