Design ChatGPT - System Design Mock Interview (with eBay EM)

Рет қаралды 23,663

Күн бұрын

Make sure you're interview-ready with Exponent's system design interview prep course: bit.ly/3NxjDyT
An eBay engineering manager, builds ChatGPT during a system design mock interview. He identifies the requirements and constraints for building a robust chatbot system that can handle millions of users and transactions.
Chapters (Powered by ChapterMe) -
00:00 - Design ChatGPT with Functional Requirements
00:53 - ChatGPT operation feedback for good functional requirements
01:24 - Nonfunctional requirements for chat architecture
03:26 - Server receives 200 million messages per day
03:53 - Server, storage, scalability requirements
04:51 - High level design with consistent user experience
07:14 - Machine learning model for obscenity detection
08:24 - API ChatGPT model, database, messages
10:14 - Rough design for messaging simplicity
11:14 - Multiple ways to ask thumbs down
11:51 - Sending model to GPT for training, avoiding malicious users
13:32 - Operations and APIs in conversation service
14:09 - Create, view, delete, send messages
15:33 - Retrieval of messages in conversations
16:17 - Sending and receiving messages in Messenger
17:08 - Grid-based messages with ID generators
20:29 - Multimessage conversation model with parent
22:09 - GPT model with variety of questions and answers
22:55 - System design uses and examples
27:34 - Databased AI training with questions and answers
29:05 - Reinforcement learning in system design training
33:14 - Reward model continuously trains
33:42 - GBT building overview, final thoughts
Watch more system design videos here:
- Meta engineering manager answers a rate limiter interview question: • System Design Mock Int...
- Google SWE answers an algorithms interview question: • Google Software Engine...
- Google TPM answers Tiktok system design interview question: • System Design Mock Int...
- Flipkart EM “Design Amazon Prime Video” system design interview question: • System Design Intervie...
👉 Subscribe to our channel: bit.ly/exponentyt
🕊️ Follow us on Twitter: bit.ly/exptweet
💙 Like us on Facebook for special discounts: bit.ly/exponentfb
📷 Check us out on Instagram: bit.ly/exponentig
📹 Watch us on TikTok: bit.ly/exponenttikttok
ABOUT US:
Did you enjoy this interview question and answer? Want to land your dream career? Exponent is an online community, course, and coaching platform to help you ace your upcoming interview. Exponent has helped people land their dream careers at companies like Google, Microsoft, Amazon, and high-growth startups. Exponent is currently licensed by Stanford, Yale, UW, and others.
Our courses include interview lessons, questions, and complete answers with video walkthroughs. Access hours of real interview videos, where we analyze what went right or wrong, and our 1000+ community of expert coaches and industry professionals, to help you get your dream job and more!

Пікірлер: 31

@tryexponent 4 ай бұрын

Make sure you're interview-ready with Exponent's system design interview prep course: bit.ly/3NxjDyT

@zeroflame33 5 ай бұрын

I think this is missing the most important and definitely most difficult part of this model design. How do you scale the ChatGPT model for inference?

@tylersnard 10 ай бұрын

A question: when you send a message, you return a message ID, but you don't talk about what happens to ChatGPT's response to the user's question. Does it get shown to the user at some point?

@bigrespect228 Жыл бұрын

Wow! awesome topic and realy deep dive explanation

@rushikeswararaopolaki3602 8 ай бұрын

Very good discussion.

@johnhobe9487 9 ай бұрын

Its interesting that the first thing he thinks about is how to do sensorship. I was about to go off, but they won me over by talking about the chatgpt model int the last 12min 😂

@BABEENGINEER Жыл бұрын

Love this topic!!!

@Abner3 Жыл бұрын

Wow I didn't expect you in this comment section! Love your videos!

@Kate-pv8cv 8 ай бұрын

Why does thumbsupthumbsdown use the message ID that is sent by a user? Shouldn’t it apply to the chatGPT’s response? Am I missing where the “answer” is? At some point we should GET a message too? 🤔

@jacobsimon4699 Жыл бұрын

Love it!

@subhashismohanty5420 6 ай бұрын

Wondering if the interviewee came prepared for this question or its spontaneous :) just kidding. great content and great share. Kudos

@andiyhuandy6655 Жыл бұрын

Very helpful video! I was wondering which platform did you use to create the mindmap?

@utkarshsinghal90 Жыл бұрын

Its Whimsical

@tryexponent Жыл бұрын

Thanks @Andiy! The platform is called Whimsical

@thesumitsingh1234 10 ай бұрын

He went deep into the ML part as well. Is that also required for Sys Design interviews? What if I am not familiar with the ML concepts like reward model, supervised fine tuning etc?

@tryexponent 9 ай бұрын

Hey thesumitsingh1234! Unless your role is an ML role or the company/department you are applying to is ML-focused, you will not be expected to know the in-depth ins-and-outs of ML concepts

@afraz-khan 8 ай бұрын

awesome video, I have never worked with ML, no idea of any piece in the last section where he explained the ChatGPT models setup. Just wondering how to tackle such blank areas in an interview?

@tryexponent 8 ай бұрын

Hi afraz-khan! Thanks for the question. Unless the role you are applying to explicitly states that they are looking with someone with AI/ML/GPT knowledge/experience, it is likely that they won't penalise you on not knowing the specifics of designing GPT. As long as you demonstrate your competence in system design, you should be fine!

@afraz-khan 8 ай бұрын

@@tryexponent makes sense, thanks.