How ChatGPT Works Technically | ChatGPT Architecture

  Рет қаралды 804,531

ByteByteGo

ByteByteGo

Күн бұрын

Пікірлер: 314
@sameerizaj5458
@sameerizaj5458 Жыл бұрын
Sir i'm being very honest your 5 to 7 minutes video always taught more than the week of study,these viusal are so helpfull and also i love the fact whatever word you use you first explain the meaning behind that make's thing more easy to understand
@happyruimi
@happyruimi Жыл бұрын
You should probably drop the course if you learnt more in this 5 min video than you did in 4 weeks...
@韩永翊
@韩永翊 Жыл бұрын
@@happyruimi People love learning superficial stuff that makes them feel smarter lol
@omgmaw
@omgmaw 7 ай бұрын
Sar sar sar
@softwareengineer8923
@softwareengineer8923 5 ай бұрын
@@韩永翊I don't think, that's the issue here
@Erik_Fenety
@Erik_Fenety 5 ай бұрын
Perplexity largest LLM done by one person on in own. ErikAFenety
@CppExpedition
@CppExpedition Жыл бұрын
Love the way you animate the presentation! Everything went so smooth and clear!
@ramaati18
@ramaati18 9 ай бұрын
Wow! The best animation in slides i have seen in any tutorials! Every word you utter during you presentation is golden and easy to learn easily and quickly!⭐️⭐️⭐️⭐️⭐️!
@AbubakerMahmoudshangab
@AbubakerMahmoudshangab 9 ай бұрын
What app to create these animated graphics
@KumarBodana
@KumarBodana 9 ай бұрын
Excellent video! Best explanation I've seen on ChatGPT
@rubbish9231
@rubbish9231 Жыл бұрын
As a software engineer I learned how to become a good chef. I asked gpt for it's implementation and informed me well
@betweenprojects
@betweenprojects Жыл бұрын
I am amazed by the results. A great wordsmith/people pleaser but factually about as reliable as a first year undergraduate in a bar.
@space_btwn_notes
@space_btwn_notes Жыл бұрын
pretty much recreated the typical politician
@satychary
@satychary Жыл бұрын
As always, CLEAR AS THE BLUE SKY - Alex, EVERY one of your explainers is pure gold, including this one! Thank you for making this.
@ferdous_khalifa
@ferdous_khalifa Жыл бұрын
Thank you so much for creating this insightful KZbin video! Your hard work and dedication to providing quality content are truly appreciated. You’ve managed to convey the information in a clear and engaging way, making it easy for viewers like myself to understand and enjoy. Keep up the fantastic work, and I’m eagerly looking forward to your future videos!
@jntaca
@jntaca Жыл бұрын
I follow a lot of divulgation tech channels. You are the most clear and concise of all. Thanks for your work !
@henriquedomingues3800
@henriquedomingues3800 Жыл бұрын
Can you do a list of this channels? Thanks!
@OsamaAdel
@OsamaAdel Жыл бұрын
I turned to be more complicated than I first thought. However this is natural, since its capabilities are fascinating and growing from day to day. Very nice video, thank you a lot.
@sowmyakotha3896
@sowmyakotha3896 2 ай бұрын
Thank you for the explanation. Visuals are really helpful and easy to understand.
@jonosutcliffe1
@jonosutcliffe1 Жыл бұрын
The best summary available. I needed a good summary for non engineers about how it works and I wish I'd found your explanation before creating my presentation. Very nice work, thanks!
@chrismachabee3128
@chrismachabee3128 Жыл бұрын
This is a very good video. It is the best nuts and bolts video I have seen and you've about think I have even heard of and I've been listening to everything I can, so fine job, well done and thanks.
@OneAndOnlyMe
@OneAndOnlyMe Жыл бұрын
Great explanation. As a computer scientist GPT is really not that mind blowing when you know that behind the scenes it's a giant data model and algorithms. It's magic to many non-computer scientists, but we can distinguish science from magic.
@herrbonk3635
@herrbonk3635 Жыл бұрын
Really?? I'm a "computer scientist" of sorts myself (CPU logic designer, compiler writer) but doesn't get sh*t from this. The video does not really explain anything "technical" (despite what the title says), only hyper loose analogies that tells me nothing.
@OneAndOnlyMe
@OneAndOnlyMe Жыл бұрын
@@herrbonk3635 As a computer programmer of 40+ years, AI is not some great mystery to me; large data models and quite simple algorithms at the core of it, combined with the computer capacity we now have. The theory has been around since the 1940s.
@herrbonk3635
@herrbonk3635 Жыл бұрын
@@OneAndOnlyMe That wasn't the point. Neural networks are no mystery to me either. My complaint was that this guy doesn't explain anything in concrete terms. It was mainly other models in the 1940s and the better part of the 1900s though. More focus on recursive list processing (Lisp) and logic programming (like Prolog).
@OneAndOnlyMe
@OneAndOnlyMe Жыл бұрын
@@herrbonk3635 I don't think the point is to explain in concrete in terms, more to just explain concepts and principles.
@messiisthebest
@messiisthebest Жыл бұрын
It is all about attention mechanism
@debashishbramha
@debashishbramha 10 ай бұрын
Excellent analysis.Thanks from India.
@darissalzburger
@darissalzburger 10 ай бұрын
I rarely comment the videos, but I had to comment yours. Amazing explanation and visualization. Thanks
@FlareGunDebate
@FlareGunDebate Жыл бұрын
Bitwise operation, if/elseif/else, and neural network are orders of complexity in flow control. ChatGPT is huge in terms of parameters but it isn't any more sophisticated than modern translation software which relies primarily on tons of user data.
@divotiontogod
@divotiontogod Жыл бұрын
right, most people fail to understand and see how chatgpt is not able to for example write a clear code, it generates always a buggy code, and one has to elaborate more on minuscules of requirement for it to change it answer to a more better one. plus its answers are not mathematically correct, ask a few complex math questions and you will know! AI can never beat humans, ill iterate, even the dumbest human!
@williamtim5893
@williamtim5893 Жыл бұрын
The information age creates the data for the AI age
@FlareGunDebate
@FlareGunDebate Жыл бұрын
@@williamtim5893 yeah OpenAI is neither open source nor artificial intelligence
@SubashiniBala
@SubashiniBala Жыл бұрын
Pretty insightful content !! On the side note, I liked that you have brought up an example with Indian prime minister
@SantoshNair1
@SantoshNair1 Жыл бұрын
7:00 - there is a mistake in the graphic at this mark, where the prompt should have been a finance statement/question, but instead it remains the roses poem from the previous example. Probably a copy paste error.
@professorst0sh164
@professorst0sh164 Ай бұрын
Clear & Concise overview with helpful images and analogies. New sub here, looking forward to your other content.
@VictorAntonioLive
@VictorAntonioLive Жыл бұрын
Exceptional video!
@SanjaySingh-jo3py
@SanjaySingh-jo3py Жыл бұрын
Voice to slide !! Perfect, Sir 🙏🙏🙏🙏🙏
@arthurcolle2778
@arthurcolle2778 Жыл бұрын
Excellent video, covers all key concepts - RLHF, PPO, etc... and how they relate to the GPT models. Great content! +Subscribed
@jeroenvermunt3372
@jeroenvermunt3372 Жыл бұрын
Those are concepts for reinforcement learning, I missed the key concepts of the LLM itself. I found out via other sources that the actual key concept of the LLM itself is multi-head attention
@rajneeshverma4026
@rajneeshverma4026 Жыл бұрын
super simple explanation and very insightful.
@renatoigmed
@renatoigmed Жыл бұрын
Even though I don't understand English perfectly, I managed to get a good idea of how it works. it is much more enlightening than the lazy analogy that they just say "ChatGPT talks about everything but has no awareness of what the subject is about". But imagine if there was...
@artlein
@artlein Ай бұрын
Excellent presentation...thank you!
@moiserwibutso4899
@moiserwibutso4899 11 ай бұрын
Thanks for this amazing explanation. The visuals are so fantastic 👌
@dionisos8152
@dionisos8152 Жыл бұрын
Congratulations, this video is very clear and useful.
@amthephoenix007
@amthephoenix007 8 ай бұрын
🎯 Key Takeaways for quick navigation: 00:36 *🧠 ChatGPT is powered by an LLM (Large Language Model) like GPT-3.5, trained on vast amounts of text data to understand and generate human language.* 01:56 *🛠️ GPT-3.5, with 175 billion parameters, is trained on 500 billion tokens of internet data to predict the next token in a sequence, generating text that mirrors internet content.* 02:54 *🔍 Fine-tuning ChatGPT involves a process called Reinforcement Learning from Human Feedback (RLHF), akin to refining a chef's skills based on customer feedback, making the model more aligned with human values.* 04:53 *🔄 ChatGPT's fine-tuning involves creating a comparison dataset, developing a reward model based on feedback, and using Proximal Policy Optimization (PPO) to iteratively improve the model's performance.* 06:24 *💬 ChatGPT incorporates conversational prompt injection to maintain context, primary prompt engineering for conversational tone, and moderation API to warn or block unsafe content, ensuring a safe and tailored user experience.* Made with HARPA AI
@deepflyball
@deepflyball Жыл бұрын
New sub here. Thanks for such a clear explanation. I really enjoy the way you explain things and the graphics you use. Looking forward to more videos. Happy New Year.
@CSCoreDecoded
@CSCoreDecoded Жыл бұрын
Man you explained everything in a simple and clear way. Thank you very much for this helpful content
@tommushrom5929
@tommushrom5929 10 ай бұрын
Build it then.
@CSCoreDecoded
@CSCoreDecoded 10 ай бұрын
@@tommushrom5929I'll
@MrKelaher
@MrKelaher Жыл бұрын
Great video, helps to clear up some confusion by "going behind the curtain"
@goneni1504
@goneni1504 Жыл бұрын
Excellent. Concise but thorough and clever. Thanks a lot. Love the burger analogy.
@roark09
@roark09 Жыл бұрын
This is gold. Thank you!
@sivam5204
@sivam5204 7 ай бұрын
Animations are awesome :) easy to follow !
@moneycrab
@moneycrab Жыл бұрын
Thank you for this! So clear and helpful
@thydevdom
@thydevdom Жыл бұрын
A few months ago I was looking exactly for this kind of video. Thank you!!!
@jdrake411
@jdrake411 Жыл бұрын
I found your review very useful, thank you!
@philipsun4834
@philipsun4834 Жыл бұрын
to be more specific, the minute on 1:55, Token ID is the vector, instead of Token, right? as Token can consist of alpha-numeric value, but the vector is purely the numeric with digits only. that is why the vector database is coming as the storage of those vectors for searching and indexing.
@pawandhailPWRIES
@pawandhailPWRIES Жыл бұрын
Excellent tutorial, very insightful !
@thanhlv2
@thanhlv2 Жыл бұрын
Great video. Keep doing your great work 👍👍👍👍👍
@santi044
@santi044 Жыл бұрын
super well animated video
@bobbyandthomas
@bobbyandthomas Жыл бұрын
Thank you for explaing so nicely!
@imagai.store.2323
@imagai.store.2323 Жыл бұрын
been searching like this one, thank you so much sir
@richardglady3009
@richardglady3009 Жыл бұрын
Thank you very much for this great explanation. As a non-computer expert, the information was well presented and very understandable. Thanks.
@jesuswords5814
@jesuswords5814 3 ай бұрын
super explanation, mind bluing .thanq
@superpowerdragon
@superpowerdragon Жыл бұрын
can you do a video on how Stable Diffusion work technically?
@sudzam
@sudzam Жыл бұрын
Wonderful explanation! Just enough detail to explore sub-topics in detail.. Thanks.
@JBoy340a
@JBoy340a Жыл бұрын
Very nice and clear explanation.
@Tony-dp1rl
@Tony-dp1rl Жыл бұрын
Knew this was coming on your channel, great little intro to the topic for sharing with people, thanks.
@MrDanieluy
@MrDanieluy Жыл бұрын
Brillant resumee and presentation !
@tomtyiu
@tomtyiu Жыл бұрын
wow, now I totally understand how it works technically. Thanks
@williambrackett7100
@williambrackett7100 Жыл бұрын
Fantastic explanation!
@phil7121
@phil7121 Жыл бұрын
Sahn is the Michael Jordan of giving ELI5 explanations of complex things
@wernerkallmann9105
@wernerkallmann9105 Жыл бұрын
Excellent explanation. Thank you very much.
@kennethcarvalho3684
@kennethcarvalho3684 10 ай бұрын
What I don't get is where is all the weights data is stored after training a neural network for image classification?
@nguyenhonghanh2043
@nguyenhonghanh2043 Жыл бұрын
Thanks for the video, I find it very helpful.
@rlewisf1
@rlewisf1 Жыл бұрын
Very useful and professional presentation. Thank you.
@J-Ind24
@J-Ind24 Жыл бұрын
Thank you for the great explaination.
@williebrits6272
@williebrits6272 Жыл бұрын
Awesome, well done
@mehediazad1780
@mehediazad1780 Жыл бұрын
Sir I'm being very honest your 5 to 7 minutes video always taught more than the week of study, these visual are so helpful and also I love the fact whatever word you use you first explain the meaning behind that make's thing more easy to understand(2)
@sheryll9966
@sheryll9966 Жыл бұрын
Great content!
@ganeshkameswaran7123
@ganeshkameswaran7123 Жыл бұрын
Nice explanation, thanks!
@Larry21924
@Larry21924 Жыл бұрын
This content is a guiding star, revealing new pathways of understanding. A book with parallel material touched me deeply. "The Art of Meaningful Relationships in the 21st Century" by Leo Flint
@freekyninjacat8207
@freekyninjacat8207 Жыл бұрын
Question: Where did you get the information about 06:30 (conversational prompt injection, primary prompt injection etc.) from? Is there a scientific paper on these topics?
@Richieexpert-cg3dx
@Richieexpert-cg3dx Жыл бұрын
Hello friend, I noticed that you want more info about how ChatGPT works, let's discuss more and you will know more.
@exxzxxe
@exxzxxe Жыл бұрын
Very well done!
@aigriffin42604
@aigriffin42604 8 ай бұрын
Could you please post something that is more up-to-date to this year thanks!❤🎉😁😊
@rahuldinesh2840
@rahuldinesh2840 Жыл бұрын
This is classic presenation. Thanks.
@terryliu3635
@terryliu3635 Жыл бұрын
awesome video!
@bhushankshire2854
@bhushankshire2854 10 ай бұрын
amazing. what tools do you use to make these videos??
@diondewet8522
@diondewet8522 Жыл бұрын
Wow.....brilliant explanation
@ChrisBrengel
@ChrisBrengel Жыл бұрын
"Tighten your seat belt and enjoy the ride." We live in incredible times! Technology is improving exponentially.
@L_Christ_BR
@L_Christ_BR Жыл бұрын
Estou impressionado com a tecnologia utilizada pelo ChatGPT-4! É fascinante como a Inteligência Artificial evoluiu nos últimos anos, permitindo que máquinas possam entender e responder às nossas perguntas de uma forma quase humana. No entanto, é importante lembrar que, assim como qualquer tecnologia, a IA também pode ser perigosa. A capacidade de aprender e evoluir rapidamente significa que as máquinas podem se tornar imprevisíveis e tomar decisões que podem ser prejudiciais para os seres humanos. É crucial que os desenvolvedores de IA levem em consideração a segurança e a ética em suas criações, para que possamos aproveitar os benefícios da tecnologia sem comprometer nossa segurança - Texto criado pela IA
@PraveensTrail
@PraveensTrail Жыл бұрын
Beautify articulated.
@yuli.kamakura
@yuli.kamakura Жыл бұрын
Very exciting, easy to understand
@BCubDelta9
@BCubDelta9 Жыл бұрын
min 6:33 Could you please provide the paper for the "Conversational prompt injection" term?. I am currently citing in-context learning and prompt learning but this one is new for me and seems helpful.
@hanimahdi7244
@hanimahdi7244 Жыл бұрын
Very nice work, thanks!
@AaronSmith-n3f
@AaronSmith-n3f Жыл бұрын
Great Job, Thank you!
@lloydwyngard7233
@lloydwyngard7233 Жыл бұрын
Great video, very informative thanks!
@damonwu9658
@damonwu9658 Жыл бұрын
Thank you for sharing, great stuff, and langchain next?
@modolief
@modolief Жыл бұрын
Superb, as usual
@kevine.167
@kevine.167 3 ай бұрын
Thanks for your super interesting videos. isnt there a mistake at 7:13? Pre-trained-Model -> N should lead to return "sorry,..."? best Regards
@TynOng
@TynOng Жыл бұрын
Could you cover Vector databases for LLM next time please?
@hamman_samuel
@hamman_samuel Жыл бұрын
I'd like to hear about that too
@onlinecreations7781
@onlinecreations7781 11 ай бұрын
Pretty same as phase of a compiler 😍🙏
@szamee83
@szamee83 7 ай бұрын
Excellent. Thank you
@marciabrown5569
@marciabrown5569 Жыл бұрын
I really enjoyed your analogy. Though it is still over my head I do think I understand a bit more.
@dineshchandgr
@dineshchandgr Жыл бұрын
amazing explanation. thank you
@williamschandran
@williamschandran Жыл бұрын
well explained , Thanks
@Masher2025
@Masher2025 Жыл бұрын
Stop supporting it, it's the end of humanity.
@nagu890000
@nagu890000 10 ай бұрын
At 7:05 , was the user's prompt supposed to be a question about stocks / finance ?
@NaterFernat
@NaterFernat 7 ай бұрын
So, ChatGPT is basically Akinator on steroids.
@fadi77fadi77
@fadi77fadi77 Жыл бұрын
wrong example for build constraints at 7:01? Or did I misunderstand how you provide constraints with a user prompt?
@ParagPandit
@ParagPandit Жыл бұрын
I asked ChatGPT about RLHF and PPO, and it said, this is not how I was trained. 😅😅
@micbab-vg2mu
@micbab-vg2mu Жыл бұрын
Great explanation - thank you
@bitsnbytes4406
@bitsnbytes4406 Жыл бұрын
Great video! Thank you very much.
@vcjayan8206
@vcjayan8206 Жыл бұрын
Great explanation..thank you..
@jigishapatel3194
@jigishapatel3194 Жыл бұрын
Nice video, I believe the 7:01 line Stock/Finance prompt is not correct and its copied from the previous screen.
@homersimpson1199
@homersimpson1199 Жыл бұрын
At 1:30 he mentions the amount of parameter for the models. Does anyone know why these are bounded according to the llm used? And how do these numbers come up?
@inber
@inber Жыл бұрын
Great explanation, much appreciated. I learned a lot.
@MandarPophali-yy1yz
@MandarPophali-yy1yz Жыл бұрын
This is great summary. Can you have quick summary on differences between BARD and chatGPT?
@pelimies1818
@pelimies1818 Жыл бұрын
What is typical energy consumption for one inquiry? For google search the consuption for one inquiry is around 24 hours usage of 2W led lamp. So if you make 10 inquiries per day, it uses around same energy than illumination needed for a small house.
So How Does ChatGPT really work?  Behind the screen!
15:01
Arvin Ash
Рет қаралды 560 М.
Transformers (how LLMs work) explained visually | DL5
27:14
3Blue1Brown
Рет қаралды 4,2 МЛН
Chain Game Strong ⛓️
00:21
Anwar Jibawi
Рет қаралды 41 МЛН
Quando eu quero Sushi (sem desperdiçar) 🍣
00:26
Los Wagners
Рет қаралды 15 МЛН
Top 6 Most Popular API Architecture Styles
4:21
ByteByteGo
Рет қаралды 991 М.
Run your own AI (but private)
22:13
NetworkChuck
Рет қаралды 1,8 МЛН
Google system design interview: Design Spotify (with ex-Google EM)
42:13
IGotAnOffer: Engineering
Рет қаралды 1,2 МЛН
ChatGPT Explained Completely.
27:39
Kyle Hill
Рет қаралды 1,2 МЛН
What are AI Agents?
12:29
IBM Technology
Рет қаралды 1 МЛН
Master the Perfect ChatGPT Prompt Formula (in just 8 minutes)!
8:30
How AIs, like ChatGPT, Learn
8:55
CGP Grey
Рет қаралды 10 МЛН
Large Language Models (LLMs) - Everything You NEED To Know
25:20
Matthew Berman
Рет қаралды 143 М.
Generative AI in a Nutshell - how to survive and thrive in the age of AI
17:57