How to Fine-tune a GPT-3 Model - Step by Step 💻

[@AllAboutAI]

Become a member here: kzbin.infojoin Join the newsletter here: www.allabtai.com/newsletter/

[@andrescolon]

Thanks for your videos and sharing your knowledge in this evolving field.

[@AllAboutAI]

Thank you for the support 🙏⭐️

[@ai-DAAS]

can you link the src code thank you for this great channel

[@joey9784]

where is the GitHub link??? what is the use of watching the whole video when we can't implement it??

[@talkingtoai]

Not sure what is more outstanding, the content or the thumbnails? 👌

[@AllAboutAI]

Thnx😃

[@ajitkumar15]

Thank you for this great video !!! , please share the link to the code sample.

[@christophchristoph9909]

Thanks for the video! Why did it you use Ada as the model? It’s much cheaper? Also in use later

[@TomaszMadry]

What was the website for selling/buying programs?

[@mauricioosorio3103]

Do you think that we can train a AI with all company data and then use the chat to ask questions about all that information in a natural language?

[@daniyalumer1425]

I was wondering about the same thing

[@erobusblack4856]

we got agi with either the perceiver line of modalities or ig really Gato 🤔 but vima is the Nvidia version

[@adamhughes4496]

This was a perfect introduction of how to start using chatGPT to create your own models. Incredible that learning python 12 years ago has now equipped me to fine tune the most sophisticated AI models on the planning. LOL what a time to be alive

[@automioai]

Almost the same story here XD

[@ZParodie]

Great vid, thanks a ton

[@thecutestcat897]

Thanks, this helps me a lot!

[@ArthurPex]

Where is the link for the gist shown on video? great content btw!

[@AllAboutAI]

Look up David Shario, a genuis

[@kevinsequen6674]

What are only commands that I have to execute Disuculate or those that I have to have installed on my console.

[@YuriRJRW]

How can I use this models in my API ? I tried to change the name of model but doesn't work

[@gibsonmunene3462]

Thank you so much for this! I wonder whether you have any ideas on how I can finetune gpt3 with image datasets.Something like a receipt, would the approach be the same or would it follow a different approach

[@Jona]

I'm maybe completely wrong here … But is there a way to train the knowledge into GTP-3 and get answers from that dictionary? (Maybe convert the PDF to plain Text or something" … Chat GTP already kinda does this; but not with a whole book (too many characters) … any easy way to do that with GTP-3?

[@AllAboutAI]

Check out these 2 vidoes:) GPT-3: How to Summarize a PDF (70 000+ Words) 📔 kzbin.info/www/bejne/d4unh6mMjs57nMk

[@AllAboutAI]

I Built My Second Brain with AI (GPT-3) kzbin.info/www/bejne/Z5yVe6OAh66id6M

[@raminoureddine6342]

thank you, that was amazing.

[@wasima4463]

@All About AI can you provide the github link to upload jsonL (as you mentioned at 19:30)

[@AllAboutAI]

Yes! send me a mail [e-mail]

[@ivanjosephgamboasanchez1158]

This video is excellent, good job. Is it possible to access this project from your github, if so where can I find your repository, thanks.

[@AllAboutAI]

join discord.gg/Xx99sPUeTd and send me a DM

[@ivanjosephgamboasanchez1158]

@@AllAboutAI I sent you a friend request, otherwise I can't send you a message. I'm Goodjoe01

[@tiechengspreadsheets]

Hello, thank you for this video. Where could we find the files you use in your video?

[@AllAboutAI]

I dont have a public GitHub yet, but i migth make one soon

[@AiAngel]

Using Notepad++ in bright mode...

[@XWSshow]

Do someone has an Solution for c# especially for unity?

[@thelavalampemporium7967]

how do i change the n_epochs parameter when fine tuning?

[@edwards2990]

could U have a step by step Video on creating a DATA SET importing into AI GPT for training a Model of a Script not in it's DATA BASE .

[@AllAboutAI]

Noted :)

[@AdamShaw-dd3up]

What script is the one you are using from david shapiro? Couldnt figure it out just looking at hi github

[@AllAboutAI]

This is several months ago now. So i really hope he still has them up. He is kinda my mentor on this stuff so :)

[@andrewbouras3880]

Is there any link with the code in the description?

[@AllAboutAI]

Send me a mail if you want access:)

[@mathlab_jordan]

does this still work? I got it to work once but I'm having trouble getting it to work again

[@Benjamin-vw2km]

Well explained, thanks. One question though: Does it actually make sense to train GPT with data that it has generated itself? Like, does your prompt at the end actually give a better answer than when you would ask it straight away?

[@paulmuehleip]

I was wondering this as well. The video is a great “how to” but I’m not sure how much benefit you get from training it on output it has generated. It may make answers more opinionated depending on the bad examples you filter out though. 🤔

[@larissapinheiro8236]

The ideia of such training is to specialize chatGPT with your own data. For example, you can train it with your own market list, so in the end you can feed your trained model your current list and it will inform you of absent common items (just a dummy exemple).

[@Trancer006]

Once fine tuned, is the GPT not allowed to have access to its default database? I just want to give it a certain voice I don't want to feed everything

[@yoniwoker]

Can GPT-3 be downloaded directly to the PC?

[@AllAboutAI]

Nope :) But i think you could run GPT-2 locally with a get Hardware setup

[@0xcBenevolent]

How viable is it to develop an AI writing tool like Jasper using GPT-3? Do I need to learn train the model or can I use the pre-trained GPT-3 model? Could you also advise me on the best way to get started writing prompts that are both effective and efficient? Is there any book/manual on writing high quality prompts?

[@AllAboutAI]

Jasper is built on top of GPT-3 so thats is very viable. Would be better if you contacted me on Discord or mail

[@pabloaf87]

Thanks for this video, that's useful and amazing!

[@AllAboutAI]

Very happy to help :)

[@wallisonbrumatti3676]

Hi Kris! How are you? Do you have the project link in github?

[@cameronscryptos2064]

This is a great video! thank you for all the info. You mentioned in the video you would link to your code. Any chance you could share it?

[@Trancer006]

So if GPT is fine tuned does that mean GPT doesn't have access to outside data at all?

[@FilmFactry]

I'm googling the definition of SYNTETIC but I can't find it. It suggests Synthetic?

[@AllAboutAI]

?

[@FilmFactry]

@@AllAboutAI Is "Syntetic" a real word? or is it the misspelling of Synthetic?

[@TheVitkuz]

Thank you for such detailed wlkthrough

[@mohammadkassir3545]

can you please provide the code and files you are using?

[@AllAboutAI]

Yes! send me a mail

[@AliKhan-i6q7g]

where can we get the code

[@ayw7542]

Loved the Video , does the openAi charge based on the dataset we use ?

[@AllAboutAI]

Yeah, input size matters

[@Stuart_Bache]

Hello, when uploading the fine-tune model I repeatedly receive this Treaceback error: Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/openai/openai_object.py", line 59, in __getattr__ return self[k] KeyError: 'json' I've tried everything but I can't figure it out. Do you have any advice?

[@AllAboutAI]

Hello Stuart! Not 100% sure, as I am not a Python expert. But your json structure is good (line59)?

[@Stuart_Bache]

@@AllAboutAI Thank you for replying. Yes, I believe so. That line doesn't exist in my code, but in the code of the file 'openai_object.py' situated in the Python Framework library. I'm at a loss.

[@AllAboutAI]

hmm, i cant really help. Maybe ask on a Python reddit:)

[@erictan9274]

How can we fine tune gtp3 for quantitative reasoning ?

[@AllAboutAI]

ohh i have never tried that. Few shot prompting maybe for specific outputs🤔🤔

[@erictan9274]

@@AllAboutAI yeah step by step quantitative reasoning seems impossible even with fine tune

[@AllAboutAI]

Ah okei, you think its a model problem?

[@AvizStudio]

This tutorial helped me a lot. Gave me good introduction to fine-tuning. Thanks you

[@AllAboutAI]

Glad I could help :D

[@jrey4057]

Hi sir, amazing content! I'm trying to find the Fine Tune option in 21:30 in the MODEL, but it doesn't appear. How did you find it? did you uploaded it? if yes, how? thanks in advance!!

[@jrey4057]

@Tushar Chakraborty, I dont, my man. He never replied

[@Stuart_Bache]

This was incredibly helpful. I've been wanting to test something like this with my writing. I have wrote book 1 a few years ago and I wonder - from your experience - whether I could use something like this to write book 2 (just as a test, I have children now so my time is limited in a great way)? I assume even if I could create something I would need to consistently add short synopsis' of what came before.

[@AllAboutAI]

Hello Stuart I would start with short stories and go from there! I think you could generate some pretty good synopsis generators with fine-tuning tho!

[@marcaurelio74]

Thank you very much😀great tutorial

[@AllAboutAI]

Glad you found it helpful :)

[@planetmars6615]

Helpful video.. thanks boss. Curious, u created the thumbnail using AI? :P

[@AllAboutAI]

Hey!:) yes i did! This one was with Midjourney

[@nazifkadiroglu7203]

Is it then possible to create a web app or something that uses the new fine-tuned gpt 3 or can it only be used on the playground?

[@AllAboutAI]

do you mean you own fine tuned models or text_davinci_003?

[@nazifkadiroglu7203]

@@AllAboutAI the own fine tuned model

[@ozorg]

great info! thx!

[@AllAboutAI]

No problem mate :)

[@checkmate4832]

Hello do u have the python script ? Thx

[@AllAboutAI]

Hello:) I dont have a public GitHub atm, but i am working on it!

[@checkmate4832]

@@AllAboutAI thx u !

[@rezatay]

If you are using Shapiro's code you should give proper credit to him and share his modified code also address and location of his code. That is just a right thing to do. Shapiro had the generocity to make his code public. To be gacious to him, you should share his modified code at the minimum.

[@dafran500]

Awesome content and channel! I subscribed to it. Can I use books to finetune gpt? What kind of preprocessing/categorization do the books should have?

[@AllAboutAI]

Watch my video coming out today. Might be what you need instead of fine-tuning

[@huymakazi1028]

Great video, like a good movie, it all makes sense in the end. I am just concerned by the price … I am myself definitely not an experienced programmer, learning to fine-tune GP3 on different prompts, datasets, making the inevitable mistakes etc. … might be quite expensive

[@AllAboutAI]

Thnx :) yes be careful with fine-tuning, start out small atleast

[@Silkari]

Where are the github links?

[@suyeongchoi2967]

where is the github link..

[@etaredaferaphaeljuliethai1220]

We are looking at fine tuning the Davinci model to better suit our goal, can we have a meeting to discuss this?

[@AllAboutAI]

Send me an e-mail: [e-mail]

[@etaredaferaphaeljuliethai1220]

@@AllAboutAI I have sent you an email

[@AllAboutAI]

hmm, try again :)

[@etaredaferaphaeljuliethai1220]

@@AllAboutAI I just did

[@widerthanpictures]

Can you share a github repo of what you're showing in the video?

[@AllAboutAI]

I might make a public GitHuB repo soon

[@serdar1629]

Link to github?

[@AllAboutAI]

I have a tutorial and github repo on my KZbin membership page :) kzbin.infojoin

[@mmuneebajaz]

And meet our sponsor for today video ~~!DAVID SHAPIIIRO*&^

[@yu-tingchang5032]

where is the python script

[@jd_turner_ai]

Ok, but where's the link to the code you used? It's kind of ridiculous that you say "step by step" but you don't actually provide useful information for the people watching in order for them to do it themselves.

[@00000a0009]

Why don't you do it for the community? Thanks

[@Neokalix]

​@@00000a0009 It's as if you don't realize that he asked a question.

[@00000a0009]

@@Neokalix I know that it is annoying to copy from the video, but to me it seems that in the video there are all the steps and the code

[@Anonym-ny6wz]

Well he told you it was from the GitHub of David shapiro. I’m sure you can find the matching code

[@10KRotator]

are you swedish?

[@AllAboutAI]

Norwegian!

[@SanjayRoy-vz5ih]

My thought process is that we shouldn't start with fine tuning in beginning itself and take advantage of GPT 3 or 3.5, mainly davinci...and take its full capacity until you really need a fine tuning due to possible "hallucinations" in the process

[@maxihamu]

You look like you are about to sneeze all the time :)

[@benchokwaiman]

I don't understand how this fine tune model is in any way better then the regular chat GTP3.

[@siddharthshukla3557]

i see 999 likes, i press like :)

[@jordanchristley1306]

Amazing video! thanks