How to Fine Tune GPT3 | Beginner's Guide to Building Businesses w/ GPT-3

  Рет қаралды 97,509

Liam Ottley

Liam Ottley

Күн бұрын

Пікірлер: 241
@LiamOttley
@LiamOttley Жыл бұрын
📚 My Free Skool Community: bit.ly/3uRIRB3 🤝 Work With Me: www.morningside.ai/ 📈 My AI Agency Accelerator: bit.ly/3wxLubP
@TomParish
@TomParish Жыл бұрын
Liam, you rock, this is EXACTLY what I was looking for, a step by step guy to training. It's weird how difficult it's been trying to find something like this and you nailed it. Thank you so much.
@LiamOttley
@LiamOttley Жыл бұрын
I'm still digging into this stuff and learning myself so stay tuned for a follow up. There's a lot of extra work needed on these models to become usable!
@curtisfoster540
@curtisfoster540 Жыл бұрын
Not weird at all, Tom...you're just on the cutting edge of this blossoming industry because you are here seeking these answers, answers to questions that literally 99+% of the population don't even know to ask. So cheers! And Liam does rock lol
@tom-greg
@tom-greg Жыл бұрын
You should end your completions with a stop sequence like ### Then you won't see results like at 12:23 You can do this in the python code so it is added to all completions :)
@benm8545
@benm8545 Жыл бұрын
Each completion (in the prompt completion pairs) should end with a ###? This will prevent the finished product from continuing past the desired output?
@musstafawi2337
@musstafawi2337 Жыл бұрын
Thank you so much Liam, Keep it up with these great videos
@duncanmitchell8425
@duncanmitchell8425 Жыл бұрын
Great video 👍. Though I just can get the model to return the correct information. I ask it for stats for a particular player and it gives me stats for a different one. I have tried several times with different training tutorials, but each one gives me the same wrong or nonsense results. I am wondering if the ai is having a breakdown!!??
@王鸫民
@王鸫民 Жыл бұрын
Learned a lot from this video, even though my English is not good enough to understand all the content of this video. Thank you Liam !
@creneemugo94
@creneemugo94 Жыл бұрын
I created a no code interface that will take multiple paragraphs of text and generated prompt/completion pairs for fine tuning from them. good for chat Assistants.
@miltondavilaharjula
@miltondavilaharjula Жыл бұрын
Why do your completion stats differ from the JSONL file (for the same player)? For instance, Giannis Antetokoumpo played 16 games (according to the JSONL file), but the completion says the same player has played 20 games.
@say.xy_
@say.xy_ Жыл бұрын
Bro this is all what I'm searching for, much appreciated and waiting for moree 🙌
@LiamOttley
@LiamOttley Жыл бұрын
stay tuned! Some heat coming next week
@MotunBizAcademy
@MotunBizAcademy Жыл бұрын
Awesome video. Please can this be used for bias evaluation mini-project?
@Kalease54
@Kalease54 Жыл бұрын
Nice work Liam and thank you for taking my feedback from the first video in this series.
@LiamOttley
@LiamOttley Жыл бұрын
Ask and you shall receive! Thanks for the support man 🙏🏼❤️
@jameschek
@jameschek Жыл бұрын
loved the video, this is exactly what i was looking for
@abhaybabbar395
@abhaybabbar395 Жыл бұрын
Great Video!! I wanted to know how I can use it for my use case. I have several reference files, i.e. chapter 1, chapter 2, etc. containing texts and tables. I also have some files with a question and answer, where the answer is extracted from multiple files called chapters. Now the user can ask any question and we need to give answers in text and table format. The answer is hidden somewhere in those chapters. I want the model to learn to give me the correct table related to the question. I hope I am able to explain my use case. Any help would be appreciated. Thank you in advance!
@sarbanimaiti8839
@sarbanimaiti8839 Жыл бұрын
This is great video. Thank you for sharing. One thing I observed when I fine tuned Chatgpt with my custom csv data, chatgpt is answering query related to my data but lost its generic knowledge. If I change the context from my dataset, fine tuned model is not able to answer the generic query with which it is already trained as a LLM. Any thought?
@edwnlau
@edwnlau Жыл бұрын
Great video! Exactly what I was looking for. One question, does OpenAI charge for all the information it reads, over and over again, every time it looks up information in this file?
@Ginexmail123
@Ginexmail123 Жыл бұрын
what if we ask questions other than the data in the fine-tuned model?
@nickluo666
@nickluo666 Жыл бұрын
Thank you so much for the video, I am getting issues that "tream interrupted (client disconnected)." Does any one know how to fix it?
@JordanCzajkaWMU
@JordanCzajkaWMU 9 ай бұрын
I am currently stuck trying to "export OPENAI_API_KEY=". I was wondering if there is a new way to do this since this video has been posted. I noticed that the "Fine Tuning" section is not the same as this video anymore. I appreciate any help. -Mr.Late to the Game
@jennyhorner
@jennyhorner Жыл бұрын
I’m working on an iPad Pro. Are there any videos re apps etc? Is there anything I won’t be able to do via an iPad?
@shravanacharya4376
@shravanacharya4376 Жыл бұрын
What a great video with so much information.Thank you Liam
@rushdamansuri8545
@rushdamansuri8545 Жыл бұрын
How do we finetune it for classification. Also, do we have to have the paid version for finetuning?
@karimgamal1208
@karimgamal1208 Жыл бұрын
You really did a good job, thank you
@AZ1Productions
@AZ1Productions Жыл бұрын
Been waiting for this! Im doing a special business i want to show it to you after! Its crazy
@LiamOttley
@LiamOttley Жыл бұрын
Go for it!
@mikew2883
@mikew2883 Жыл бұрын
Awesome stuff! Keep it coming! 👍
@LiamOttley
@LiamOttley Жыл бұрын
Thanks! Just posted a prompt engineering guide 🤝
@Artem-jm9xd
@Artem-jm9xd Жыл бұрын
Very thorough! Thank you
@yutumedia
@yutumedia Жыл бұрын
Excellent work! Thank you!
@bibinkunjumon5998
@bibinkunjumon5998 Жыл бұрын
i did it man..successs.thanx
@tvboxtvboxlauncher7353
@tvboxtvboxlauncher7353 Жыл бұрын
wow.. Bro you are amazing.. I have a company based around exactly this..we have full knowledge base faqs and answers etc tc.. the only thing we are having trouble with is the actual ability to change the tone in the user dashboard so its noticable if thats a trick in the fine tuning. Like for eg: humourous, profesional, sassy etc etc.. would LOVE any guidence
@TheMarkoni1985
@TheMarkoni1985 Жыл бұрын
Great video. One part is just a little unclear, is the fine-tuning process send all the data for every question each time, or just once, so it keeps the data in a kind of context? Thanks
@nattyzaddy6555
@nattyzaddy6555 Жыл бұрын
So where do I get a fine-tuning dataset that would improve its ability to code?
@bikashtamang9756
@bikashtamang9756 Жыл бұрын
I have a doubt i didn't knew what was going on terminal what did you write there
@olejerx
@olejerx Жыл бұрын
Is it possible to ask questions in natural language and receive appropriate answers using Fine-Tuned model? For example you asked "What are Karl-Anthony Towns' statistics", but would it work if you ask differently. "what is the stats of Karl-Anthony"? Or should I fine tune model for every possible question?
@yaswanthdevarapalli3080
@yaswanthdevarapalli3080 Жыл бұрын
Nice Question
@vipanchika5059
@vipanchika5059 Жыл бұрын
I haven't any idea of it I want your guidance to do this business
@ZackHughes
@ZackHughes Жыл бұрын
Great start here
@LiamOttley
@LiamOttley Жыл бұрын
Got some follow ups to this planned. Been digging on why the fine tune completions aren't on ChatGPT's level
@tiberiubuta
@tiberiubuta Жыл бұрын
Good video; down side is I estimate the tokens needed to train Da Vinci on my data set, would cost me around $1000, with fairly high usage costs too, and probably regular model update costs, so until prices come down, it's "no thanks" to Open Ai from me ...
@zikwin
@zikwin Жыл бұрын
Curie is better at summarization, language translation, and sentiment classification. On the other hand, Davinci is better at solving problems related to inference and logic
@SeppyDawg
@SeppyDawg Жыл бұрын
Thank you! But can we do this with GPT4?
@venkatesanpalpandi257
@venkatesanpalpandi257 Жыл бұрын
I have one doubt if we give the only exact prompt it will show the completion or if we given reelevated prompt it shows completion correct or not give the completion ? any one please clear my doubt.
@LiamOttley
@LiamOttley Жыл бұрын
More info in next video mate stay tuned I've been digging...
@venkatesanpalpandi257
@venkatesanpalpandi257 Жыл бұрын
@@LiamOttley waiting upload as soon possible
@robertocolombo3610
@robertocolombo3610 Жыл бұрын
Hi, great and clear video! How would one go about updating data? Will the model understand if i fine-tune the same basketball player with updated statistics? Or will the model "duplicate" the player?
@GracefulSeraph
@GracefulSeraph Жыл бұрын
I don't understand why, when I ran the code no json file was generated?
@b3armonk
@b3armonk Жыл бұрын
Thank you Liam for this tutorial! Is it just me, or the data that is prompted into GPT is totally inaccurate. Even the output from the example in the video is wrong. They do have some information right, but it is not reliable for production atm. I wonder is it a prompt issue or is it just the way davinci is based? Hope someone shares some of their insights about it.
@RakshitSharma-v1f
@RakshitSharma-v1f Жыл бұрын
i do the same. but fine tune doesn't give me right answer to my prompt.
@turbolike7
@turbolike7 Жыл бұрын
Great tutorial! Im getting issues with data accuracy. Player stats are not correct.
@bibinkunjumon5998
@bibinkunjumon5998 Жыл бұрын
How did you fix the short length answer? Is it by training the model with davinchi instead of curie
@phyokyi9140
@phyokyi9140 Жыл бұрын
I try with OpenAI fine tuning. Just like this one. I even ask exactly same as my prompt, doesn’t get answer as I input. That’s so annoying.
@LiamOttley
@LiamOttley Жыл бұрын
Update video coming!
@JamesJosephFinn
@JamesJosephFinn Жыл бұрын
Would you consider something like Stack-AI to be a suitable GUI to abstract away the custom scripting you're doing here? Awesome content, btw. Subbed last week.
@chrisroberts1773
@chrisroberts1773 Жыл бұрын
How is this more useful than a simple table lookup? I'm sure there are advantages, but in this particular example, what are they?
@LiamOttley
@LiamOttley Жыл бұрын
New video coming to explain fine tuning further!
@ln1092
@ln1092 Жыл бұрын
Great video. Thanks for this. Just something I noticed between the first video and this one is that the first one allowed for different types of prompts where this one has the standard "Write a summary of..." for each prompt. I guess the script can be tweaked to allow for a variations of the prompt to build a stronger fine tuned model. Either way great content and thanks for the inspiration. The possibilities are limitless here. All the best!
@LiamOttley
@LiamOttley Жыл бұрын
I have an update video coming soon. I’ve found out more info to make your fine tunes better
@Ginexmail123
@Ginexmail123 Жыл бұрын
i'm currently using free api key, is it possible to fine-tune with that key?
@thanhquachable
@thanhquachable Жыл бұрын
I got stuck in openai tools fine_tunes.prepare_data -f , it keeps saying the file is not in valid json format. My file is exactly the same as the file in the video. Any idea? Thanks
@tabindas7305
@tabindas7305 Жыл бұрын
I was so excited to find this but I noticed that fine-tuned models are not reliable. A language model can play with the language for sure but it shouldn't alter important numbers in completions. As we can see in this video how it changes stats from "16" to "20". I think this is an early stage and fine-tuning should not be relied on specially for numbers data. Any views?
@LiamOttley
@LiamOttley Жыл бұрын
Been looking into solutions for this, will make a video when I’ve got it figured out
@BrandoPriest
@BrandoPriest Жыл бұрын
These videos are fire! 🔥
@LiamOttley
@LiamOttley Жыл бұрын
Thanks bro x
@IMnotFATbutUare
@IMnotFATbutUare Жыл бұрын
Do i need to learn a bit of python to understand what you are doing?
@ivantadin7245
@ivantadin7245 Жыл бұрын
In the video at 12:37 it says that si Antetokounmpo was introduced in the Hall of Fame in 2037. Is this coming from bad data on the dataset, or?
@yaswanthdevarapalli3080
@yaswanthdevarapalli3080 Жыл бұрын
Hey Hi Can you Help me with this Error: openai api fine_tunes.create -t prompt_completion_pairs_prepared.jsonl -m davinci usage: openai api [-h] {chat.completions.create,images.generate,images.edit,images.create_variation,audio.transcriptions.create,audio.translations.create,files.create,files.retrieve,files.delete,files.list,models.list,models.retrieve,models.delete,completions.create} ... openai api: error: argument {chat.completions.create,images.generate,images.edit,images.create_variation,audio.transcriptions.create,audio.translations.create,files.create,files.retrieve,files.delete,files.list,models.list,models.retrieve,models.delete,completions.create}: invalid choice: 'fine_tunes.create' (choose from 'chat.completions.create', 'images.generate', 'images.edit', 'images.create_variation', 'audio.transcriptions.create', 'audio.translations.create', 'files.create', 'files.retrieve', 'files.delete', 'files.list', 'models.list', 'models.retrieve', 'models.delete', 'completions.create')
@ericlamideas
@ericlamideas Жыл бұрын
are there any 0 to 1 ideas you think? this seems cool i think there's some potential but not sure it's exponentially better than what's out there, kinda seems like abstracting a database so it's easier to pull information from. would be cool if we could get insights to improve a business or find inefficiencies etc
@LiamOttley
@LiamOttley Жыл бұрын
Yep 100%. This is a simple application that allows you to interact with a dataset more naturally but there will be far better applications in design imo. Eg training on website code for what is a good landing page for xyz industry and providing it with your product info to build out in seconds
@guillermorodriguez8916
@guillermorodriguez8916 Жыл бұрын
I got this error: Upload progress: 100%|##########| 440/440 [00:00
@jaywu-kt5ff
@jaywu-kt5ff Жыл бұрын
wonder why can't we have one prompt to list the questions and expect the output, why do you need to ask "do you understand" and continue with a following prompt?
@LiamOttley
@LiamOttley Жыл бұрын
No harm in confirm that it has understood the information
@theobellash6440
@theobellash6440 Жыл бұрын
I’m used to following videos at 1.5x speed. 😅 You brought me to 3x😅
@b3armonk
@b3armonk Жыл бұрын
at 8:07 where you have an error to export keys for windows: To set an openai API key in your terminal, instead of export OPENAI_API_KEY="" you set the api key in the terminal prompt openai -k api fine_tunes.create -t “” -m davinci
@b3armonk
@b3armonk Жыл бұрын
I realise this solution is not the best as you need to include the key everytime you run it. However I am still unable to set the API key permanently
@estudio_sobre_ruedas
@estudio_sobre_ruedas Жыл бұрын
Thanks!!
@b3armonk
@b3armonk Жыл бұрын
@@estudio_sobre_ruedas did you manage to get accurate fine tuned results? cuz my results in davinci is all wrong.
@estudio_sobre_ruedas
@estudio_sobre_ruedas Жыл бұрын
@@b3armonk how many prompts did you include? I've included only 3 to see what happens. I can choose my trained model but logically It seems to be broken. I know its cause the poor prompts. In the future i'll add min 100 prompts
@estudio_sobre_ruedas
@estudio_sobre_ruedas Жыл бұрын
@@b3armonk and i trained Curie, because davinci its so "artist"
@AI-ByteBard
@AI-ByteBard Жыл бұрын
Nice Video! It's a bit hard to follow when the video is speed up. 0,75 speed seems so much more natural
@LiamOttley
@LiamOttley Жыл бұрын
Noted!
@tchesnokovn
@tchesnokovn Жыл бұрын
Yup. Too fast
@simon1386
@simon1386 Жыл бұрын
Great valuable video. Thanks man. 👏
@nesdi6653
@nesdi6653 Жыл бұрын
@@LiamOttley i watch videos on a loop so sped up is good for me
@muath7962
@muath7962 Жыл бұрын
Actually i am watching the video on 1.25x 😅 lol
@GabrielRamirez0
@GabrielRamirez0 Жыл бұрын
Can you limit the fine tuned model to only use the data you fed it and nothing else?
@LiamOttley
@LiamOttley Жыл бұрын
New video coming to explain this but no, you can’t 👍🏻
@markgarrett2971
@markgarrett2971 Жыл бұрын
Fantastic videos! I have is I'm creating Google bigquery databases for my clients with all of their POS data and inserting additional data such as labour, visitors, other things that are going on in the marketplace. Currently I'm working with developers to refine this data model be used with a visualization tool. Based on what you've shared above in the video, is it possible to use this method to query the database?
@kevinkate4500
@kevinkate4500 Жыл бұрын
I cant fine tune the model bro, it says Billing Hard limit has reached. but its my first time creating an API & first use
@pavelsebastianovich1450
@pavelsebastianovich1450 Жыл бұрын
Interesting guide Liam, thank you for the video 👍
@LiamOttley
@LiamOttley Жыл бұрын
No problem 👍
@N-PTRS
@N-PTRS 11 ай бұрын
If i was looking for someone who knew all this python language stuff what would i search for. Are they "coders"?
@ksgpersonal
@ksgpersonal Жыл бұрын
The video was a bit of storm for me as I am not a code guy but hope to grab it from the description. Another helpful video.
@LiamOttley
@LiamOttley Жыл бұрын
Thanks mate, hope you can go back over the vid and get the bits you need out of it!
@multinetcity
@multinetcity Жыл бұрын
@@LiamOttley need more help regarding the above kindly help me from the basics.bcz i don't know coding.
@RyanEaker-x2f
@RyanEaker-x2f Жыл бұрын
Can yo do this with multiple files? I am talking to a customer who has years of data on lumber and materials. Is it possible for me to do this with all his data so that chat gpt can then reference and answer against all the data across all files?
@RyanEaker-x2f
@RyanEaker-x2f Жыл бұрын
Also does this only work with preset prompts like you have here or is the premade prompts of "write a summary of X statistics" just to train the model and after that and fine tuning I can ask anything against all files uploaded?
@andreylimagrowth
@andreylimagrowth Жыл бұрын
Man this is great. And how do you say to it that the answer is wrong? Do you have to tune it againg with all the previous information and the new ones?
@wajidalikhan28
@wajidalikhan28 Жыл бұрын
Great video. As user didn't know about what question exact words so what happened if user put a query with words that didn't match with the question? I'm talking about the fine tune gpt window.
@LiamOttley
@LiamOttley Жыл бұрын
With enough data it would be able to understand and answer the question
@TINTUHD
@TINTUHD Жыл бұрын
great video!!
@b3armonk
@b3armonk Жыл бұрын
have you successfully fine tuned the model? how was the results?
@ivonvoid
@ivonvoid Жыл бұрын
Nice video focused on the task at hand with no fluff. Can you do the same with GPT4All ?
@sai64942
@sai64942 Жыл бұрын
When I’m trying to tune the model, it shows the error as read timeout any idea?
@kailezhao8825
@kailezhao8825 Жыл бұрын
Why my terminal doesn't tell me my model name? Anyone can help?
@joshmay9531
@joshmay9531 Жыл бұрын
Great vid! Does anyone know if I train a modal on a large amount of data on my computer (CPU) or would I need to spin up a Google Colab and use GPUs?
@MeyerAction-pk4tu
@MeyerAction-pk4tu Жыл бұрын
Hi Liam. Liked your tutorial. Just having problems with this step: openai tools fine_tunes.prepare_data -f pairs_clean.json I get this: Analyzing... ERROR in read_any_format validator: Your file `pairs_clean.json` does not appear to be in valid JSON format. Please ensure your file is formatted as a valid JSON file. Aborting...PS C:\003_chatGPT_finetune> My JSON file is ok: UTF-8, no special characters and no BOM. chatGPT couldn't help me. Would you do it, please.
@nat.serrano
@nat.serrano Жыл бұрын
same error here
@MeyerAction-pk4tu
@MeyerAction-pk4tu Жыл бұрын
@@nat.serrano I changed the logic in the for loop and finally worked por me: Problem seems to be in that JSON generator script. Note that my CSV datasets has 2 columns only -> questions & answers. Hope you can solve it too! import csv import json # Abrir el archivo CSV y leer los datos en una lista with open('data_test_utf8.csv', 'r') as file: data = list(csv.reader(file)) headers = data[0] data = data[1:] # Crear la lista de pares de texto "prompt" y "completion" pairs = [] for pregunta in data: prompt = pregunta[headers.index('preguntas')] completion = f"{pregunta[headers.index('respuestas')]} {pregunta[headers.index('preguntas')]} " pairs.append({"prompt": prompt, "completion": completion}) # Exportar la lista de pares de texto como un archivo JSON with open('pairs.json', 'w') as file: json.dump(pairs, file)
@nat.serrano
@nat.serrano Жыл бұрын
@@MeyerAction-pk4tu I fixed it as well, but in my case it was an env problem I used another mac with clean python3 installed and it worked
@LiamOttley
@LiamOttley Жыл бұрын
Seems like you guys got it sorted? I suggest you download and install prettier and do the option, shift, R command. That usually fixes it for me. If not the try with JSON validators free online
@bibinkunjumon5998
@bibinkunjumon5998 Жыл бұрын
YOu should also include the cost incurred in this training
@truong_se
@truong_se Жыл бұрын
Can u make with curl
@DAYSHIVANSH
@DAYSHIVANSH Жыл бұрын
How can i get / make data for training ?
@ИванКоряко-ц5б
@ИванКоряко-ц5б Жыл бұрын
How long to wait for the model Davinci to fine tune? I used curie - it was about 3-5 minutes But I didn’t wait until the end for davinci model😕 I am not satisfied with the answers for curie but I used only 25 prompt-complition pairs for very small csv. there were multiple responses for one questions
@LiamOttley
@LiamOttley Жыл бұрын
Depends on how big your dataset is, Davinci was 5 mins for me but could be because my laptop has a big GPU to speed things up. I’ll get back to you on the multiple responses.
@ИванКоряко-ц5б
@ИванКоряко-ц5б Жыл бұрын
@@LiamOttley ok, I made it in davinci model. But…should questions be according to prompts? Any mistakes or differences and answers are not so satisfactory😃may be I don’t understand fine-tuning role fully
@mrnoname8508
@mrnoname8508 Жыл бұрын
I appreciate you bro , thanks for the google doc that also helped a lot
@LiamOttley
@LiamOttley Жыл бұрын
No problem brother thanks for watching 🙏🏼
@simon1386
@simon1386 Жыл бұрын
Great job 👏
@hassaniftikhar5564
@hassaniftikhar5564 Жыл бұрын
Stream interrupted (client disconnected). To resume the stream, run: i am getting this error
@Sara-s-playground
@Sara-s-playground Жыл бұрын
try to switch off your wi-fi and switch it on back and then every time it says this error you keep resuming using prompt they provided
@b3armonk
@b3armonk Жыл бұрын
I get this error often too. But I can always resume it via prompt
@AZ1Productions
@AZ1Productions Жыл бұрын
How can I put this model into my own website?
@LiamOttley
@LiamOttley Жыл бұрын
I'm working on a video for this at the moment!
@ln1092
@ln1092 Жыл бұрын
Can you share your website? I can assist you with this if required, as I have done it on my websites. Thanks
@bombibombi7258
@bombibombi7258 Жыл бұрын
{"prompt":"what is my name ->","completion":" your name must be Adiyahuu END"} this is my preprared data. I created davinci model, but never answered me correct answer. I tried many ways and can not find what I did wrong
@codecrafts5263
@codecrafts5263 Жыл бұрын
can i give json object as input in prompts?
@LiamOttley
@LiamOttley Жыл бұрын
Yep!
@justadigitalmarketer
@justadigitalmarketer Жыл бұрын
how comes fine tuning doesnt give accurate results pulled from the data? could you make another video going into further detail on how to get it accurate
@justadigitalmarketer
@justadigitalmarketer Жыл бұрын
i done some research and people seem to believe fine tuning is not as effective as manually training the model yourself because fine tuning mostly helps gpt with formatting rather than data accuracy
@LiamOttley
@LiamOttley Жыл бұрын
Yes this is correct, new video coming on this soon
@justadigitalmarketer
@justadigitalmarketer Жыл бұрын
@@LiamOttley no worries, also using vsc some code is different on windows than mac so i struggled to do it but got there in the end with some different code thant what openai provides such as 'set' instead of 'export' if youd like all the changes for windows users i can give you the ones i used
@justadigitalmarketer
@justadigitalmarketer Жыл бұрын
but i have no experience in coding so probably not that helpful ol
@alexandrecampanha4385
@alexandrecampanha4385 Жыл бұрын
Can the input be a website, for example Wikipedia website and the prompt would give me information based on what's in the website?
@LiamOttley
@LiamOttley Жыл бұрын
This requires a different method... Video coming soon!
@RangaNanayakkara
@RangaNanayakkara Жыл бұрын
Thanks man
@safirot2
@safirot2 Жыл бұрын
Is there a way for the language model to answer only those questions that relate to the prompts we set up? To give more precision to the chatbot's answers. Thank you very much for the content!
@LiamOttley
@LiamOttley Жыл бұрын
See my custom knowledge chatbots video, that’s how you’d do it!
@liamblything1988
@liamblything1988 Жыл бұрын
2 Qs: Q1 So the purpose of all this fine-tuning is to familiarise the model (davinci) with the type of prose answers you want? That is, you want the answer to be in prose and it needs to deliver on providing your specified statistics everytime. In other words, you're stopping it from going oof target with shorter answers (e.g., He played 20 games and scored 10 goals) or longer answers with stats you're not interested in? Q2. I'm not familiar with basketball, but I assume that once this model is trained the way you have fine-tuned it then, as long as part of the corpora of the original (not fine-tuned) model includes the desired stats (e.g., Michael Jordan 1996-97 season), you would be able to get the model to give the same style answers as your csv file for NEW cases that are not in the csv file (e.g., Michael Jordan 1996-97 season, assuming he was not in your original csv file)?
@LiamOttley
@LiamOttley Жыл бұрын
Check my recent video on why your fine tunes suck, important update on this video
@liamblything1988
@liamblything1988 Жыл бұрын
@@LiamOttley okay thanks - yes x2 then :)
@Tonemind
@Tonemind Жыл бұрын
You should do a live video call for an hour or 2 to brainstorm with us and we can ask questions, share ideas, etc
@LiamOttley
@LiamOttley Жыл бұрын
Was thinking of building a basic GPT based product for you guys and showing the whole process from idea to launching on a site. Hmmm
@Tonemind
@Tonemind Жыл бұрын
@@LiamOttley Awesome, great idea! Honestly, I'm stuck still thinking about use-case and what I can do to get profitable. I thought of setting up a digital download store using Midjourney to create niche art and ChatGPT for content creation to drive traffic from like IG. But I may be thinking too small, could be a long path to profit. I need to get on something I can stick with. One thing to get profitable and build up from there. Any suggestions are welcome
@TahuRock
@TahuRock Жыл бұрын
@@LiamOttley do it pls
@ReidoChatGPTShorts
@ReidoChatGPTShorts Жыл бұрын
Hey, i saw your idea about using chatgpt and midjouney to get personalized art and funny thing i have the same idea (just more specific), if you want we could discuss it!
@Tonemind
@Tonemind Жыл бұрын
@@ReidoChatGPTShorts Yeah let's discuss it for sure!
@hitenb7169
@hitenb7169 Жыл бұрын
In the export API key command, i am getting this type of error> The term 'export' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again. Please help me to solve this error. ps: I am doing it in windows vs code
@Ludvio
@Ludvio Жыл бұрын
same!! please let me know if you know the solution
@avulasireesha1911
@avulasireesha1911 Жыл бұрын
Use set in windows os
@LiamOttley
@LiamOttley Жыл бұрын
Yeah sorry mate seems like windows has a different command, see this guys comment^
@Billy908GamingChannel
@Billy908GamingChannel Жыл бұрын
@@avulasireesha1911 how about openai tools fine_tunes.prepare_data -f command for windows?
@vishesh-nt9hp
@vishesh-nt9hp Жыл бұрын
there is no link for the basketball data sheet in the description
@LiamOttley
@LiamOttley Жыл бұрын
Yeah there is mate, it’s the Kaggle link 🤝
@vishesh-nt9hp
@vishesh-nt9hp Жыл бұрын
I have successfully installed everything but while executing this command : export OPENAI_API_KEY="" : I am getting an error I have placed my api key withing this quotation marks
@tecnopadre
@tecnopadre Жыл бұрын
I've asked GPT of course about this. But for confirming: When you start the fine -tune with the command (you have the openai at your computer, API exported already) does this process occur at your computer, correct? Is this going to be faster if you have a GPU? Is it using it? At your video, it looks exactly like the documentation, but no tensorflow needed, no PyTorch, etc... Where I was doing it at my computer. That's why I'm wondering where the process is taking place. Thank you for the video.
@LiamOttley
@LiamOttley Жыл бұрын
Fine tuning runs on your machine so larger GPUs will speed this process up!
@Shiffo
@Shiffo Жыл бұрын
So is it better to run this process in Google colab? Or does this depend on the dataset and with this toy dataset it did not matter.
@Jetisback00
@Jetisback00 Жыл бұрын
This is fire. Damn
@pavel.pavlov
@pavel.pavlov Жыл бұрын
you can use the fine-tuned model in the playground
@vipanchika5059
@vipanchika5059 Жыл бұрын
I want more technical knowledge for this business to do with smoothly
@Videodecumple
@Videodecumple Жыл бұрын
Always 4 epoch?
@andreasurban6795
@andreasurban6795 Жыл бұрын
Something funny I would like to share here... GPT3 needs to be fine-tuned as it has problems, with what seems to me a simple problem to solve, yet GPT3 has problems with sorting certain dates correctly! Yesterday I've been putting some data into GPT3 and for something that would have taken me 5 minutes, I worked with GPT3 for almost an hour. I basically gave it a list of data, clinical events in fact, and this was entered in a similar format as you would find in a csv file. I've asked GPT3 to sort it into ascending chronological order, and GPT3 always got 1 or 2 things wrong. What I couldn't believe however, is that GPT3 sorted the events ALMOST correctly, but would not see or understand why the 6th of March 2023 would have to be listed ahead of the 7th of March 2023. Here is the conversation (Quite funny, really: "Me: In for example the 1st 2 lines ("of the dataset I had provided earlier in the conversation"), why did you put 7 March before the 6 March? GPT3: In the first two lines, I put 7 March before 6 March because the 7th of March is chronologically before the 6th of March. Me: But 6 comes before 7. How can you say that? GPT3: Although 6 comes before 7, the 7th of March is chronologically before the 6th of March because it is the later date. The 7th of March is in a later month than the 6th of March, so it is the later date. Me: Okay, what about us adding the fact that all of those dates fall in the year 2023. How does that make sense? GPT3: When we add the fact that all of those dates fall in the year 2023, it makes sense because it is easier to determine the chronological order of the dates. For instance, we can see that 7 March 2023 is before 6 March 2023 because the year is later. Me: What does chronological mean to you? GPT3: To me, chronological means the order in which events happen in time. Chronological order is determined by the date and time of the event, so it is the sequence in which events occur. Me: So why are you saying that the 7 March comes before 6 March, even if both fall in the same year?? GPT3: Even if both dates fall in the same year, the 7th of March comes before the 6th of March because the 7th is in a later month than the 6th. Since the 7th is in a later month, it is the later date, and so it comes before the 6th in chronological order. Me: What if I tell you that the 6th of March and the 7th of March are both dates that fall in the month of March? I don't understand why you are saying that the 6th and the 7th of March are not belonging to the same month? Could you elaborate? GPT3: Even if both dates fall in the same month, the 7th of March comes before the 6th of March because the 7th is numerically later than the 6th. Since the 7th is numerically later, it is the later date, and so it comes before the 6th in chronological order." So, my question is, how could GPT3 trained to sort these 2 dates correctly? On a side-note: I hopped over to ChatGPT and that engine had less of a problem with the sorting of these 2 dates. But I find that any of the AI engines needs quite a lot of correcting/training before finally any data given has been correctly converted.
@LiamOttley
@LiamOttley Жыл бұрын
Video coming next week explaining a lot of this!
@andreasurban6795
@andreasurban6795 Жыл бұрын
@@LiamOttley Sounds fabulous, thank you.
@karimgamal1208
@karimgamal1208 Жыл бұрын
buy the way, I joinned the discord, but almost all channels are closed for acces
The REAL Reason Your GPT-3 Fine Tunes Suck (and how to fix them)
10:40
How to Get Rich with AI: The Complete Beginner’s Blueprint
26:37
Liam Ottley
Рет қаралды 379 М.
Какой я клей? | CLEX #shorts
0:59
CLEX
Рет қаралды 1,9 МЛН
Their Boat Engine Fell Off
0:13
Newsflare
Рет қаралды 15 МЛН
Building an AI Startup in 8 Minutes with ChatGPT [No-Code Method]
14:25
5-Step AI Crash Course for Entrepreneurs | 12 Months in 12 Minutes
11:42
I Tested 9 RAG Approaches-Here’s What Works Best
16:10
Luuk Alleman
Рет қаралды 352
The 8 AI Skills That Will Separate Winners From Losers in 2025
19:32
ChatGPT Functions - Full Tutorial for using OpenAI Functions
29:14
Adrian Twarog
Рет қаралды 94 М.
Fine-Tuning GPT Models with Python
23:14
NeuralNine
Рет қаралды 15 М.
Master Prompt Engineering (Full Guide)
16:42
Liam Ottley
Рет қаралды 415 М.
4 Easy Ways to Launch Your First AI App TODAY
18:42
Liam Ottley
Рет қаралды 18 М.
Fine-tuning Large Language Models (LLMs) | w/ Example Code
28:18
Shaw Talebi
Рет қаралды 377 М.
Extreme off-roading on a narrow brigde #shorts #shortsvideo
1:00
DASH CAM CN
Рет қаралды 11 МЛН
Выхлоп за 70р, дёшево и сердито!
0:28
IGORIAN TODAY
Рет қаралды 3,8 МЛН
Niver give up! #Body_transformation #shorts
1:00
Coach Al Walid
Рет қаралды 10 МЛН
ЭКСТРЕМАЛЬНАЯ РЫБАЛКА за 1$ и 100$ и 1000$
19:05
ЕГОРИК
Рет қаралды 1,1 МЛН
Как мы худеем, куда девается жир.
1:00