"okay, but I want GPT to perform 10x for my specific use case" - Here is how

Finetune Falcon 7b/40b instruct with your own data - The step by step guide about how to train falcon model for generating high quality midjourney prompt, from prep training dataset to comparing final results;
- Join Falcon 40B contest: falconllm.tii.ae/call-for-pro...
- Follow me on twitter: / jasonzhou1993
- Join my AI email list: www.ai-jason.com/
- My discord: / discord
🔗 Links
- Google colab: colab.research.google.com/dri...
- Midjourney training dataset: docs.google.com/spreadsheets/...
- RelevanceAI midjourney training dataset generator: app.relevanceai.com/notebook/...
⏱️ Timestamps
0:00 Finetune VS Knowledge base
1:50 Step1 Choose base LLM
2:30 Step2 Prep training data
4:54 Step3 Setup google colab
5:41 Step4 Load base Falcon model
6:48 Step5 Load training data
7:36 Step6 Finetune model
7:56 Step7 Save & run finetuned model
9:08 Falcon 40b
👋🏻 About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! [e-mail]
#gpt #autogpt #ai #artificialintelligence #tutorial #stepbystep #openai #llm #falcon7b #finetune #largelanguagemodels #largelanguagemodel #midjourney

[@trickybarrel444]

No clickbait, no long intro, no over-excitement. Just pure, straight-to-the-point content, with real-world examples and neatly divided sections. You are a hero

[@668771]

You understood that? I wish.

[@Bashar3A]

YES! Getting tired of those time filler AI videos, almost didn't watch this one. Now subscribed

[@myob3074]

Aaaah just like the good ol days 😅😂

[@myob3074]

​@@668771knuckle down and study practice study practice, it's not that difficult 🤷🏽‍♂️

[@Andyonrice]

specific use case: filter videos for overexcitement and clickbait, then tag them

[@spoonikle]

holy heck dude, you just taught us magic. This is the magic! not even the fine tuning, but the data set generation! data sources! all the pieces I have been searching for!

[@AIJasonZ]

Thanks so much mate!! That means a lot, DM me if you get any question pls!

[@EGGHEADIUS]

Literally brother you have taught us prompt engineering wizardry, there’s no other way to put it.

[@DeepDiveNFT]

I’ve been generating massive data sets and manipulating in python then bringing it back to fine tune. Shits getting wild out here

[@Zer-ei4co]

@@DeepDiveNFTlol sounds like fun, what kind of general use cases do you have?

[@stan9682]

Be wary that OpenAI prohibits the use of their models to generate training data (no competing closure). It's hard to detect, obviously, but it's useful knowledge imo regardless.

[@pikleman5880]

Honestly, I love how you don't put a clickbaity title or thumbnail, and how you explain it well but also fast.

[@sweetmelon3365]

Very good teaching style. I also liked that you actually went through the process ourself. Thank you very much

[@lucyn.7501]

Fantastic video once again, can’t wait for the next embedding one 😊

[@hansjochen2193]

One of the best and most straight forward tutorials i have Seen after 5 years of ComputerScience! Keep it up now i am honna binge eatvh your other videos

[@sayantandas7544]

One thing I really like about your videos is that it always comes with really quality examples. And the examples are pretty much practical oriented. Do make the embedding video.

[@AIJasonZ]

Thanks man, that means a lot! 😬

[@treadaar]

@@AIJasonZ Absolutely agree. Very helpful and i like the speed you go, staying on topic. Please make the embedding video! Very interested to see your take on it.

[@668771]

I thought the opposite, this was like watching someone assemble a nuclear reactor. I'm more confused about AI after watching this. You need to be a master programmer to properly view this video.

[@antonschillen2633]

@@AIJasonZ +1 on make the embedding video. Really great stuff :)

[@dogemaster6361]

Excellent video Jason. Well organised and easy to understand.

[@joejiang8353]

Excellent video Jason! Step by step examples are really helpful

[@unicornist]

most underrated channel in AI. Thank you for the effort you are putting into this.

[@DivineMisterAdVentures]

Really appreciate your free thought. Will try to follow you closely.

[@AdrianMark]

Learning so much from you. Thank you for making this.

[@loktheswe6768]

Omg this is the best one I have seen so far!!!I’m planning to train one of my own model soon!!

[@LC-lj5kd]

well done! looking forward to the embedding video too

[@mytechnotalent]

Great job Jason! Very helpful!

[@unshadowlabs]

Great Video! I would love to see a video on how to create an embedded knowledge base and use it along side this fine-tuning.

[@tahamohd1409]

I'm glad i found this channal! wonderful work!!

[@squibtechnologies]

I'm floored by your content. It is amazing 👏👏👏👏👏👏

[@DorkDork69]

Man this is exactly the sort of guide I was looking for. Thank you very much.

[@kazimafzal]

Bloody awesome video - concise yet detailed! Looking for upcoming vids

[@theAIsearch]

Let's be honest. Who here clicked because you thought he was JIMMY YANG?

[@shuzhu6633]

Who’s Jimmy Yang? 😂

[@NESDUB]

@@shuzhu6633 the comedian in the thumbnail

[@aiutksemua]

jian yang

[@bakasenpaidesu]

I'm not 😂

[@tevx9670]

That's 😂

[@soyitiel]

Your audio gradually went from studio recording to cathedral ambiant. Hey thanks for the info. Love it ♥

[@user-jt3jc7fk2x]

keep the good job Jin Yang，your top follower from shanghai

[@markmonfort29]

Brilliant mate. Keep these coming

[@royxss]

This is just amazing! waiting for your embedding model

[@chonmon]

Good work dude! This is super useful!

[@awesomeGuss]

brooo....God bless you for this...gained a ton

[@Yadu-bv1kn]

One of the best, to the point, goldmine of a tutorial

[@yashsoni5437]

Great Video! Keep up the good work

[@user-jd3gf5xw1x]

honestly, I was not expecting jin yang to teach us but I'm all for it straight to the point, loved it

[@TheAiClub]

Good stuff Jason🤙🏻

[@jasonfinance]

Oh man, this is so good, i always confused about when should i finetune LLM, this makes things super clear; Also falcon 40b seem to be an awesome choice!

[@Muuip]

Great concise tutorial, thanks!👍

[@jasonwang3539]

Real thanks from another Jason man, clear and concise video! As a high schooler, I'd like to create an LLM project, so I hope I can follow through after I do my research :)

[@hughesadam87]

This is such a relevant and timely video. Thanks bud. PS I love all your silicon valley video titles

[@maxgeorgopoulos3516]

Awesome video! So many great resources. Demystified a lot for me. Thanks!

[@user-vk5fj5mj8s]

Good Job Jason 👨🏽‍💻

[@chaseclingman]

Would love to see the video on the knowledge database. Thank you for this!

[@JustRawFootage]

This is an amazing video that helps me make sense of the Azure Open AI playground to train my model. Love this.

[@antonschillen2633]

Great content! A how-to without any fluff what so ever that is easy to follow.

[@AnonymousBosch3158]

So useful! Thank you!

[@mhc4124]

This is fantastic info, thanks! Subscribed.

[@khaledrweha6823]

Much appreciated ❤️ Thanks man, this helped me alot!

[@DavidPiccinelli]

this is gold, thank you!

[@sparebatteries]

great video Jason - also my first ever comment on KZbin. Most practical tutorials on AI so far imo - I would be keen to see a video where you set up a vector DB and load your own data

[@AIJasonZ]

Hah thanks, first comment means a lot to me! Will get more content :)

[@lucaswei9133]

I like it. Because your video i can follow it every step. It's important for a newbine .

[@serispeaks]

Bro you've done something wonderful for the world with sharing this video 🎉👏 As an app dev I learned something I didn't know I needed to know

[@davidconnelly]

This channel is going to be huge.

[@BiranchiNarayanNayak]

Excellent tutorial on finetuning Falcon 7B

[@DigitalMirrorComputing]

Absolutely loved the video mate! super focused! You inspired me for my own channel! thanks and keep it up! :))

[@chrismachabee3128]

Excellent lesson on Fine tuning. You are a good teacher. Thanks. Please make he next video I am now subbed.

[@michaelnurse9089]

I appreciate this. Subscribed.

[@th3j0t46]

This was super informative and I learned a lot. Great video!! Not to be rude, see this as a constructive comment, be aware of some typos you have along the video. It's not like it bothers me much or anyone, but correcting those little details add up to make your content even better! Good luck and I hope to watch more of your videos :D

[@CustAndCode]

really interesting! nice video! 🤗

[@indiecowan33]

Wow, what a sick video. Thanks so much!

[@CloudWithUgur]

give this man a cookie, dude thank you !!!!

[@JayanaKalansuriya]

What an amazing to the point video! You're an amazing human being Jason. Keep doing you!

[@bayesian7404]

Excellent job, thank you. This is just what I needed.

[@arfh2759]

All thriller no filler. Wicked vid well done sir

[@loudorz]

Great job !

[@sup5356]

fantastically clear

[@Blue-bd4vs]

my man great content ever, keep it up

[@Trolosi123]

Great video, dude! Thanks!

[@joseinTokyo]

excellent tutporial! thank you for sharing.

[@wilfredomartel7781]

Well explained my friend👏👏

[@MasterBrain182]

Astonishing content Man 👍👍👍

[@martinskov5155]

Great video mate! Keep up the work (Y)

[@SafetyLabsInc_ca]

Great video. Helped create a much tighter solution for our client.

[@nsoe8990]

thanks for this amzaing videos. looking forwards to your next videos for embedded knowledge base and creating a chatbot for UI using these trained models.

[@sohailhosseini2266]

Thanks for sharing!

[@ryanfarran]

I have been spinning my wheels on a project and this video unstuck me - thanks a million!

[@dubey_ji]

that was really good glad this was recommended to me

[@Hmelino]

Yes please, waiting for knowledge base embedding video ! 🎉

[@dreamingtulpa]

Thank you for sharing this. This will definitely help. Also epic thumbnail 😂

[@yelectric1893]

Beyond excellent. Damn. Reminds me of Yolo and Stable diffusion in a way. I have got to read the papers sometimes and try tot write a C implementation. This is beautiful!!!!!

[@juansebastiansandovalcorre9254]

Looking forward to the video on embedding a knowledge base

[@NeuroNinjaX]

Awesome! I'm totally new to fine-tuning. I'm looking forward to fine-tuning a model with thousands of private 4K images!

[@AndrewsPanda]

Amazing, thank you!

[@parkjunu2400]

you are legend tysm!

[@mlavinb]

Great content! thanks for sharing

[@ayushnayak6138]

I have been looking for you for so long. Thank you so much for this. Now I can ditch open AI api key and use this for free for my usecase.

[@MYBLOODYUSERNAMEFFS]

Ey 😊 awesome. I created a conversational api with context management in Java. I've used gpt-4 and learnt allot. I'm hoping I can make use of this as well. Nice video.

[@chopradimpy]

Thanks for sharing. It was helpful for understanding the fine tuning process. Can you also make a video on KnowledgeBase embedding? Thanks

[@Gos2]

Wow this is amazing, pure relevant data, tahnk you!, you got my subscription and like

[@Nono-ie3yk]

Hi, Thanks for the excellent video.

[@Neuronalchannel]

Great! Thanks!

[@sameergamer4567]

Damn amazing video

[@user-cn4co9mt4p]

really helpful and straight forward. Subbed !

[@yush3402]

Amazing, you are the best bro. thanks

[@C3r3P0weL]

Waw that was amazing

[@judysu8992]

节奏好快，剪得厉害👍

[@sirrr.9961]

Greaeeeeeeeeeeettttttt ! I have been surfing through internet for last 6 months for this type of workflow tutorial and here you have just made it. Thank you so much for this. My biggest question was how to prepare my own data to finetune a specific AI model for my use case. You have explained that part very easily. Now I can start making my own chatbots. P.S I am not a tech guy .... just an accountant.😅

[@Theineluctable_SOME_CANT]

You should ditch your boring profession.

[@wizarddon]

Thank you Jin yang

[@mitchellsigley8574]

Great video Jason.

[@joaopauloborges3866]

Thanks for sharing such an amazing content! It would be great with you could also make a video about creating embeddings

[@DEFACTO9]

Bad audio Dude. However, this is Exceptional content... finally... a workable explanation. Thank You.

[@nithinchinni]

Great information. I am interested in the embedding style. Would love to see a video of that.

[@wiktormigaszewski8684]

v good tutorial, that goes through a lot of stuff, from overview, datasets, even dataset creation, downloading, finetuning and even uploading a model; wow

[@AIJasonZ]

Thank you! Let me know if anything else missing!

[@wiktormigaszewski8684]

I am now waiting for your tutorial on the reborn Guidance :) Regards! @@AIJasonZ

[@raaajit1]

Thanks for the detail level of explanation .....

[@Unknown-ki8yk]

Thank you for the video. Is this the way to make LLM good at certain languages (spoken ones)?