How to create your own Flux AI Model 💥 (Flux LoRA Fine Tuning) 💥

[@1littlecoder]

New Super Fast Flux -Finetuning - kzbin.info/www/bejne/qHzWY6JnnKeqabs

[@Heisen3urger]

This was a fantastic explanation of training a Flux model! I've been looking all over for exactly this and you've done the best job at explaining it without rushing over the smaller details. Greatly appreciate you sharing your knowledge and expertise!

[@SkylineAICreator]

Great video ! I have made four now works perfect.

[@1littlecoder]

Glad it helped

[@emonhossain_pro]

Fantastic walkthrough on fine-tuning FLUX.1! Really appreciated the detailed steps and practical tips. This made things much clearer! 👍

[@1littlecoder]

Thank you

[@skillbuddy8911]

Thank you Thalaiva. I am going to try it today. I have become a fan of you!

[@1littlecoder]

Haha Thank you nga!

[@DavidDji_1989]

Very nice and clear tutorial !

[@1littlecoder]

Thank you, David

[@andyy79]

Thank you so much for the tutorial! Very clear and straight forward! when i try to upload a zip folder with photos, it does not upload anything. Any idea why its not uploading the zip-folder?

[@tomchurch1]

Thanks so much for this video. I followed it and worked great. Question - You mention you can run locally on Mac after the training model is produced. How would you do this please?

[@1littlecoder]

Thank you. Just published kzbin.info/www/bejne/aabYqaNmq5h5ibM

[@rajivraghu9857]

Excellent.. i was searching for this :)

[@1littlecoder]

If you happen to try, let me know if your quality was good

[@EclipticVistaYT]

It's a very awesome tutorial but I would like to know how to add realism in the lora we create.

[@valineagu2624]

Good quality video Friend!

[@1littlecoder]

Thank you, I spent a lot of time on this, lot more than average video. I'm glad that's reflected 🙏🏾❤️

[@artyartemis5752]

there many Ai artist asking me how to train Flux Lora for free so... I am suggesting your channel to them

[@somratdutta]

Hi sir, can you tell me how to run on Mac?

[@panwar9848]

How about using controlnet and upscaler with? In order to produce more crisp images?

[@robdiaz]

I use Flux locally on my computer, can I do this on my pc or I still need to use Replicate? Thank you

[@gentleman.editsss]

Can we create for multiple characters?? Does it have an option of initial image option?

[@1littlecoder]

Technically you would have to create them as two different loras

[@KishanisTrading]

Great Video. W content 👑

[@1littlecoder]

Thank you

[@jaydev8148]

I'm new to this, can you please explain me 1. That download weight means the Flux LoRA fine tune model file, right? And we can use it in Google collab, Huggingface or any other platform. 2. In hf_lora label can we mention any other repo platform or can we only store the repo only in replicate to use it later to use via replicate new Reflux platform.

[@TheIntelligentVehicle]

Amazing work.

[@NobleCaveman]

Great tutorial! I'm going to use this for halloween lol

[@1littlecoder]

Haha great

[@ramp2011]

When you were trying out the fine tuned model in replicate, did u have to deploy it in a server to try it? Per replicate pricing it says.. "Unlike public models, you’ll pay for setup and idle time in addition to the time it spends processing your requests." THank you

[@1littlecoder]

@@ramp2011 the model is already there. I paid for inference. I also did the inference with the lora from hosting the lora on hugging face

[@CorkyBallasdancewithme]

I wish you would have shown how to make the captions txt file not sure what you meant by ur example? Every photo have a different name? Confusing ?

[@1littlecoder]

@@CorkyBallasdancewithme it's not mandatory. It'll be auto done if you want to skip it.

[@SupremacyMediaAgency]

Hey, can I train two models of different different individuals and get outputs with both of them in an image?

[@Petyr25]

Great video!

[@MichealScott24]

❤

[@imyashw]

Noob question - Do I have to train it again and again if I want to use in future?

[@1littlecoder]

@@imyashw nope you use the trained lora

[@DudeBlox-y8m]

It is trained on ly that particular image. If you have a customer with another image, you hae to train it again on that different image.

[@Shorts4D]

Possible to run on M3 18GB Ram Mac? If yes, How?

[@mshonle]

I wonder how you can see the autocaptions, so that you can see if any noise/incorrect captioning made its way. Similarly, if you can run multiple samples for the autocaptions, to see how much it varies and if there are any better captions.

[@1littlecoder]

Auto caption is based on lava 1.5 which probably we can try separately. After I have made this video, I think they've made changes to their UI where you can download the caption as well. But I would still suggest that if you can use something like gpt4o or Gemini to make caption. I guess that will be a lot better but when I did the fine tuning I did not do with any separate caption file and still it turned out to be good

[@mshonle]

@@1littlecoder Perhaps, but it might be better if the captions are closer to the embedding space that Flux actually uses for text? That is, a higher quality caption might not fit the native (so to speak) distribution and might not be as effective? However, that’s just a theory.

[@CorkyBallasdancewithme]

@@1littlecoder I would like an example of the TXT caption file. Filename a_photo_of_JACK Caption TXT file a_photo_of_JACK standing up talking? is that how, please explain @1littlecoder

[@sammathew535]

It seems the age of trusting in photos is over! Having a picture taken with camera was a gold standard to capture reality, be it for authentication (e.g., IDs) or for reporting a real event. Seems this was short-lived, maybe only 80 years.

[@basicvisual7137]

if you include captioning , do you still need the trigger word ?

[@1littlecoder]

captioning is for the algorithm to understand the picture better. trigger word is what invokes what you trained

[@catsanzsh]

thank u human

[@ysy69]

Very grateful. I tried this and was able to train my Lora. Now, when I tried it on my ComfyUI using the nodes from x-flux, I get the error: Error occurred when executing FluxLoraLoader: Error(s) in loading state_dict for DoubleStreamBlockLoraProcessor: Missing key(s) in state_dict: "qkv_lora1.down.weight", "qkv_lora1.up.weight", "proj_lora1.down.weight", "proj_lora1.up.weight", "qkv_lora2.down.weight", "qkv_lora2.up.weight", "proj_lora2.down.weight", "proj_lora2.up.weight".

[@1littlecoder]

I did it here. It worked fine kzbin.info/www/bejne/aabYqaNmq5h5ibM

[@ysy69]

@@1littlecoder Yes, I figured that out after realizing the trained Loras over at Ostris are not compatible with the Loras from XLab (and their nodes)

[@JimMendenhall]

🤯

[@DivyanshKulshreshtha-f7k]

I am a little new to all this, how can I set all of this up locally? And not on the replicate that you've linked

[@1littlecoder]

do you have an NVIDIA GPU with at least 24GB graphics memory or minimum 18GB VRAM i guess

[@ArcosGaming]

​@@1littlecoderI have a RTX 4090 and I want to train a few LORAs locally. Please make a video on training loras on personal computer

[@shobhitagnihotri416]

lets go

[@1littlecoder]

🚀

[@pastuh]

Confusing title.. its Lora training or Checkpoint model training?

[@1littlecoder]

Doesn't title say Lora fine tuning?

[@aswinrathan7898]

hey bro! not able to upload the zip file in the destined place, nothing is being uploaded, any idea why?

[@1littlecoder]

Oh. Did you already add money to replicate? kzbin.info/www/bejne/qHzWY6JnnKeqabssi=0f1W0h3BXPjyrBZe you can try this much cheaper

[@aswinrathan7898]

@@1littlecoder no thanks for saving brother!!, gonna try this one..!!

[@elpablitorodriguezharrera]

Hi how can I use my own model on google collabs or hugging face?

[@1littlecoder]

Do you mean you already have lora?

[@elpablitorodriguezharrera]

@@1littlecoder yes, I already trained it, just wanna know how

[@yashpatidar.8506]

How did you get $95 for free on Replicate?

[@lowaura]

Can you make a tutorial for forge ui?

[@sameerquadri8289]

Hey It is asking for payment. It didn't in your case.

[@1littlecoder]

It's a paid service. You could see it in the billing section

[@user-nb6kx3qn3p]

Can u download the Lora after training and use it in Comfyui runing localy in PC ?

[@1littlecoder]

Yes I showed how to download. But also here showed how to use locally kzbin.info/www/bejne/aabYqaNmq5h5ibMsi=lq9N3QlPbq8qaWmG

[@user-nb6kx3qn3p]

@@1littlecoder Thanks

[@DoctorTasin]

Unable to upload the .zip file. Can you please help me out on this?

[@paul.caillard]

Try on Google Chrome. Not working for me into Firefox

[@GuilhermeDuqueChannel]

I don't know why, but im getting very bad quality results, and Lora insists on copying the clothes of imput images to create the new images 😢

[@1littlecoder]

Try to reduce the LoRAs strength when you do the inference

[@sivap6674]

how to run inference locally ??

[@1littlecoder]

Just published kzbin.info/www/bejne/aabYqaNmq5h5ibM

[@KumR]

Teeviramana Dhanush Rasingara neenge???

[@moarshy]

athe kelvi than!

[@1littlecoder]

Kandippa illa, I wanted someone not white skin and also someone who's not on training data, settled with Dhanush!

[@moarshy]

@@1littlecoder thanks for all ur content bro!

[@itsanishjain]

anyone found that you can't upload zip file replicate, anyone else facing that issue?

[@gulatiramit]

same here, were you able to resolve the issue?

[@itsanishjain]

@@gulatiramit try different browser I was using brave if that's not work use API I hosted my files in S3

[@pacificblues5084]

Ugh. My fine tuned model looks nothing like me. I used 50 pictures.

[@1littlecoder]

50 is too much and unnecessary. Did you check the video ?

[@ClebFacts]

How much did this cost you to make?

[@1littlecoder]

I guess around $5 why ?

[@ClebFacts]

@@1littlecoder Thanks. Just wanted to know before I chose between doing this and running Osiris toolkit on runpod.

[@1littlecoder]

Then I would suggest you compare with this which is much cheaper kzbin.info/www/bejne/qHzWY6JnnKeqabs

[@ClebFacts]

@@1littlecoder cool, thanks for the suggestion, I'll check it out now!

[@AaliDGr8]

so is that fkn mean this thing is not free but crappy paid even low paid price but it has M I right or we can who cant afford can use free also ??

[@1littlecoder]

Didn't understand

[@gyahoo]

Bro from where to add payment method on replicate. I'm struggling to add please help.

[@1littlecoder]

@@gyahoo I guess it will be inside your accounts and billing

[@gyahoo]

@@1littlecoder ok thanks bro

[@webhosting7062]

Varun mayya inspired? 😅

[@1littlecoder]

Actually not, I'd recorded it a day before, but saw his hulk yesterday on twitter, his hulk looked better. In my Dhanush's hulk, the face doesn't have a lot muscles. His one was better in that sense.

[@webhosting7062]

@@1littlecoder what could be the reason?

[@1littlecoder]

@@webhosting7062 probably a detailed prompt or Varun has a bit of cheek more than Dhanush pics

[@webhosting7062]

@@1littlecoder got it 👍

[@hamzaabbasi8923]

Can I Train Lora by providing a single grid of multiple face angles?

[@mr.entezaee]

Is this method free?

[@1littlecoder]

Nope

[@vanshwadhwa1332]

Would you be open to the idea of training a Lora with me? I am willing to help you with anything you want. Love the idea of building something of my own. This would mean the world to me.

[@1littlecoder]

could you please elaborate, do you want me to train a lora for you, is that what you mean?

[@vanshwadhwa1332]

@@1littlecoderI will work with you as you ask. I don’t have the required hardware nor do i have as much knowledge as you do.

[@vanshwadhwa1332]

I feel my project would benefit the community too.

[@1littlecoder]

@@vanshwadhwa1332 point of this tutorial is that you don't need the hardware. You can just spend less than $10 on that website and then train your own model and then use it anytime you want

[@1littlecoder]

@@vanshwadhwa1332 point of this tutorial is that you don't need the hardware. You can just spend less than $10 on that website and then train your own model and then use it anytime you want

[@NIDSTER25]

Can we do this in low end device?

[@1littlecoder]

This was happening in a cloud service

[@vaibhavgeek]

What the freaking hell! Can we trust the internet anymore?

[@1littlecoder]

Almost you can't!

[@sammathew535]

I read in the comment section of "Fireship"'s video on Flux : "I saw in my lifetime the shift from 'show me the picture that I may believe' to 'I want to see it that I may believe'" Anyway, photos didn't exist 100 years ago, so we are back to the times, when people didn't trust paintings! The age of celluloid and digital photos seems over now!

[@1littlecoder]

@@sammathew535 brilliant

[@LouisGedo]

Hi

[@1littlecoder]

How to use the fine-tuned flux loRA locally - kzbin.info/www/bejne/aabYqaNmq5h5ibM

[@SR-zi1pw]

Grayan

[@therobotocracy]

I really don’t like the look of Flux.

[@1littlecoder]

@@therobotocracy why ? Anything particular?

[@therobotocracy]

@@1littlecoder yeah, the composition is very much the same and the contrast has its own look. Very much like MJ in the color. Something about the blacks not having detail man maybe like a vibrancy in the mids. It’s like it’s been trained on a lot of modern movies with professional grades. Looks realistic but very much the same same.