Пікірлер
@EsZfW5f
@EsZfW5f 5 күн бұрын
Thanks!
@pinnivamshikrishna
@pinnivamshikrishna 9 күн бұрын
I have worked on Markov chain Monte Carlo algorithm, it took me 1 hour to map the posterior distribution and that’s not even close….looking forward to use this Gflownets
@shibohao8930
@shibohao8930 25 күн бұрын
Great video! Looking forward to your video explaining the relation between GFN and Max-Entropy RL
@tonywang7933
@tonywang7933 26 күн бұрын
3:26 That is the best explanation!!
@todamont
@todamont 29 күн бұрын
Very cool. I know some of these words.
@redthunder6183
@redthunder6183 Ай бұрын
Thank you so much for explaining this clearly, everything I watch on KZbin is made by ppl who have no idea how the tech works, or don’t even know how to code outside of copy/paste/change inputs, but pretend like they do. Furthermore, there’s just so many useless libraries around LLMs that ppl claim are the next big thing, but in reality, they create code bloat, introduce more unknowns, make the code harder to work with since u now gotta learn the library, and don’t work as well as if u just wrote everything urself.
@ph10m
@ph10m 2 ай бұрын
This was a great intuitive explanation of it. I wish more people took the adaptability of lora seriously, though: everyone (and their dog) upload full models after doing small fine-tunes *with* lora, instead of just the adapters. Not only would it help experimentation, but time too, as we have to download unnecessary base models over and over...
@jett_royce
@jett_royce 2 ай бұрын
LoRA is such an unlock for resource-constrained creators looking to leverage models for specific domains. Thank you for this amazing work!
@houbenbub
@houbenbub 2 ай бұрын
Awesome video, thanks for making it :)
@BruceChar007
@BruceChar007 2 ай бұрын
能不能继续在微调后的LoRA模型上面微调,效果怎么样
@lophyre1380
@lophyre1380 2 ай бұрын
Very informative video, but please get a better mic
@user-wp8yx
@user-wp8yx 3 ай бұрын
Trying to teach a mistral7b model sanskrit. It already has Sanskrit characters as tokens and is the best performing 7b llama based model I can find. You seem like a knowledgable person in this area. Do you have any advice for lora? Rank, alpha? How about targeting of q,k,v? Other strategies? I have about 3gb of datasets that range from translations, corpus, to data tables. I wonder if I should use different strategies for different data types?
@user-ut4zh3pw7l
@user-ut4zh3pw7l 3 ай бұрын
waiting for those future videos. lets generalize ood
@bobbyparikh5690
@bobbyparikh5690 3 ай бұрын
Fantastic video Edward! In case someone wants a quick refresher on low-rank decomposition of matrices, here's a great video: kzbin.info/www/bejne/aKDKlaqmfalmjJo&ab_channel=ritvikmath
@arnoldpalmer-fv7pf
@arnoldpalmer-fv7pf 3 ай бұрын
So much groundbreaking research broken down into an easy to follow 7 minute video, I love it 🙏
@nathangonzales-hess6569
@nathangonzales-hess6569 3 ай бұрын
That was great. Thanks for sharing. I really appreciate the simple style, no distracting animated plots or fancy editing. Look forward to more!
@justinpresent
@justinpresent 3 ай бұрын
thanks edward for the gentle intro!
@ellielikesmath
@ellielikesmath 3 ай бұрын
i was trying to come up with something like this, in that i wanted to train a generator which would be the inverse of a classifier, and the classifier gave a score to how good a solution was drawn from some range. this looks miles and miles more sophisticated than what i was doing with tf and pytorch, but i definitely understand, at least on that level of abstraction, why such a development is necessary. i look forward to trying this, cheers.
@Bbb78651
@Bbb78651 3 ай бұрын
Thank you so much for the video Edward. Its an inspo seeing you make videos and take off. Im currently a masters of science student in data science and Im always excited about NN architectures and new ML algos. Whenever easy, could you please share 1-2 tips for writing good research papers in ML? I recently started in a lab that does neuroscience-ML, and rlly want to make an impact there
@faizanjaved1443
@faizanjaved1443 3 ай бұрын
Hey there! Can we talk about Q*, the AGI developed by Sam Altman? I'm excited to discuss this with you, it's one of the most interesting topics for me after Sora.
@candrewlee14
@candrewlee14 3 ай бұрын
This was fantastic! Thank you, it’s great to hear from a real expert in this AI mega-hype cycle.
@DB-Barrelmaker
@DB-Barrelmaker 3 ай бұрын
The audio is terrible, it's noticeable when you're dealing with a complex subject containing alot of niche phrases
@DigitalAlligator
@DigitalAlligator 3 ай бұрын
Shit, you invented LoRA 😮? How you come up with that idea works so good?!
@Niamato_inc
@Niamato_inc 3 ай бұрын
Thank you wholeheartedly.
@faizanjaved1443
@faizanjaved1443 3 ай бұрын
Here's a "Below are some new topics for you to discuss: - Grok-1 - Claude Opus - Gemini Ultra - Poe - Figure humanoid powered by OpenAI - Hugging Face - Sam Altman 7+ trillion - Google AI in iPhones - NVIDIA Disney robots Let me know if you need any help to choose the best topics for your content."
@BaKimura03
@BaKimura03 3 ай бұрын
Love the fact that you’re organic. Didn’t even lead with the big credential.. unlike some of these goofs who have done far less. 👏
@Niamato_inc
@Niamato_inc 3 ай бұрын
Thank you wholeheartedly.
@sumitpawar000
@sumitpawar000 3 ай бұрын
Sir, please make more videos explaining fundamental concepts as well as latest breakthroughs in AI field. Your style of explanation is neat and pin point. Everyone will get benefited out of these videos.
@chitarito100
@chitarito100 3 ай бұрын
Hey, I’m glad you’re on KZbin! It’s great to have an expert in the field break down complex topics and intuition and also explain real world applications not just theory. I think it would be nice if you could have some summary pointers overlaid in the video or on a summary slide with you overlaid on it. Different people have different learning styles and being able to read helps.
@Jandodev
@Jandodev 3 ай бұрын
I found a way to do this at my company with just LLM's! I used LLM's to not only generate the process steps but also make a liminal/expansion map of the ideas themselves that could lead to those individual processing steps! The trick to make it run wasn't to fit to a "reward function" but to use the "reward function" for back propagation as the starting point to then determine what was needed from the user to retrieve and select the correct path!
@automatalearninglab
@automatalearninglab 3 ай бұрын
Nice! Turn up your volume! Loved the topic! :)
@kibrutemesgen1759
@kibrutemesgen1759 3 ай бұрын
Amazing explanation with clear explanation of the intuition. It would be great if you give us one more vedio on implementation or detail explanation of how Gflownet is used to enhance reasoning of LLMs (i.e the paper)
@james-cucumber
@james-cucumber 3 ай бұрын
Thanks for including subtitles with this video. I’m pretty sure (but not certain given you may have access to better models than regular Joes) that it’s been manually edited or written from scratch. If so, extra thank you!
@yiannishadjiyianni7737
@yiannishadjiyianni7737 3 ай бұрын
This might be dumb but I wonder how applicable can GFlowNets be in an object detection/instance segmentation context where the distribution created is based on the millions of images the model will train on and the "pathways" of the help the model be even more accurate
@vtrandal
@vtrandal 3 ай бұрын
Fantastic
@_rd_kocaman
@_rd_kocaman 3 ай бұрын
You’re gonna need a graphic designer to reach broad range of audience
@alinmathuo4018
@alinmathuo4018 4 ай бұрын
You don’t need microphone, just find ai tool that fix it🙃
@user-lf4ir3mp2f
@user-lf4ir3mp2f 4 ай бұрын
great man
@RonLWilson
@RonLWilson 4 ай бұрын
This looks very promising!
@RonLWilson
@RonLWilson 4 ай бұрын
BTW, I have been working on a graphical way of building Ontology models that I am calling UniML (Universal Modeling Language) that can model the GflowNets process quite readily much like OWL or RDF graphs, but even more graphically. Something like this might help develop these nets in that it is a way to better visualize them. I made a number of introductory videos that I uploaded on my KZbin channel that describe them in more detail into their what's and why's plus a Padlet virtual corkboard that takes a bit of of a closer look at them. UniML can model NNs as well, or just treat them as functions (Chips).
@jayyoung7577
@jayyoung7577 4 ай бұрын
Wow❤ please post more deep dive videos. Thank you for sharing!
@jan3477
@jan3477 4 ай бұрын
Great video, but it was a bit too fast for me to keep up with the complex topic.
@unclecode
@unclecode 4 ай бұрын
Hi Edward, I've been following your channel since you had long hair, and I've noticed two things: 1) You post videos when you have a new paper meaning new discoveries, and 2) Your hair seems to get shorter in each video. If I had to predict, based on these three videos, (overfitting) your next video will have you bald! 😀😀 Nonetheless, you are incredibly talented, and your timing and placement are impeccable.
@MrMehrd
@MrMehrd 4 ай бұрын
Thx nice intro
@miikalewandowski7765
@miikalewandowski7765 4 ай бұрын
Brilliant topic and explanation! Looking forward for your deep dives and if you like some observations or insights you have made on your saga as a researcher 😊
@user-hu2tn8ef8r
@user-hu2tn8ef8r 4 ай бұрын
Is it me or is this AI generated?
@peace_and_blessings1111
@peace_and_blessings1111 4 ай бұрын
Sir, with all due respect ,please don't take my question in the wrong way. How can a total newbie get started in AI ? What are the books you would recommend reading and the things Id need to do? Sir I really appreciate the clarity and intensity of your incredible thought processes. Love you sir.
@JumpDiffusion
@JumpDiffusion 4 ай бұрын
Good stuff
@PharaoTeti
@PharaoTeti 4 ай бұрын
Great scientist and communicator!
@user-wr4yl7tx3w
@user-wr4yl7tx3w 4 ай бұрын
this is really informative. thanks for taking time to make such videos.
@ABG1788
@ABG1788 4 ай бұрын
Thanks, for the video!!!!!!!! I appreciate you