I have worked on Markov chain Monte Carlo algorithm, it took me 1 hour to map the posterior distribution and that’s not even close….looking forward to use this Gflownets
@shibohao893025 күн бұрын
Great video! Looking forward to your video explaining the relation between GFN and Max-Entropy RL
@tonywang793326 күн бұрын
3:26 That is the best explanation!!
@todamont29 күн бұрын
Very cool. I know some of these words.
@redthunder6183Ай бұрын
Thank you so much for explaining this clearly, everything I watch on KZbin is made by ppl who have no idea how the tech works, or don’t even know how to code outside of copy/paste/change inputs, but pretend like they do. Furthermore, there’s just so many useless libraries around LLMs that ppl claim are the next big thing, but in reality, they create code bloat, introduce more unknowns, make the code harder to work with since u now gotta learn the library, and don’t work as well as if u just wrote everything urself.
@ph10m2 ай бұрын
This was a great intuitive explanation of it. I wish more people took the adaptability of lora seriously, though: everyone (and their dog) upload full models after doing small fine-tunes *with* lora, instead of just the adapters. Not only would it help experimentation, but time too, as we have to download unnecessary base models over and over...
@jett_royce2 ай бұрын
LoRA is such an unlock for resource-constrained creators looking to leverage models for specific domains. Thank you for this amazing work!
@houbenbub2 ай бұрын
Awesome video, thanks for making it :)
@BruceChar0072 ай бұрын
能不能继续在微调后的LoRA模型上面微调,效果怎么样
@lophyre13802 ай бұрын
Very informative video, but please get a better mic
@user-wp8yx3 ай бұрын
Trying to teach a mistral7b model sanskrit. It already has Sanskrit characters as tokens and is the best performing 7b llama based model I can find. You seem like a knowledgable person in this area. Do you have any advice for lora? Rank, alpha? How about targeting of q,k,v? Other strategies? I have about 3gb of datasets that range from translations, corpus, to data tables. I wonder if I should use different strategies for different data types?
@user-ut4zh3pw7l3 ай бұрын
waiting for those future videos. lets generalize ood
@bobbyparikh56903 ай бұрын
Fantastic video Edward! In case someone wants a quick refresher on low-rank decomposition of matrices, here's a great video: kzbin.info/www/bejne/aKDKlaqmfalmjJo&ab_channel=ritvikmath
@arnoldpalmer-fv7pf3 ай бұрын
So much groundbreaking research broken down into an easy to follow 7 minute video, I love it 🙏
@nathangonzales-hess65693 ай бұрын
That was great. Thanks for sharing. I really appreciate the simple style, no distracting animated plots or fancy editing. Look forward to more!
@justinpresent3 ай бұрын
thanks edward for the gentle intro!
@ellielikesmath3 ай бұрын
i was trying to come up with something like this, in that i wanted to train a generator which would be the inverse of a classifier, and the classifier gave a score to how good a solution was drawn from some range. this looks miles and miles more sophisticated than what i was doing with tf and pytorch, but i definitely understand, at least on that level of abstraction, why such a development is necessary. i look forward to trying this, cheers.
@Bbb786513 ай бұрын
Thank you so much for the video Edward. Its an inspo seeing you make videos and take off. Im currently a masters of science student in data science and Im always excited about NN architectures and new ML algos. Whenever easy, could you please share 1-2 tips for writing good research papers in ML? I recently started in a lab that does neuroscience-ML, and rlly want to make an impact there
@faizanjaved14433 ай бұрын
Hey there! Can we talk about Q*, the AGI developed by Sam Altman? I'm excited to discuss this with you, it's one of the most interesting topics for me after Sora.
@candrewlee143 ай бұрын
This was fantastic! Thank you, it’s great to hear from a real expert in this AI mega-hype cycle.
@DB-Barrelmaker3 ай бұрын
The audio is terrible, it's noticeable when you're dealing with a complex subject containing alot of niche phrases
@DigitalAlligator3 ай бұрын
Shit, you invented LoRA 😮? How you come up with that idea works so good?!
@Niamato_inc3 ай бұрын
Thank you wholeheartedly.
@faizanjaved14433 ай бұрын
Here's a "Below are some new topics for you to discuss: - Grok-1 - Claude Opus - Gemini Ultra - Poe - Figure humanoid powered by OpenAI - Hugging Face - Sam Altman 7+ trillion - Google AI in iPhones - NVIDIA Disney robots Let me know if you need any help to choose the best topics for your content."
@BaKimura033 ай бұрын
Love the fact that you’re organic. Didn’t even lead with the big credential.. unlike some of these goofs who have done far less. 👏
@Niamato_inc3 ай бұрын
Thank you wholeheartedly.
@sumitpawar0003 ай бұрын
Sir, please make more videos explaining fundamental concepts as well as latest breakthroughs in AI field. Your style of explanation is neat and pin point. Everyone will get benefited out of these videos.
@chitarito1003 ай бұрын
Hey, I’m glad you’re on KZbin! It’s great to have an expert in the field break down complex topics and intuition and also explain real world applications not just theory. I think it would be nice if you could have some summary pointers overlaid in the video or on a summary slide with you overlaid on it. Different people have different learning styles and being able to read helps.
@Jandodev3 ай бұрын
I found a way to do this at my company with just LLM's! I used LLM's to not only generate the process steps but also make a liminal/expansion map of the ideas themselves that could lead to those individual processing steps! The trick to make it run wasn't to fit to a "reward function" but to use the "reward function" for back propagation as the starting point to then determine what was needed from the user to retrieve and select the correct path!
@automatalearninglab3 ай бұрын
Nice! Turn up your volume! Loved the topic! :)
@kibrutemesgen17593 ай бұрын
Amazing explanation with clear explanation of the intuition. It would be great if you give us one more vedio on implementation or detail explanation of how Gflownet is used to enhance reasoning of LLMs (i.e the paper)
@james-cucumber3 ай бұрын
Thanks for including subtitles with this video. I’m pretty sure (but not certain given you may have access to better models than regular Joes) that it’s been manually edited or written from scratch. If so, extra thank you!
@yiannishadjiyianni77373 ай бұрын
This might be dumb but I wonder how applicable can GFlowNets be in an object detection/instance segmentation context where the distribution created is based on the millions of images the model will train on and the "pathways" of the help the model be even more accurate
@vtrandal3 ай бұрын
Fantastic
@_rd_kocaman3 ай бұрын
You’re gonna need a graphic designer to reach broad range of audience
@alinmathuo40184 ай бұрын
You don’t need microphone, just find ai tool that fix it🙃
@user-lf4ir3mp2f4 ай бұрын
great man
@RonLWilson4 ай бұрын
This looks very promising!
@RonLWilson4 ай бұрын
BTW, I have been working on a graphical way of building Ontology models that I am calling UniML (Universal Modeling Language) that can model the GflowNets process quite readily much like OWL or RDF graphs, but even more graphically. Something like this might help develop these nets in that it is a way to better visualize them. I made a number of introductory videos that I uploaded on my KZbin channel that describe them in more detail into their what's and why's plus a Padlet virtual corkboard that takes a bit of of a closer look at them. UniML can model NNs as well, or just treat them as functions (Chips).
@jayyoung75774 ай бұрын
Wow❤ please post more deep dive videos. Thank you for sharing!
@jan34774 ай бұрын
Great video, but it was a bit too fast for me to keep up with the complex topic.
@unclecode4 ай бұрын
Hi Edward, I've been following your channel since you had long hair, and I've noticed two things: 1) You post videos when you have a new paper meaning new discoveries, and 2) Your hair seems to get shorter in each video. If I had to predict, based on these three videos, (overfitting) your next video will have you bald! 😀😀 Nonetheless, you are incredibly talented, and your timing and placement are impeccable.
@MrMehrd4 ай бұрын
Thx nice intro
@miikalewandowski77654 ай бұрын
Brilliant topic and explanation! Looking forward for your deep dives and if you like some observations or insights you have made on your saga as a researcher 😊
@user-hu2tn8ef8r4 ай бұрын
Is it me or is this AI generated?
@peace_and_blessings11114 ай бұрын
Sir, with all due respect ,please don't take my question in the wrong way. How can a total newbie get started in AI ? What are the books you would recommend reading and the things Id need to do? Sir I really appreciate the clarity and intensity of your incredible thought processes. Love you sir.
@JumpDiffusion4 ай бұрын
Good stuff
@PharaoTeti4 ай бұрын
Great scientist and communicator!
@user-wr4yl7tx3w4 ай бұрын
this is really informative. thanks for taking time to make such videos.