LLaVA: A large multi-modal language model

[@Jerad-wu3xt]

Just found your site. I’m learning so much. You do a great job explaining things. Thanks for all you do to help people.

[@thisurawz]

Can you do a video on finetuning a multimodal LLM (Video-LlaMA, LLaVA, or CLIP) with a custom multimodal dataset containing images and texts for relation extraction or a specific task? Can you do it using open-source multimodal LLM and multimodal datasets like video-llama or else so anyone can further their experiments with the help of your tutorial. Can you also talk about how we can boost the performance of the fine-tuned modal using prompt tuning in the same video?

[@aragaodan]

So cool. GenAI is a never ending stream of fun.

[@AdamMonago]

Nice job on this video series Mark.

[@StudyWithMe-mh6pi]

Nice job 👏👏

[@kenbajema]

Thanks for posting. I have it working but I do see an error in Cygwin when I run it regarding a missing cl.exe which exists but it seems to be working

[@learndatawithmark]

It might be worth posting the error as a GitHub issue so they can look into it, but good it works even with the error!

[@vishalnakey4703]

👏

[@PeterCorless]

Me, immediately honing in on the misspelling of "instruction" at the 17 second mark. 🫠

[@learndatawithmark]

Didn't spot that haha, good one!