NVIDIA's Nemotron-4's is totally insane for synthetic data generation

[@erfanshayegani3693]

Your videos help me a lot stay up-to-date with the latest stuff. This video for example, led me to these new reward models and datasets that have been released only a few days ago! I think if you can also have some 10 min videos weekly to summarize the important releases and new stuff it would be great! Many thanks for the great content again!

[@chrishayuk]

Sadly, 10 mins weekly summary videos isn’t my style. Check out the IBM mixture of experts podcast though, I’m usually on every 4 weeks or so

[@pratiknarendraraut6889]

igrore the dude below, awesome content , keep going .

[@chrishayuk]

Appreciate it!

[@sidharthrao9005]

Is there any possiblities to fine-tune, quantise or distill the model into a smaller model to be run locally? I urgently need this for a project I'm doing.

[@chrishayuk]

i'm not aware of anyone that has done this tbh, it's quite a large model. and it'd be a challenge to get it small enough

[@bamh1re318]

what kind of hardware requirement do I need to run this? Thanks!

[@chrishayuk]

more than most can afford, it really needs to be run on cloud. i think it's like a cluster of 8 x H100's or something to run it, not sure off the top of my head

[@richsoftwareguy]

Maybe you need new glasses. Your eyes keep getting stuck together, hella annoying.

[@everyhandletaken]

How respectful of you. There are other channels, if you can't cope.

[@chrishayuk]

lol, tell me about it, I have a light sensitivity hence why I wear the glasses. I don’t think anything but my sunglasses will fix that, sadly

[@WillJulian-Vicary]

@@chrishayuk Ignore the troll, thought your video was great - thanks for sharing.

[@chrishayuk]

thank you, appreciate it

[@chrishayuk]

thank you, appreciate it